Programmer Group

advantage: If we store a large amount of HBase data at one time, the processing speed is slow, and the Region resources are particularly occupied, a more efficient and convenient method is to use the "Bulk Loading" method, that is, the HFileOutputFormat class provided by HBase. It uses the principle that hbase data information is ...

2021SC@SDUSC hbase source code analysis (x) HFile analysis (2) 2021SC@SDUSC 2021SC@SDUSC 2021SC@SDUSC 2021SC@SDUSC HFileBlock HFileBlock mainly includes two parts: BlockHeader and BlockData. BlockHeader mainly stores Block related metadata, and BlockData is used to store specific data. The core field in Block metadata is the BlockType ...

2021SC@SDUSC 1, Brief description Snapshot is a function supported by many storage systems and database systems. A snapshot is the image of a whole file system or a directory at a certain time. 2, Basic principle The simplest and crudest way to realize data file mirroring is to lock the copy (the reason for locking is that the data obtai ...

2021SC@SDUSC 1, Brief description Coding + compression can double the disk space of data and save considerable storage costs. At the same time, shrinking can usually improve the system throughput, so that the system can do more work In terms of space saving processing at the storage level, HBase provides two schemes: 1. Key based coding. I ...

Purpose: (1) Understand the role of HBase in Hadoop architecture. (2) Proficient in using HBase to operate common Shell commands. Objectives: (1) Be familiar with hbase related operations, and master the operations of creating tables, modifying tables, looking up tables, deleting tables, etc. (2) You can create a table by yourself, be familiar ...

    hbase is a member of hadoop ecology. To build hbase first, you need to install hadoop, then zookeeper, and then hbase. Now hbase can be installed directly through docker, and hadoop is not required in the container.     The installation is simple. Directly pull the image and run it. docker run -d --name hbase -p 2181 ...

2021SC@SDUSC                  In the fourth article, we explored how cacheflush initializes. Now let's look at how cacheflush handles flush requests.          Through the analysis in the previous article, we know that there are two queues and collections that store flush requests ...

1, Install docker 1. Download offline package Index of linux/static/stable/x86_64/ 2. Decompression tar -xzvf docker-18.06.3-ce.tgz (ce version means community free version, please specify   The difference between docker with ce and without ce) 3. Copy the extracted folder to the / usr/local directory cp docker-18.06.3-ce /usr/local ...

2021SC@SDUSC 1, HBase overview What is HBase HBase is a database system built on HDFS, which provides high reliability, high performance, column storage, scalability and real-time reading and writing. It is mainly used to store unstructured and semi-structured loose data. HBase uses hadoop HDFS as its file storage system, Hadoop MapReduc ...

Start learning big data again - Hbase - day 56 Phoenix Phoenix overview    Hbase is suitable for storing a large number of NOSQL data with low requirements for relational operations. Due to the limitations of Hbase design, it is not possible to directly use the native API to perform the operations such as condition judgment a ...