[hard HBase] HBase Optimization: pre partition / RowKey design / memory optimization / basic optimization
This article is right [hard big data learning route] learning guide for experts from zero to big data (fully upgraded version) HBase partial supplement.
1 high availability
In HBase, HMaster is responsible for monitoring the lifecycle of HRegionServer and balancing the load of regional server. If HMaster fails, the whole HBase cluster will fa ...
Posted by svihas on Wed, 15 Sep 2021 19:31:12 -0700
Hbase client programming (Eclipse)
Hadoop stepping on the pit (4)
Hbase client programming (Eclipse)
Environmental Science
For the installation and configuration of Hbase and the configuration of Eclipse, please refer to the previous two articles
The version of hbase used in this series is 1.4.13
The selected hadoop version of this series is 2.8.5
Please pay attention to the per ...
Posted by Quest on Sun, 28 Jun 2020 21:59:57 -0700
HBase2 uses coprocessor to delete all data of the specified qualifier
In the user portrait scenario, many tags are usually developed. As a qualifier, each tag needs to be offline after some tags are no longer in use. However, the delete related api provided by hbase can only be used for a single line. It is not easy to clean up all the data of a qualifier. Here we provide an implementation scheme based on coproce ...
Posted by amchargue on Thu, 28 May 2020 08:18:34 -0700
HBase2 uses coprocessor to delete all data of the specified qualifier
In the user portrait scenario, many tags are usually developed. As a qualifier, each tag needs to be offline after some tags are no longer in use. However, the delete related api provided by hbase can only be used for a single line. It is not easy to clean up all the data of a qualifier. Here we provide an implementation scheme based on coproce ...
Posted by psn on Thu, 28 May 2020 08:17:55 -0700
phoenix-5.0.0 and CDH6.0.1 compatibility cause secondary index unavailable
Today, when testing phoenix's secondary index function, the following exception occurred when the index was created to write data:
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 1 action: org.apache.phoenix.hbase.index.builder.IndexBuildingFailureException: Failed to build index for unexpected reason!
...
Posted by superhaggis on Sat, 09 May 2020 07:38:49 -0700
Hbase API create table error record for Docker container deployment cluster
Hbase API create table error record
Demo method:
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.HColumnDescriptor;
import org.apache.hadoop.hbase.HTableDescriptor;
import org.apache.hadoop.hbase.TableName;
import org.apache.hadoop.hbase.client.Admin;
import ...
Posted by spartan7 on Tue, 05 May 2020 16:37:36 -0700
Hbase API create table error record for Docker container deployment cluster
Hbase API create table error record
Demo method:
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.HColumnDescriptor;
import org.apache.hadoop.hbase.HTableDescriptor;
import org.apache.hadoop.hbase.TableName;
import org.apache.hadoop.hbase.client.Admin;
import org.apa ...
Posted by fusionxn1 on Thu, 30 Apr 2020 02:57:56 -0700
The Comparator principle and source code learning of HBase Filter
**Foreword: * * last article HBase Filter overview This paper briefly introduces the composition and genealogy of HBase Filter. This paper mainly introduces the comparator of HBase Filter, which is also the necessary low-level soul skill for learning HBase Filter. The source code in this article is based on HBase 1.1.2.2.6.5.0-292 HDP version. ...
Posted by Oni on Sat, 25 Apr 2020 06:53:54 -0700
HBase operation: Spark read HBase snapshot demo share
**Before * * I shared with you a small demo of Spark reading HBase directly through the interface: HBase-Spark-Read-Demo However, if the amount of data is very large, Spark's direct scanning of HBase table will inevitably cause a lot of pressure on HBase cluster. Based on this, today I'd like to share with you the way spark directly reads HBas ...
Posted by vapokerpro on Fri, 17 Apr 2020 08:28:05 -0700
Reader's Letter|If you have too many Region s in your HBase cluster, take a look at this problem, which you may encounter
Preface: Reader's Letter is a question and answer column opened by the old HBase store, which aims to solve HBase-related problems frequently encountered in the work for more small partners.The store will try its best to help you solve these problems or give you a help. The store hopes this will be a small platform to help each other.If you hav ...
Posted by chatmaster on Mon, 06 Apr 2020 20:35:23 -0700