HBase hbck 命令

HBase提供一个hbck工具，其功能由HBaseFsck类来实现，主要用来做一致性检查和完整性检查。可以通过以下命令来查看hbck的参数，

[root@openstack-2 ~]# hbase hbck -hJava HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release17/06/05 15:31:52 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFSUsage: fsck [opts] {only tables} where [opts] are:   -help Display help options (this)   -details Display full report of all regions.   -timelag <timeInSeconds>  Process only regions that  have not experienced any metadata updates in the last  <timeInSeconds> seconds.   -sleepBeforeRerun <timeInSeconds> Sleep this many seconds before checking if the fix worked if run with -fix   -summary Print only summary of the tables and status.   -metaonly Only check the state of the hbase:meta table.   -sidelineDir <hdfs://> HDFS path to backup existing meta.   -boundaries Verify that regions boundaries are the same between META and store files.   -exclusive Abort if another hbck is exclusive or fixing.   -disableBalancer Disable the load balancer.  Metadata Repair options: (expert features, use with caution!)   -fix              Try to fix region assignments.  This is for backwards compatiblity   -fixAssignments   Try to fix region assignments.  Replaces the old -fix   -fixMeta          Try to fix meta problems.  This assumes HDFS region info is good.   -noHdfsChecking   Don't load/check region info from HDFS. Assumes hbase:meta region info is good. Won't check/fix any HDFS issue, e.g. hole, orphan, or overlap   -fixHdfsHoles     Try to fix region holes in hdfs.   -fixHdfsOrphans   Try to fix region dirs with no .regioninfo file in hdfs   -fixTableOrphans  Try to fix table dirs with no .tableinfo file in hdfs (online mode only)   -fixHdfsOverlaps  Try to fix region overlaps in hdfs.   -fixVersionFile   Try to fix missing hbase.version file in hdfs.   -maxMerge <n>     When fixing region overlaps, allow at most <n> regions to merge. (n=5 by default)   -sidelineBigOverlaps  When fixing region overlaps, allow to sideline big overlaps   -maxOverlapsToSideline <n>  When fixing region overlaps, allow at most <n> regions to sideline per group. (n=2 by default)   -fixSplitParents  Try to force offline split parents to be online.   -ignorePreCheckPermission  ignore filesystem permission pre-check   -fixReferenceFiles  Try to offline lingering reference store files   -fixEmptyMetaCells  Try to fix hbase:meta entries not referencing any region (empty REGIONINFO_QUALIFIER rows)  Datafile Repair options: (expert features, use with caution!)   -checkCorruptHFiles     Check all Hfiles by opening them to make sure they are valid   -sidelineCorruptHFiles  Quarantine corrupted HFiles.  implies -checkCorruptHFiles  Metadata Repair shortcuts   -repair           Shortcut for -fixAssignments -fixMeta -fixHdfsHoles -fixHdfsOrphans -fixHdfsOverlaps -fixVersionFile -sidelineBigOverlaps -fixReferenceFiles -fixTableLocks -fixOrphanedTableZnodes   -repairHoles      Shortcut for -fixAssignments -fixMeta -fixHdfsHoles  Table lock options   -fixTableLocks    Deletes table locks held for a long time (hbase.table.lock.expire.ms, 10min by default)  Table Znode options   -fixOrphanedTableZnodes    Set table state in ZNode to disabled if table does not exists Replication options   -fixReplication   Deletes replication queues for removed peers

一旦开始运行，hbck工具会执行.META.表来收集持有的所有相关信息，还会扫描HBase使用的HDFS中的root目录。然后比较收集的信息来报告相关的一致性和完整性问题。

• 一致性检查
  一致性检查以region为单位，检查region是否同时存在于.META.表和HDFS中，并检查是否被指派给唯一的region服务器。

• 完整性检查
  完整性检查以表为单位，将region与表细节信息比较以找到缺失的region，同时检查region起止键范围中的空洞或重叠情况。