HDFS常用命令

来源：互联网发布：数据库原理王新梅编辑：程序博客网时间：2024/05/21 19:36

1、查看空间使用情况：hdfs dfs -df -h
Filesystem Size Used Available Use%

hdfs://black:8020 58.8 G 356 K 28.9 G 0%

2、查看文件列表：hdfs dfs -ls /

Found 3 items
drwxr-xr-x - hdfs hdfs 0 2016-10-15 13:03 /apps
drwxrwxrwx - hdfs hdfs 0 2016-10-15 13:05 /tmp
drwxr-xr-x - hdfs hdfs 0 2016-10-15 13:01 /user

3、查看目录下空间占用情况：hdfs dfs -du -h /

10.5 K /apps
2.2 K /tmp
0 /user

4、hdfs块检查：hdfs fsck /
Connecting to namenode via http://black:50070
FSCK started by hdfs (auth:SIMPLE) from /127.0.0.1 for path / at Sat May 20 06:05:04 CST 2017
.
/apps/hbase/data/WALs/black,60020,1495231329684/black%2C60020%2C1495231329684.1495231341393.meta: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741983_1173. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/default/ambarismoketest/.tabledesc/.tableinfo.0000000001: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741839_1015. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/default/ambarismoketest/6ac7bbb05c7d14953c3a1b20fe4f3fba/.regioninfo: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741840_1016. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/default/ambarismoketest/6ac7bbb05c7d14953c3a1b20fe4f3fba/family/53379f0503074dffab00a0ba4fff8276: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741849_1025. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/default/ambarismoketest/6ac7bbb05c7d14953c3a1b20fe4f3fba/family/90da734315d04e2c9d6ba8a8fd5b2835: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741934_1119. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
..
/apps/hbase/data/data/hbase/meta/.tabledesc/.tableinfo.0000000001: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741828_1004. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/hbase/meta/1588230740/.regioninfo: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741827_1003. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/hbase/meta/1588230740/info/efa0fb1a362049ce8dcfea91ddff23d6: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741979_1168. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
..
/apps/hbase/data/data/hbase/namespace/.tabledesc/.tableinfo.0000000001: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741832_1008. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/hbase/namespace/158f0b170485d14f6f8710b7b43b72a8/.regioninfo: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741833_1009. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/data/hbase/namespace/158f0b170485d14f6f8710b7b43b72a8/info/f4c47dbca3de4f108bcb69ecc63ef546: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741846_1022. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
..
/apps/hbase/data/hbase.id: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741826_1002. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/hbase.version: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741825_1001. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/oldWALs/black%2C60020%2C1478299588893.1478299608187: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741975_1174. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/oldWALs/black%2C60020%2C1478299588893.1478299931697.meta: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741980_1171. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/oldWALs/black%2C60020%2C1495231329684.1495231334026: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741981_1170. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/apps/hbase/data/oldWALs/black%2C60020%2C1495231329684.1495231340672.meta: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741982_1172. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
.
/tmp/id007f0100_date041516: Under replicated BP-1010931634-127.0.0.1-1476507690874:blk_1073741838_1014. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).
Status: HEALTHY
Total size: 14829 B (Total open files size: 166 B)
Total dirs: 35
Total files: 21
Total symlinks: 0 (Files currently being written: 2)
Total blocks (validated): 18 (avg. block size 823 B) (Total open file blocks (not validated): 2)
Minimally replicated blocks: 18 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 18 (100.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 1.0
Corrupt blocks: 0
Missing replicas: 36 (66.666664 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Sat May 20 06:05:04 CST 2017 in 148 milliseconds

The filesystem under path '/' is HEALTHY

阅读全文

0 0