hadoop 中的一个属性及启示

来源:互联网 发布:ubuntu进不了win10 编辑:程序博客网 时间:2024/05/16 04:36

1. 

Hadoop+HBase cluster on windows: winutils not found

When trying to start hbase from my master (./bin/start-hbase.sh), I get the following error:

.......


We've found it. So, in Hadoop's Shell.java, you'll find that there are two options to communicate the Hadoop-path.

// first check the Dflag hadoop.home.dir with JVM scopeString home = System.getProperty("hadoop.home.dir");// fall back to the system/user-global env variableif (home == null) {  home = System.getenv("HADOOP_HOME");}

After trial and error, we found that in the HBase options (HBase's hbase-env.sh, HBASE_OPTS variable), you'll need to add in this option with the Windows(!) path to Hadoop. In our case, we needed to add -Dhadoop.home.dir=D:/hadoop .

Good luck to anyone else who happens to stumble across this ;).


0 0