编译运行HBase源码，安装hadoop集群

node1:namenode, datanode, jobtracker, tasktracker,zookeeper, hmaster, hregionserver

node2:datanode, tasktracker, hregionserver

 

Install maven, edit /etc/profile:

export M2_HOME=/home/apache-maven-3.1.1

export PATH=$M2_HOME/bin:$PATH

 

source /etc/profile

 

Edit /etc/hosts

192.168.20.24 node1

192.168.20.98 node2

 

Configuring key baased login:

ssh-keygen –t rsa

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

chmod 0600 ~/.ssh/authorized_keys

scp ~/.ssh/authorized_keys root@node2:/root/.ssh/

 

1.   Install Hadoop

Download Hadoop:

http://www.apache.org/dyn/closer.cgi/hadoop/common/

 

Edit conf/core-site.xml

<configuration>

 

<property>

    <name>fs.default.name</name>

    <value>hdfs://node1:9000</value>

</property>

<property>

    <name>dfs.permissions</name>

    <value>false</value>

</property>

 

</configuration>

 

Edit conf/hdfs-site.xml

<configuration>

 

<property>

        <name>dfs.data.dir</name>

        <value>/opt/hadoop/hadoop/dfs/name/data</value>

        <final>true</final>

</property>

<property>

        <name>dfs.name.dir</name>

        <value>/opt/hadoop/hadoop/dfs/name</value>

        <final>true</final>

</property>

<property>

        <name>dfs.replication</name>

        <value>2</value>

</property>

 

</configuration>

 

Edit conf/mapred-site.xml

<configuration>

 

<property>

        <name>mapred.job.tracker</name>

        <value>node2:9001</value>

</property>

 

</configuration>

 

Edit conf/slaves

node1

node2

 

Edit conf/master

node1

 

Edit conf/hadoop-env.sh

export JAVA_HOME=/usr/java/jdk1.7.0_21

 

Hadoop format:

bin/hadoop namenode -format

 

copy the code to node2:

scp -r hadoop-1.2.1/ root@node2:/opt/

 

 

start hadoop:

bin/start-all.sh

 

2. Compile and Install HBase

Download HBase

git clone https://github.com/apache/hbase.git

 

Edit conf/hbase-site.xml

<configuration>

 <property>

    <name>hbase.rootdir</name>

    <value>hdfs://node1:9000/hbase</value>

 </property>

 <property>

    <name>hbase.cluster.distributed</name>

    <value>true</value>

 </property>

 <property>

    <name>hbase.zookeeper.quorum</name>

    <value>node1</value>

 </property>

 <property>

   <name>hbase.assignment.maximum.attempts</name>

   <value>1</value>

 </property>

</configuration>

 

Edit conf/hbase-env.sh

export HBASE_MANAGES_ZK=true

export JAVA_HOME=/usr/java/jdk1.7.0_21

 

Edit conf/regionservers

node1

node2

 

Build hbase:

mvn clean package -DskipTests -Dhadoop.profile=1.1 -Dhadoop.version=1.2.1

 

copy the code to node2:

scp -r hbase-trunk/ root@node2:/opt/

 

start hbase:

bin/start-hbase.sh