使用 Ambari 安装 Hbase

来源:互联网 发布:微信秒杀软件哪个好 编辑:程序博客网 时间:2024/05/18 15:27

安装准备:

腾讯云机器五台,分别是sehb1st、sehb2st、sehb3st、sehb4st、sehb5st,其中sehb1st作为master机,其它是client机

1.1 设置SSH免密登录

在 sehb1st 上生成 ssh 密钥:

ssh-keygen -t rsa

生成的密钥在~/.ssh文件夹下,将公钥 id_rsa.pub 中的内容拷贝到其它四台机器上~/.ssh/authorized_keys 文件中,然后执行:

chmod 600 ~/.ssh/authorized_keyschmod 700 ~/.ssh

把其它四台机器上 /etc/ssh/sshd_config 中的 PermitRootLogin no 改为 PermitRootLogin yes

测试 ssh sehb2st 可以成功登录

1.2 安装JDK

wget --no-check-certificate --no-cookies --header "Cookie: oraclelicense=accept-securebackup-cookie" http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.rpmrpm -ivh jdk-8u144-linux-x64.rpm

查看 java 版本 java -version 输出如下内容说明安装正确

openjdk version "1.8.0_141"OpenJDK Runtime Environment (build 1.8.0_141-b16)OpenJDK 64-Bit Server VM (build 25.141-b16, mixed mode)

1.2 安装Maven

wget https://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.5.0/binaries/apache-maven-3.5.0-bin.tar.gz tar xvf apache-maven-3.5.0-bin.tar.gz vi ~/.bashrc 添加  M2_HOME=/usr/local/apache-maven      export PATH=$PATH:$M2_HOME/bin source ~/.bashrc

查看maven版本信息mvn -v 输出如下内容说明安装正确:

Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-04T03:39:06+08:00)Maven home: /opt/maven/apache-maven-3.5.0Java version: 1.8.0_141, vendor: Oracle CorporationJava home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.141-1.b16.el7_3.x86_64/jreDefault locale: en_US, platform encoding: UTF-8OS name: "linux", version: "3.10.0-514.21.2.el7.x86_64", arch: "amd64", family: "unix"

1.3 安装Python setuptools

检测python 版本

pythonPython 2.7.5 (default, Nov  6 2016, 00:28:07) [GCC 4.8.5 20150623 (Red Hat 4.8.5-11)] on linux2Type "help", "copyright", "credits" or "license" for more information.>>> exit()

下载 setuptools-0.6c11-py2.7.egg ,然后执行sh setuptools-0.6c11-py2.7.egg

1.4 安装rpmbuild

yum --enablerepo=updates-testing install rpm-build

1.5 安装g++

yum install gcc-c++

1.6 安装NodeJS

wget https://nodejs.org/dist/v6.11.2/node-v6.11.2.tar.gztar xvf node-v6.11.2.tar.gz./configuremakemake install

设置环境变量:

vi ~/.bashrc添加 export PATH=/opt/maven/apache-maven-3.5.0/bin:$PATH    export PATH=/usr/local/bin:$PATHsource ~/.bashrc

1.7 安装brunch

npm install -g brunch@1.7.20

1.8 安装git

yum install -y git

1.9 安装ant

yum install -y ant

1.10 安装python-devel

yum install python-devel

2.1 下载ambari源码

wget http://www.apache.org/dist/ambari/ambari-2.5.1/apache-ambari-2.5.1-src.tar.gztar xfvz apache-ambari-2.5.1-src.tar.gzcd apache-ambari-2.5.1-srcmvn versions:set -DnewVersion=2.5.1.0.0pushd ambari-metricsmvn versions:set -DnewVersion=2.5.1.0.0popd 

2.2 build ambari源码

mvn -B clean install package rpm:rpm -DnewVersion=2.5.1.0.0 -DskipTests -Dpython.ver="python >= 2.6"

2.3 Install Ambari Server

yum install ambari-server*.rpm

2.4 Setup and Start Ambari Server

ambari-server setupambari-server start

2.5 Install and Start Ambari Agent on All Hosts

yum install ambari-agent*.rpmambari-agent start

3 会遇到的问题

3.1

[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm (install node and npm) on project ambari-admin: Could not extract the Node archive: Could not extract archive: ‘/root/.m2/repository/com/github/eirslett/yarn/0.23.2/yarn-0.23.2./yarn-v0.23.2.tar.gz
‘: EOFException -> [Help 1]

解决办法:将/root/.m2/repository/com/github/eirslett/yarn/0.23.2/yarn-0.23.2./yarn-v0.23.2.tar.gz删除,手动下载

3.2

Failed to execute goal on project ambari-metrics-storm-sink

解决办法:

vi /opt/ambari/apache-ambari-2.5.1-src/ambari-metrics/ambari-metrics-storm-sink/pom.xml

修改为如下
<dependency>
<groupId>org.apache.storm</groupId>
<artifactId>storm-core</artifactId>
<version>1.1.0</version>
<scope>provided</scope>
</dependency>

原创粉丝点击