pyhs2搭建详细过程

来源:互联网 发布:lol for mac 美服下载 编辑:程序博客网 时间:2024/06/03 15:10

1.1            安装python

系统自带python环境,故不需认为安装

2            引入需要模块

sudo yum installpython-setuptools -y

sudo yum install gcclibffi-devel python-devel openssl-devel -y

sudo yum install gcc-c++-y

sudo yum install -y unzip

sudo yum install -y boostboost-devel

sudo yum install -yautomake

sudo yum installcyrus-sasl-devel  cyrus-sasl-plain cyrus-sasl-gssapi-y

下载 sasl-0.2.1.tar.gz

   Python setup.py install

下载 thrift-0.9.3.tar.gz

   Python setup.py install

下载pyhs2-master.zip

python setup.py build

python setup.py install

以及从原有集群中导入python hive的相关模块:

python/home/hadoop/python/thrift-0.9.3/lib/py/setup.py install

/home/hadoop/python/thrift-0.9.3/contrib/fb303/bootstrap.sh

./configure 

python setup.py build

sudo python setup.py install

 

--安装fb303(thrift-0.9.3包内就有)

cd contrib/fb303

./bootstrap.sh

./configure--prefix=/usr/local/thrift/fb303 --with-thriftpath=/usr/local/thrift/

cp -r/usr/local/thrift/include/thrift .


---测试

写一个简单的python访问hive脚本进行测试,验证OK