安装 360的 poseidon

来源:互联网 发布:dubstep软件 编辑:程序博客网 时间:2024/06/14 15:42

wget https://services.gradle.org/distributions/gradle-3.5-all.zipunzip gradle-3.5-all.zipmv gradle-3.5 /usr/localvi /etc/profile加上GRADLE_HOME=/usr/local/gradle-3.5export PATH=$PATH:$GRADLE_HOME/binsource /etc/profilegradle -v

看到

------------------------------------------------------------Gradle 3.5------------------------------------------------------------Build time:   2017-04-10 13:37:25 UTCRevision:     b762622a185d59ce0cfc9cbc6ab5dd22469e18a6Groovy:       2.4.10Ant:          Apache Ant(TM) version 1.9.6 compiled on June 29 2015JVM:          1.8.0_121 (Oracle Corporation 25.121-b13)OS:           Linux 2.6.32-696.el6.x86_64 amd64

说明成功。

=============================

wget http://memcached.org/files/memcached-1.4.36.tar.gztar -zxf memcached-1.4.36.tar.gzcd memcached-1.4.36./configure && make && make test && sudo make installls -al /usr/local/bin/mem*  查看是否成功

/usr/local/bin/memcached -d -m 1024 -u root -l 0.0.0.0 -p 11211 -c 1024 -P /tmp/memcached.pid-d 选项是启动一个守护进程-m 是分配给Memcache使用的内存数量,单位是MB-u 是运行Memcache的用户-l 是监听的服务器IP地址-p 是设置Memcache监听的端口-c 选项是最大运行的并发连接数,默认是1024,按照服务器的负载量来设定,-P 是设置保存Memcache的pid文件kill `cat /tmp/memcached.pid`  结束Memcache进程

=============================

安装 启动 redis

=============================

安装 启动 hadoop: http://blog.csdn.net/gold2008/article/details/72403729


=============================

mkdir -p /root/go/src/github.com/Qihoo360

cd /root/go/src/github.com/Qihoo360git clone https://github.com/Qihoo360/poseidoncd poseidonsh ./build.sh

mkdir /usr/local/poseidoncd distcp -rf * /usr/local/poseidontar -zxf idgenerator*.tar.gztar -zxf poseidon_proxy*.tar.gztar -zxf poseidon_searcher*.tar.gztar -zxf meta*.tar.gzsh /usr/local/poseidon/idgenerator/serverctl start    监听 39360sh /usr/local/poseidon/meta/serverctl start           监听 39610sh /usr/local/poseidon/proxy/serverctl start          监听 39460sh /usr/local/poseidon/searcher/serverctl start       监听 39504

tar -xf hdfsreader-0.1.tarmv hdfsreader-0.1 hdfsreadervi /usr/local/poseidon/hdfsreader/etc/core-site.xml<value>hdfs://localhost:9000</value>sh /usr/local/poseidon/hdfsreader/bin/hdfsReader.sh start

tar -zxf docformat-0.1.tar.gzmv docformat-0.1 docformatvi /usr/local/poseidon/docformat/etc/docformat.json"hadoop_cmd":"./bin/real-hadoop.sh"sh /usr/local/poseidon/docformat/bin/install.sh start


wget https://raw.githubusercontent.com/liwei-ch/poseidonlog/master/weibo_data.tar.gztar -xvf weibo_data.tar.gzsh /usr/local/poseidon/docformat/bin/demo.sh /usr/local/poseidon/weibo_data.txt


tar -xf index-0.1.tarmv index-0.1 indexsh /usr/local/poseidon/index/bin/start.sh 2017-05-16


出现错误 doc meta setter map reduce test 2017-05-16 failed, 经过多次测试是 hadoop 没有安装配置好,一定要按照说明步骤仔细操作。



原创粉丝点击