ADAM学习之4集群安装（未成功）

来源：互联网发布：如何安装c语言编辑：程序博客网时间：2024/06/12 20:22

更多代码请见：https://github.com/xubo245/SparkLearning

ADAM学习之4集群安装（未成功）

1.基本：
$ git clone https://github.com/bigdatagenomics/adam.git

$ cd adam

$ export MAVEN_OPTS="-Xmx512m -XX:MaxPermSize=256m"

2.安装maven

3.配置pom.xml

可能要启动

4.$ mvn clean package -DskipTests
需要多次重试，老是卡在adam-core

alias adam-submit="/home/hadoop/cloud/adam/bin/adam-submit"
alias adam-shell="/home/hadoop/cloud/adam/bin/adam-shell"

hadoop fs -put ../adam-core/src/test/resources/small.vcf

hadoop fs -put ../adam-core/src/test/resources/* /adam/adam-core

去除安全模式：bin/hadoop dfsadmin -safemode leave
http://blog.csdn.net/xw13106209/article/details/6866072

20160305：
测试：
adam-submit transform /xubo/adam/dataAdam/small.sam /xubo/adam/output/smallMcnode2.adam

其他：
sudo rm -r adam

export ADAM_HOME=$CLOUD_PREFIX/adam
export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib:$SPARK_HOME/assembly/target/scala-2.10:$ADAM_HOME/lib
export PATH=$HOME/bin:$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$ADAM_HOME/bin:$PATH

source /etc/profile

备份：
export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib:$SPARK_HOME/assembly/target/scala-2.10:$ADAM_HOME/lib:$ADAM_HOME/adam-core/target/scala-2.10.4/classes:$ADAM_HOME/lib/adam-apis_2.10-0.18.3-SNAPSHOT.jar:$ADAM_HOME/lib/adam-cli_2.10-0.18.3-SNAPSHOT.jar:$ADAM_HOME/lib/adam-core_2.10-0.18.3-SNAPSHOT.jar

笔记：

1.从Master用dispath.sh将adam分发到其他节点

2.修改每个节点的/etc/profile,并且source

3.为什么还是找不到ADAMcontext??

0 0