安装yarn下的spark过程记录以及sparkr安装记录

spark安装

hadoop参考这个
http://www.powerxing.com/install-hadoop/
http://www.bubuko.com/infodetail-650807.html

sql安装

http://www.cnblogs.com/liuchangchun/p/4099003.html

hive安装

http://www.cnblogs.com/zouzhongfan/p/4309432.html
http://www.tuicool.com/articles/bmUjAjj

R安装

sudo gedit  /etc/apt/sources.list加入:deb http://cran.cnr.Berkeley.edu/bin/linux/ubuntu trusty/更新软件源：sudo apt-get updatesudo apt-get install r-base r-base-dev

Rstudio安装

http://www.rstudio.com/products/rstudio/download-server/
不能用root登陆!!!!!

安装sparkr

安装rjava

wget http://cran.r-project.org/src/contrib/rJava_0.9-6.tar.gzR CMD javareconf #R的程序从系统变量中会读取Java配置R CMD INSTALL rJava_0.9-6.tar.gz

安装Rcurl,devtools

yum install libcurl yum install libcurl-devel install.packages("RCurl") install.packages("devtools") 

安装maven

http://blog.csdn.net/zdnlp/article/details/7457596

安装SparkR包

library(devtools)install_github("amplab-extras/SparkR-pkg", subdir="pkg")