Spark和Scala的网络资源汇集

来源:互联网 发布:陕西广电网络总经理 编辑:程序博客网 时间:2024/05/12 06:42

Spark和Scala的网络资源汇集

作者:chszs,未经博主允许不得转载。经许可的转载需注明作者和博客主页:http://blog.csdn.net/chszs

本文的目的是为Spark和Scala初学者提供一些学习资源。

1、Github上的Scala Workshop

https://github.com/airisdata/scalaworkshop

2、Setup资源

  • 下载Scala 2.11.8: http://www.scala-lang.org/download/
  • 下载Apache Spark 1.6.1: http://spark.apache.org/downloads.html

3、Scala安装

http://www.scala-lang.org/download/install.html

4、Setup

首先确保本地安装了Java 7或Java 8环境,再下载Scala 2.11.8、SBT以及Spark,最好是再安装Maven。

5、解决本地Spark的问题

export SPARK_MASTER_IP=127.0.0.1export SPARK_LOCAL_IP=127.0.0.1export SCALA_HOME=~/Downloads/scala-2.10.6export PATH=$PATH:$SCALA_HOME/bin

对于Windows系统,使用SET命令代替EXPORT。

6、书籍

  • Learning Spark: http://www.amazon.com/Learning-Spark-Lightning-Fast-Data-Analysis/dp/1449358624
  • Scala by Example by Odersky: http://www.scala-lang.org/docu/files/ScalaByExample.pdf
  • Scala Overview by Odersky: http://www.scala-lang.org/docu/files/ScalaOverview.pdf
  • Programming in Scala, First Edition by Odersky: http://www.artima.com/pins1ed/
  • Structure and Interpretation of Computer Programs: http://mitpress.mit.edu/sicp/full-text/book/book.html
  • Scala for the Impatient: http://www.amazon.com/Scala-Impatient-Cay-S-Horstmann/dp/0321774094
  • Programming Scala: http://www.amazon.com/Programming-Scala-Scalability-Functional-Objects/dp/0596155956
  • Scala-Lang官网给出的书籍列表: http://www.scala-lang.org/documentation/books.html
  • Advanced Analytics with Spark: http://www.amazon.com/Advanced-Analytics-Spark-Patterns-Learning/dp/1491912766
  • Spark Cookbook: http://www.amazon.com/Spark-Cookbook-Rishi-Yadav/dp/1783987065

7、在线指南

  • Scala for Java Programmers: http://docs.scala-lang.org/tutorials/scala-for-java-programmers.html
  • Scala Tutorial: http://www.scala-lang.org/docu/files/ScalaTutorial.pdf
  • Effective Scala (Twitter): http://twitter.github.io/effectivescala/
  • Scala Tour: http://www.scala-tour.com/#/welcome

8、E-Books

  • Books at Lightbend (Typesafe): http://www.lightbend.com/resources/e-books
  • AtomicScala (sample): http://www.atomicscala.com/free-sample/

9、Scala Koans/Exercises

  • Scala Exercises: http://scala-exercises.47deg.com/
  • Scala Koans: http://www.scalakoans.org/

10、资源

  • Scala Roundup for Java Engineers: http://www.codecommit.com/blog/scala/roundup-scala-for-java-refugees
  • Scala Info at StackOverflow: http://stackoverflow.com/tags/scala/info
  • Scala Cheetsheats: http://docs.scala-lang.org/cheatsheets/
  • Scala Notes: http://aperiodic.net/phil/scala/s-99/
  • Cake Solutions Blog: http://www.cakesolutions.net/teamblogs
  • Scala School (Twitter): https://twitter.github.io/scala_school/
  • Functional Programming in Scala: http://nerd.kelseyinnis.com/blog/2013/01/07/resources-for-getting-started-with-functional-programming-and-scala/
  • How to Learn Scala: http://blog.codacy.com/2015/07/03/how-to-learn-scala/#gs.GX=delw
  • Scala Lang Overviews: http://docs.scala-lang.org/overviews/
  • Learning Scala in Small Bites: http://matt.might.net/articles/learning-scala-in-small-bites/

11、Scala在线免费课程

  • Functional Programming with Scala: https://www.coursera.org/course/progfun
  • Reactive Programming with Scala: https://www.coursera.org/course/reactive

12、Spark在线免费课程

  • Big Data Analysis with Spark: https://www.edx.org/course/big-data-analysis-spark-uc-berkeleyx-cs110x
  • Distributed Machine Learning with Spark: https://www.edx.org/course/distributed-machine-learning-spark-uc-berkeleyx-cs120x
  • Introduction to Spark: https://www.coursera.org/learn/hadoop/lecture/9cq0R/introduction-to-apache-spark
  • Spark Fundamentals: http://bigdatauniversity.com/courses/spark-fundamentals/
  • Data Science / Engineering Spark: https://www.edx.org/xseries/data-science-engineering-spark
  • CS100: https://courses.edx.org/courses/BerkeleyX/CS100.1x/1T2015/
  • CS190: https://courses.edx.org/courses/BerkeleyX/CS190.1x/1T2015/
1 0
原创粉丝点击