Spark Internals

来源:互联网 发布:js获取json字符串数据 编辑:程序博客网 时间:2024/06/07 23:04

一,what is spark

1,what is spark?


ApacheSpark™ is afast and general engine for large-scale data processing.

--对于业务层来说 spark是一个大数据解决方案,对于开发者来说是sdk 和 一堆API

--官网

Spark.apache.org

www.databricks.com

2,what does spark have?


3,spark utility tools

二,Spark programmingmodel

1,Programming model

2,RDD

3,Spark-shell


三,Spark runtimeinfrastructure

1,Run time infrastructure

2,WordCounts example

3,Run on different cluster


0 0
原创粉丝点击