spark rdd countByValue

来源:互联网 发布:js隐藏select标签 编辑:程序博客网 时间:2024/05/22 13:00
package com.latrobe.sparkimport org.apache.spark.{SparkContext, SparkConf}/** * Created by spark on 15-1-18. * 统计出集合中每个元素的个数 */object CountByValue {  def main(args: Array[String]) {    val conf = new SparkConf().setAppName("spark-demo").setMaster("local")    val sc = new SparkContext(conf)    val xx = sc.parallelize(List(1,1,1,1,2,2,3,6,5,9))    //打印结果:Map(2 -> 2, 5 -> 1, 1 -> 4, 9 -> 1, 3 -> 1, 6 -> 1)    println(xx.countByValue())  }}
0 0
原创粉丝点击