特牛网址导航

Spark去重操作_spark rdd reducebykey 去重-CSDN博客

网友收藏
文章浏览阅读727次。import Utils.SparkUtilsimport org.apache.spark.SparkContextimport org.apache.spark.rdd.RDDobject ReduceByKeyDemo { def main(args: Array[String]): Unit = { val sc: SparkContext =SparkUtils.getSparkContext() val tf: RDD[String] =sc.textFile("da_spark rdd reducebykey 去重