Spark算子实现WordCount_用combinebykey实现wordcount-CSDN博客

网友收藏2024-01-23 16:50

链接地址：https://blog.csdn.net/weixin_39381833/article/details/108349646
链接标题：Spark算子实现WordCount_用combinebykey实现wordcount-CSDN博客
所属网站：blog.csdn.net
被收藏次数：7520

文章浏览阅读213次。1 map + reduceByKey sparkContext.textFile("hdfs://ifeng:9000/hdfsapi/wc.txt") .flatMap(_.split(",")) .map((_,1)) .reduceByKey(_+_).collect()2 countByValue代替map + reduceByKeyval RDDfile = sparkContext.textFile("hdfs://ifeng:9_用combinebykey实现wordcount

本文地址：https://tebull.com/detail/519319.html

标签：用combinebykey实现wordcount