特牛生活网

Structed Streaming集成kafka_"java structed sparksession readstream(\"kafka\")"-CSDN博客

网友收藏
文章浏览阅读201次。读取kafka数据 // 构建SparkSession实例对象,相关配置进行设置 val spark: SparkSession = SparkSession.builder() .appName(this.getClass.getSimpleName.stripSuffix("$")) .master("local[2]") // 设置Shuffle时分区数目 .config("spark.sql.shuffle.partitions", "2"_"java structed sparksession readstream(\"kafka\")"