0
点赞
收藏
分享

微信扫一扫

Spark 读取clickhouse

我是芄兰 2022-03-12 阅读 141

第一步加入jar

<dependency>
<groupId>ru.yandex.clickhouse</groupId>
<artifactId>clickhouse-jdbc</artifactId>
<version>0.2.6</version>
</dependency>


第二步

public long prepareProductInfo(SparkSession s) {
Dataset<Row> house=s.read().format("jdbc")
.option("driver", "ru.yandex.clickhouse.ClickHouseDriver")
.option("url", "jdbc:clickhouse://****:8123/ads_zz")
.option("dbtable", "(select id, name, brand_id from *.* ) as tt")
.option("user", "*")
.option("password", "*")
.load();
house.createOrReplaceTempView("product");
house.show(10, false);
return house.count();
}

速度很快,性能还行!

举报

相关推荐

0 条评论