我收到以下錯誤
要求失敗:提供的 Maven 坐標必須采用“groupId:artifactId:version”的形式
當我運行下面的命令時
spark-submit --class StreamHandler\
--master local[*]\
--packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.4.5,\
net.snowflake.snowflake-ingest-sdk:0.10.3,\
net.snowflake.snowflake-jdbc.3.13.14\
target/scala-2.11/stream-handler_2.11-1.0.jar
我正在嘗試使用 scala 使用資料并將其推送到雪花接收器資料庫。我的 build.sbt 檔案看起來像這樣
name := "Stream Handler"
version := "1.0"
scalaVersion := "2.11.12"
libraryDependencies = Seq(
"org.apache.spark" %% "spark-core" % "2.4.5" % "provided",
"org.apache.spark" %% "spark-sql" % "2.4.5" % "provided",
"net.snowflake" % "snowflake-ingest-sdk" % "0.10.3",
"net.snowflake" % "snowflake-jdbc" % "3.13.14",
"org.apache.hadoop" % "hadoop-core" % "1.2.0"
//"net.snowflake" % "spark-snowflake" % "2.7.2"
)
這里有遇到過這種情況并可以提供幫助的人嗎?
uj5u.com熱心網友回復:
為 Snowflake 指定包的正確方法是:
不是:
net.snowflake.snowflake-ingest-sdk:0.10.3
但:
net.snowflake:snowflake-ingest-sdk:0.10.3
在哪里:
<groupId>net.snowflake</groupId>
<artifactId>snowflake-ingest-sdk</artifactId>
<version>0.10.3</version>
同樣適用于 JDBC:
net.snowflake:snowflake-jdbc:3.13.14
轉載請註明出處,本文鏈接:https://www.uj5u.com/ruanti/474429.html
上一篇:Json4s不序列化Java類