0

我正在尝试构建 Qubole spark-lens项目。我遇到了未解决的依赖错误。在 git 版本中，火花解析器指向https://dl.bintray.com/spark-packages/maven，我更改了它（按照开放 PR spark-lens repo 中的建议），因为此 URL 现在已停用并提供403 响应。

[error] (*:update) sbt.ResolveException: unresolved dependency: com.eed3si9n#sbt-assembly;0.12.0: not found
[error] unresolved dependency: org.spark-packages#sbt-spark-package;0.2.4: not found

以下是 sbt 配置

构建.sbt

name := "sparklens"
organization := "com.qubole"

scalaVersion := "2.11.8"

crossScalaVersions := Seq("2.10.6", "2.11.8")

spName := "qubole/sparklens"

sparkVersion := "2.0.0"

spAppendScalaVersion := true


libraryDependencies += "org.apache.spark" %% "spark-core" % sparkVersion.value % "provided"

libraryDependencies +=  "org.apache.hadoop" % "hadoop-client" % "2.6.5" % "provided"

libraryDependencies += "org.apache.httpcomponents" % "httpclient" % "4.5.6" % "provided"

libraryDependencies += "org.apache.httpcomponents" % "httpmime" % "4.5.6" % "provided"

test in assembly := {}

testOptions in Test += Tests.Argument("-oF")

scalacOptions ++= Seq("-target:jvm-1.7")

javacOptions ++= Seq("-source", "1.7", "-target", "1.7")

publishMavenStyle := true


licenses += ("Apache-2.0", url("http://www.apache.org/licenses/LICENSE-2.0"))

credentials += Credentials(Path.userHome / ".ivy2" / ".sbtcredentials")


pomExtra :=
  <url>https://github.com/qubole/sparklens</url>
  <scm>
    <url>git@github.com:qubole/sparklens.git</url>
    <connection>scm:git:git@github.com:qubole/sparklens.git</connection>
  </scm>
  <developers>
    <developer>
      <id>iamrohit</id>
      <name>Rohit Karlupia</name>
      <url>https://github.com/iamrohit</url>
    </developer>
    <developer>
      <id>beriaanirudh</id>
      <name>Anirudh Beria</name>
      <url>https://github.com/beriaanirudh</url>
    </developer>
    <developer>
      <id>mayurdb</id>
      <name>Mayur Bhosale</name>
      <url>https://github.com/mayurdb</url>
    </developer>
  </developers>

项目/plugins.sbt

addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.12.0")

resolvers += "Spark Package Main Repo" at "https://repos.spark-packages.org"

addSbtPlugin("org.spark-packages" % "sbt-spark-package" % "0.2.4")

项目/build.properties

sbt.version=0.13.16

有人能指出我哪里出错了吗？

4

0 回答 0