☰

Installationsproblem von Zeppelin: Wie behebe ich die Abhängigkeiten ohne Internet?

tag-icon • tag-icon software-installation repository maven
Installationsproblem von Zeppelin: Wie behebe ich die Abhängigkeiten ohne Internet?

Ich installiere Zeppelin in einem privaten Netzwerk.

Bisher benötigen vier Module zum Erstellen eines lokalen Repository.

zeppelin-beam 
zeppelin-bigquery 
zeppelin-postgresql 
zeppelin-shell

Diese Informationen habe ich aus den folgenden Protokollen.

    Install beam(org.apache.zeppelin:zeppelin-beam:0.7.1) to /opt/zeppelin-0.7.1-bin-all/interpreter/beam ...
    org.sonatype.aether.RepositoryException: Cannot fetch dependencies for org.apache.zeppelin:zeppelin-beam:0.7.1
            at org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:181)
            at org.apache.zeppelin.dep.DependencyResolver.loadFromMvn(DependencyResolver.java:131)
            at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:79)
            at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:96)
            at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:88)
            at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:172)
            at org.apache.zeppelin.interpreter.install.InstallInterpreter.installAll(InstallInterpreter.java:122)
            at org.apache.zeppelin.interpreter.install.InstallInterpreter.main(InstallInterpreter.java:272)
    Install bigquery(org.apache.zeppelin:zeppelin-bigquery:0.7.1) to /opt/zeppelin-0.7.1-bin-all/interpreter/bigquery .        ..
    org.sonatype.aether.RepositoryException: Cannot fetch dependencies for org.apache.zeppelin:zeppelin-bigquery:0.7.1
            at org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:181)
            at org.apache.zeppelin.dep.DependencyResolver.loadFromMvn(DependencyResolver.java:131)
            at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:79)
            at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:96)
            at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:88)
            at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:172)
            at org.apache.zeppelin.interpreter.install.InstallInterpreter.installAll(InstallInterpreter.java:122)
            at org.apache.zeppelin.interpreter.install.InstallInterpreter.main(InstallInterpreter.java:272)
org.sonatype.aether.RepositoryException: Cannot fetch dependencies for org.apache.zeppelin:zeppelin-postgresql:0.7.        1
        at org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:181)
        at org.apache.zeppelin.dep.DependencyResolver.loadFromMvn(DependencyResolver.java:131)
        at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:79)
        at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:96)
        at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:88)
        at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:172)
        at org.apache.zeppelin.interpreter.install.InstallInterpreter.installAll(InstallInterpreter.java:122)
        at org.apache.zeppelin.interpreter.install.InstallInterpreter.main(InstallInterpreter.java:272)
org.sonatype.aether.RepositoryException: Cannot fetch dependencies for org.apache.zeppelin:zeppelin-shell:0.7.1
        at org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:181)
        at org.apache.zeppelin.dep.DependencyResolver.loadFromMvn(DependencyResolver.java:131)
        at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:79)
        at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:96)
        at org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:88)
        at org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:172)
        at org.apache.zeppelin.interpreter.install.InstallInterpreter.installAll(InstallInterpreter.java:122)
        at org.apache.zeppelin.interpreter.install.InstallInterpreter.main(InstallInterpreter.java:272)

Nehmen

Zeppelinstrahl

Um dieses Modul zu kompilieren, können die Abhängigkeitsinformationen beispielsweise von diesem Java abgerufen werdenpom.xml

https://github.com/apache/zeppelin/blob/61aeeaf10f340879337b6f19c5a9b3aaaa4eca9e/beam/pom.xml

    <dependency>
  <groupId>org.apache.spark</groupId>
  <artifactId>spark-core_2.10</artifactId>
  <version>${beam.spark.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>slf4j-log4j12</artifactId>
      <groupId>org.slf4j</groupId>
    </exclusion>
    <exclusion>
      <artifactId>netty-all</artifactId>
      <groupId>io.netty</groupId>
    </exclusion>
    <exclusion>
      <artifactId>akka-actor_2.10</artifactId>
      <groupId>org.spark-project.akka</groupId>
    </exclusion>
    <exclusion>
      <artifactId>akka-remote_2.10</artifactId>
      <groupId>org.spark-project.akka</groupId>
    </exclusion>
    <exclusion>
      <artifactId>akka-slf4j_2.10</artifactId>
      <groupId>org.spark-project.akka</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>org.apache.spark</groupId>
  <artifactId>spark-streaming_2.10</artifactId>
  <version>${beam.spark.version}</version>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-mapreduce-client-core</artifactId>
  <version>${beam.hadoop.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>slf4j-log4j12</artifactId>
      <groupId>org.slf4j</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-common</artifactId>
  <version>${beam.hadoop.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>slf4j-log4j12</artifactId>
      <groupId>org.slf4j</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>org.apache.zeppelin</groupId>
  <artifactId>zeppelin-scio_${scala.binary.version}</artifactId>
  <version>${project.version}</version>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-hdfs</artifactId>
  <version>${beam.hadoop.version}</version>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-client</artifactId>
  <version>${beam.hadoop.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>slf4j-log4j12</artifactId>
      <groupId>org.slf4j</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-annotations</artifactId>
  <version>${beam.hadoop.version}</version>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-yarn-common</artifactId>
  <version>${beam.hadoop.version}</version>
</dependency>

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-mapreduce-client-common</artifactId>
  <version>${beam.hadoop.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>slf4j-log4j12</artifactId>
      <groupId>org.slf4j</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>com.thoughtworks.qdox</groupId>
  <artifactId>qdox</artifactId>
  <version>2.0-M3</version>
</dependency>

<dependency>
  <groupId>org.apache.beam</groupId>
  <artifactId>beam-runners-parent</artifactId>
  <version>${beam.beam.version}</version>
  <type>pom</type>
</dependency>

<dependency>
  <groupId>org.apache.beam</groupId>
  <artifactId>beam-runners-core-java</artifactId>
  <version>${beam.beam.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>google-http-client-jackson2</artifactId>
      <groupId>com.google.http-client</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>org.apache.beam</groupId>
  <artifactId>beam-runners-direct-java</artifactId>
  <version>${beam.beam.version}</version>
</dependency>

<dependency>
  <groupId>javax.servlet</groupId>
  <artifactId>javax.servlet-api</artifactId>
  <version>${servlet.api.version}</version>
</dependency>

<dependency>
  <groupId>org.apache.beam</groupId>
  <artifactId>beam-runners-google-cloud-dataflow-java</artifactId>
  <version>${beam.beam.version}</version>
  <exclusions>
    <exclusion>
      <artifactId>google-http-client-jackson2</artifactId>
      <groupId>com.google.http-client</groupId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
  <groupId>org.apache.beam</groupId>
  <artifactId>beam-runners-spark</artifactId>
  <version>${beam.beam.version}</version>
  <type>jar</type>
</dependency>

<dependency>
  <groupId>${project.groupId}</groupId>
  <artifactId>zeppelin-interpreter</artifactId>
  <version>${project.version}</version>
  <scope>provided</scope>
</dependency>

<dependency>
  <groupId>org.apache.commons</groupId>
  <artifactId>commons-exec</artifactId>
  <version>${commons.exec.version}</version>
</dependency>

<dependency>
  <groupId>junit</groupId>
  <artifactId>junit</artifactId>
  <scope>test</scope>
</dependency>

Meine Fragen beziehen sich auf die Hintergrundinformationen: 1. Welche Maven-Repositorys enthalten diese Abhängigkeiten? 2. Wie viele Arten von Repositorys gibt es auf der Website? 3. Wie viele Arten bzw. welche Quelle verwaltet sie?

verwandte Informationen