ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

编译flink1.9.0 报flink-fs-hadoop-shaded找不到

2020-02-22 09:36:02  阅读:570  来源: 互联网

标签:INFO fs WARNING flink flink1.9 version apache org


编译flink1.9.0 报flink-fs-hadoop-shaded找不到

1.Flink 源码下载

git clone git@github.com:apache/flink.git

然后你可以切换到项目的不同分支,执行下面命令将代码切换到 release-1.9 分支:

git checkout release-1.9

2.Flink 源码编译

mvn clean install -Dmaven.test.skip=true -Dmaven.javadoc.skip=true -Dcheckstyle.skip=true
  • -Dmaven.test.skip:跳过测试代码
  • -Dmaven.javadoc.skip:跳过 javadoc 检查
  • -Dcheckstyle.skip:跳过代码风格检查

maven 编译的时候跳过这些检查,这样可以减少很多时间,还可能会减少错误的发生。

注意:你的 maven 的 settings.xml 文件的 mirror 添加下面这个(这样才能下载到某些下载不了的依赖)。

<mirror>
  <id>nexus-aliyun</id>
  <mirrorOf>*,!jeecg,!jeecg-snapshots,!mapr-releases</mirrorOf>
  <name>Nexus aliyun</name>
  <url>http://maven.aliyun.com/nexus/content/groups/public</url>
</mirror>

<mirror>
  <id>mapr-public</id>
  <mirrorOf>mapr-releases</mirrorOf>
  <name>mapr-releases</name>
  <url>https://maven.aliyun.com/repository/mapr-public</url>
</mirror>

编译报错

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:12 min
[INFO] Finished at: 2020-02-22T09:00:29+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flink-s3-fs-hadoop: Could not resolve dependencies for project org.apache.flink:flink-s3-fs-hadoop:jar:1.9-SNAPSHOT: Could not find artifact org.apache.flink:flink-fs-hadoop-shaded:jar:tests:1.9-SNAPSHOT in nexus-aliyun (http://maven.aliyun.com/nexus/content/groups/public) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :flink-s3-fs-hadoop

解决方法

在网站 https://www.mvnjar.com/
搜索对应的jar包
在这里插入图片描述
下载后添加到本地

192:flink lijun$ mvn install:install-file -DgroupId=org.apache.flink -DartifactId=flink-fs-hadoop-shaded -Dversion=1.9-SNAPSHOT -Dpackaging=jar  -Dfile=/Users/lijun/Downloads/flink-s3-fs-hadoop-1.9.0.jar
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.flink:flink-scala_2.11:jar:1.9-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.flink:flink-scala_${scala.binary.version}:[unknown-version], /Users/lijun/IT/workspace/workspace_idea/bigData/flink/flink-scala/pom.xml, line 31, column 14
[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:build-helper-maven-plugin is missing. @ org.apache.flink:flink-scala_${scala.binary.version}:[unknown-version], /Users/lijun/IT/workspace/workspace_idea/bigData/flink/flink-scala/pom.xml, line 215, column 12
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.flink:flink-runtime_2.11:jar:1.9-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.flink:flink-runtime_${scala.binary.version}:[unknown-version], /Users/lijun/IT/workspace/workspace_idea/bigData/flink/flink-runtime/pom.xml, line 32, column 14
[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:build-helper-maven-plugin is missing. @ org.apache.flink:flink-runtime_${scala.binary.version}:[unknown-version], /Users/lijun/IT/workspace/workspace_idea/bigData/flink/flink-runtime/pom.xml, line 424, column 12
[WARNING] Some problems were encountered while building the effective model for org.apache.flink:flink-table-planner_2.11:jar:1.9-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.flink:flink-table-planner_${scala.binary.version}:[unknown-version], /Users/lijun/IT/workspace/workspace_idea/bigData/flink/flink-table/flink-table-planner/pom.xml, line 30, column 14
[WARNING] 

[WARNING] Some problems were encountered while building the effective model for or
[INFO] flink-plugins-test ................................. SKIPPED
[INFO] dummy-fs ........................................... SKIPPED
[INFO] another-dummy-fs ................................... SKIPPED
[INFO] flink-tpch-test .................................... SKIPPED
[INFO] flink-contrib ...................................... SKIPPED
[INFO] flink-connector-wikiedits .......................... SKIPPED
[INFO] flink-yarn-tests ................................... SKIPPED
[INFO] flink-fs-tests ..................................... SKIPPED
[INFO] flink-docs ......................................... SKIPPED
[INFO] flink-ml-parent .................................... SKIPPED
[INFO] flink-ml-api ....................................... SKIPPED
[INFO] flink-ml-lib 1.9-SNAPSHOT .......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.672 s
[INFO] Finished at: 2020-02-22T09:11:41+08:00
[INFO] ------------------------------------------------------------------------
192:flink lijun$ 

问题解决

coderKeNan 发布了72 篇原创文章 · 获赞 8 · 访问量 31万+ 他的留言板 关注

标签:INFO,fs,WARNING,flink,flink1.9,version,apache,org
来源: https://blog.csdn.net/Leeyehong_self/article/details/104438978

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有