在Hive中配置Tez低级错误


Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://hadoop104:9000/tmp/hive/root/_tez_session_dir/586a6561-7f3a-4ed9-a755-88725417f895/hadoop-lzo-0.4.20.jar. Failing because I am unlikely to write too.
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.io.IOException: Previous writer likely failed to write hdfs://hadoop104:9000/tmp/hive/root/_tez_session_dir/586a6561-7f3a-4ed9-a755-88725417f895/hadoop-lzo-0.4.20.jar. Failing because I am unlikely to write too.
    at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:980)
    at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:860)
    at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:803)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:219)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:147)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
    ... 8 more
hive-env.sh中路径不对我把 module 写成了 modules
export HIVE_AUX_JARS_PATH=/opt/module/hadoop-2.7.2/share/hadoop/common/hadoop-lzo-0.4.20.jar$TEZ_JARS
在Hive中配置Tez低级错误

发表评论

电子邮件地址不会被公开。 必填项已用*标注

滚动到顶部