执行Hive的查询语句报错:java.lang.IllegalArgumentException: Does not contain a valid host:port authority: loca
来源:互联网 发布:布哈里圣训软件 编辑:程序博客网 时间:2024/05/17 03:45
好不容易把Hive装完了,结果一执行Hive的查询语句运行MapReduce程序立马报错。。。
log详细信息如下:
Job running in-process (local Hadoop)Hadoop job information for null: number of mappers: 1; number of reducers: 02017-10-21 21:54:15,503 null map = 0%, reduce = 0%2017-10-21 21:54:44,930 null map = 100%, reduce = 0%Ended Job = job_1508590228879_0004 with errorsError during job, obtaining debugging information...Examining task ID: task_1508590228879_0004_m_000000 (and more) from job job_1508590228879_0004Exception in thread "Thread-19" java.lang.IllegalArgumentException: Does not contain a valid host:port authority: local at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:212) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153) at org.apache.hadoop.hive.ql.exec.JobTrackerURLResolver.getURL(JobTrackerURLResolver.java:42) at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:209) at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:92) at java.lang.Thread.run(Thread.java:744)Execution failed with exit status: 2Obtaining error informationFAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
看了网上的许多方法,有让在hive-site日志下加入这个属性:
<property> <name>hive.exec.show.job.failure.debug.info</name> <value>false</value></property>
然而并没有效果。刚好最近开十九大,整个VPN被封完了,也没法翻墙找答案,只能在内网大海捞针(答案千篇一律)。然而皇天不负有心人,最终总算在一个算是能访问的国外论坛中找到了答案,(同样的问题,十几个回答中找到了唯一正确的解决方法。。。)。至于原因,我还没搞懂(根据这个属性的设置,个人猜测应该通过添加这个设置的属性值,将程序源码执行中要抛出的异常给忽略了)。
废话少说直接上解决方案:
直接再hive-site下添加如下属性:
<property> <name>mapreduce.jobtracker.address</name> <value>ignorethis</value></property>
这样直接就OK了。
就因为一个这样的小问题就花了我快一天的学习时间,真TM要命。。。
希望后能为后来者提供下帮助。
阅读全文
0 0
- 执行Hive的查询语句报错:java.lang.IllegalArgumentException: Does not contain a valid host:port authority: loca
- Hadoop Exception: java.lang.IllegalArgumentException: Does not contain a valid host:port authority:
- java.lang.IllegalArgumentException: Does not contain a valid host :port authority
- java.lang.IllegalArgumentException: Does not contain a valid host:port authority: ignorethis
- Does not contain a valid host:port authority: file:///
- failed in state INITED; cause: java.lang.IllegalArgumentException: Does not contain a valid host:por
- failed in state INITED; cause: java.lang.IllegalArgumentException: Does not contain a valid host:por
- 终于有解了~~hadoop Does not contain a valid host:port authority: file:///
- Hive连接MYSQL数据OK,查询出现in thread "Thread-18" java.lang.IllegalArgumentException:Does not contain a vali
- Hbase:java.lang.IllegalArgumentException: Not a host:port pair: PBUF
- mybatis报错:java.lang.IllegalArgumentException: Mapped Statements collection does not contain
- spring mvc java.lang.IllegalArgumentException: "undefined" does not contain '/'
- Exception in thread "main" java.lang.IllegalArgumentException: Not a host:port pair: PBUF
- Exception in thread "main" java.lang.IllegalArgumentException: Not a host:port pair: PBUF
- 解决HBase IllegalArgumentException: Not a host:port
- tomcat的java.lang.IllegalArgumentException:Document base *** does not exist or is not a readable
- java. lang. IllegalArgumentException: Path does not start with a "/" character
- java.lang.IllegalArgumentException: Mapped Statements collection does not contain value for /package
- Docker's 学习资料
- 今天发现的一个有用的爬虫视频,对静态网页爬取整体关系有很好的讲解
- Kali Linux安装中文输入法全纪录
- c++DLL编程详解
- Spring3-依赖注入
- 执行Hive的查询语句报错:java.lang.IllegalArgumentException: Does not contain a valid host:port authority: loca
- 一个32岁入门的70后程序员给我的启示
- 浮点数在计算机中的储存原理
- 传智博客 扫地僧公开课 Linux 内核链表
- laravel artisan常用命令
- 扫雷
- LeetCode刷题(19)
- Java-数据类型
- Android HIDL 官方文档(二)—— 接口与包(Interfaces & Packages)