java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org
来源:互联网 发布:淘宝奥特曼星计划 编辑:程序博客网 时间:2024/05/22 16:00
问题
写某Hadoop程序,运行时,遇到以下错误
java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org.apache.hadoop.io.LongWritable
具体问题截图
解决
解决步骤
1、 检查配置job的class格式是否正确
job.setMapperClass(cls); job.setReducerClass(tagReducer.class); job.setMapOutputKeyClass(Text.class); job.setMapOutputValueClass(Text.class); job.setOutputKeyClass(Text.class); job.setOutputValueClass(Text.class); .......
2、 检查具体的map、reduce实现中的传入和传出的格式是否正确
3、 如果以上两步还不起作用的话,查看是否写代码时,不同版本的新老API混用。特别是具体map、reduce时的重写函数。
阅读全文
0 0
- java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org
- Type mismatch in key from map: expected org.apache.hadoop.io.Text, received org.apache.hadoop.io.Lon
- Type mismatch in key from map: expected org.apache.hadoop.io.LongWritable, received org.apache.hadoo
- java.io.IOException: Type mismatch in key from map: expected
- java.io.IOException: Type mismatch in key from map:解决方法
- expected org.apache.hadoop.io.IntWritable, recieved org.apache.hadoop.io.Text
- Hadoop笔记十二之 java.io.IOException: expected org.apache.hadoop.io.LongWr
- IOException: Type mismatch in key from map的处理
- org.apache.hadoop.ipc.RemoteException(java.io.IOException)
- hadoop MR 任务 报错 "Error: java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io"
- org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /
- 564 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: IOException in offerService java.io.IOExce
- org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in
- org.apache.hadoop.io
- hive执行query语句时提示错误:org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.io.IOException:
- hadoop错误java.io.IOException at org.apache.hadoop.mapred.pipes.OutputHandler。。。
- Hadoop Problem : org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible
- Hadoop Problem : java.io.IOException: Unknown protocol to DataNode: org.apache.hadoop.mapred.JobSubm
- Effective minidump
- Android JsBridge源码分析
- 【百度联盟峰会】李彦宏详解AI时代思维方式,算法驱动的降维攻击
- 解决fatal error: jni.h: No such file or directory.
- POJ 1356 Grandpa's Other Estate 笔记
- java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved org
- QQ顶部消息与电话切换栏实现(UI美化)
- 15天的性能优化工作,5方面的调优经验
- 由一个简单需求到Linux环境下的syslog、unix domain socket
- 关于C/S客户端异常“clr20r3”的处理
- java 消息推送的比较
- Android版本更新知识(检测、升级)总结
- Next Permutation
- 算法—猜拳游戏