Nutch:skipped. Content of size 91280 was truncated to 59131
来源:互联网 发布:相册软件哪个好 编辑:程序博客网 时间:2024/06/05 22:50
Nutch在抓取数据时出现以下报错:
xxx skipped. Content of size 91280 was truncated to 59131错误原因:
配置文档中限制了文档的最大字节长度
解决方案:
打开nutch根目录下conf文件夹下的nutch-size.xml
找到
<name>file.content.limit</name>
<value>65536</value>
将value值改大一点,例如6553600
找到
<property>
<name>parser.skip.truncated</name>
<value>true</value>
将value值改成false,改完记得重新ant编译
0 0
- Nutch:skipped. Content of size 91280 was truncated to 59131
- 有关verilog truncated value with size 32 to match size of target警告的处理
- ways of getting size to machine size
- sql错误1301 Result of CONCAT() was larger than max_allowed_packet(1024)-truncated
- vc6.0中 identifier was truncated to '255' characters in the debug information警告的解决
- vc++编译程序时 identifier was truncated to '255' characters in the browser information告警的解决方法
- SWFLoader: the size of SWF document and content
- securecrt 上传文件出现 *** was skipped 问题
- Adjust structure size to power of two
- An Auction That Google Was Content to Lose
- Packet size limited during capture: RADIUS truncated
- vc6.0中warning C4786:identifier was truncated to '255' characters in the debug information的原因及解决办法
- How to determine the size of an object of class?
- relocation truncated to fit: R_X86_64_PC32
- relocation truncated to fit: R_X86_64_32
- No content to map due to end-of-input
- identifier of an instance of was altered from to null
- identifier of an instance of was altered from to null
- Android可以拖动位置的ListVeiw
- Java多线程中的生产者消费者模型
- Android学习笔记之ListView
- html5 制作
- [BZOJ3626] LCA - 离线 - 树链剖分/动态树/分块
- Nutch:skipped. Content of size 91280 was truncated to 59131
- Android 发布开源项目到jcenter
- iOS开发中sqlite数据库的基本使用
- ButterKnife--View注入框架
- c语言:递归求最大公约数
- 基于Redux架构的单页应用开发总结(二)
- solrj操纵CloudSolrServer的一般步骤
- ubuntu下crontab 定时执行php脚本
- css3选择器