hadoop上优化速度可以采用改变outputDefinition为avro的方法

来源:互联网 发布:杨霞sunny扒皮知乎 编辑:程序博客网 时间:2024/05/20 22:27

To optimise the performenc , after result validation, it is better let the intermediate output format as avro, need to do the setting in myenv.yaml

outputDefinition:
type: "avro"
disableParallelism: false

0 0