Java序列化框架性能比较
来源:互联网 发布:免费手机安装窃听软件 编辑:程序博客网 时间:2024/06/07 09:24
jvm-serializers提供了一个很好的比较各种Java序列化的的测试套件。 它罗列了各种序列化框架, 可以自动生成测试报告。
我在AWS c3.xlarge机器上进行了测试,一下是测试报告与解析。
关键的测试数据的统计代码如下:
123456789101112131415161718192021222324252627
public double runWithTimeMeasurement(int timeMillis, TestCase tc, int iterations) throws Exception{long start = System.currentTimeMillis();double sumTime = 0;int count = 0;System.err.println("test-time "+timeMillis+" iteration "+iterations);while ( System.currentTimeMillis()-start < timeMillis ){double time = tc.run(transformer, serializer, value, iterations);sumTime += time;measurementVals[count] = time;count++;}double avg = sumTime / count;Arrays.sort(measurementVals,0,count);System.err.println("-----------------------------------------------------------------------------");System.err.println(serializer.getName());System.err.println("min:" + measurementVals[0]);System.err.println("1/4:"+measurementVals[count/4]);System.err.println("1/2:"+measurementVals[count/2]);System.err.println("3/4:"+measurementVals[count/4*3]);System.err.println("max:"+measurementVals[count-1]);System.err.println("average:"+ avg +" deviation:"+(avg-measurementVals[count/2]));System.err.println("-----------------------------------------------------------------------------");return avg;}
测试时序列化和反序列化会迭代多次,默认2000次。 测试会有一个限定时间,一轮测试完成后时间还有的话还会继续新的一轮的测试。 因此, 由于不同的框架花费的时间不同, 测试的轮数也不一样。
测试平台
OS:Linux (CentOS 6.4)
JVM:JDK 1.7.0_17
CPU: c3.xlarge
Cores (incl HT):4
免责声明
本测试主要关注无循环引用的数据结构, 但是如此众多的序列化框架还是各有不同:
- 有些支持循环引用检测
- 有些会输出全部的元数据,有些不会
- 有些支持跨平台,有些只支持特定的编程语言
- 有些是基于文本的,有些却基于二进制
- 有些支持向前向后兼容, 有些只支持向前或者向后,有些全部不支持
(查看ToolBehavior页面以了解一些框架的特性)
尽管别的测试数据可能会生成不同的测试结果(例如在每个字符串中增加非ascii字符), 此测试还是会提供一个各个序列化框架的性能的原始估计。
序列化框架Serializers(无共享引用)
- 无循环引用。 一个对象如果被引用两次则会序列化两次
- 没有手工优化
- schema预先已知
Ser Time+Deser Time (ns)
Size, Compressed in bytes
123456789101112131415161718192021222324252627
pre. create ser deser total size +dflprotostuff 112 663 917 1580 239 150fst-flat-pre 81 908 984 1893 251 165kryo-flat-pre 81 831 1083 1914 212 132protobuf 149 1625 942 2567 239 149msgpack-databind 81 1123 1821 2944 233 146thrift-compact 139 1844 1101 2945 240 148json/fastjson/databind 82 1710 1633 3343 486 262thrift 139 2216 1253 3469 349 197scala/sbinary 166 2122 1451 3573 255 147smile/jackson+afterburner/databind 81 1757 1868 3625 352 252smile/jackson/databind 81 2095 2250 4346 338 241json/jackson+afterburner/databind 81 2006 2548 4554 485 261json/protostuff-runtime 80 2008 2741 4748 469 243json/jackson/databind 80 2173 2972 5145 485 261json/jackson-jr/databind 81 2282 3435 5716 468 255cbor/jackson/databind 81 4112 2659 6771 397 246xml/jackson/databind 81 3558 7028 10585 683 286json/gson/databind 81 7322 7063 14386 486 259bson/jackson/databind 80 6974 8318 15291 506 286xml/xstream+c 81 9050 28265 37315 487 244xml/exi-manual 83 19634 18063 37697 337 327json/javax-tree/glassfish 1558 16804 23814 40618 485 263java-built-in 82 7154 37804 44958 889 514scala/java-built-in 164 11195 62423 73617 1312 700json/protobuf 142 11815 73133 84949 488 253json/json-lib/databind 81 45857 165134 210991 485 263
全对象图序列化框架Full Object Graph Serializers
- 支持全部的object graph读写. Object graph可能包含循环引用.
- 无预先处理, 没有预先的类生成,注册. 所有都运行时产生, 比如使用反射.
- 注意通常不会跨编程语言。 然而JSON/XML格式由于其特殊性可以跨语言.
Ser Time+Deser Time (ns)
Size, Compressed [light] in bytes
1234567891011121314
pre. create ser deser total size +dflprotostuff-graph 112 946 963 1909 239 150protostuff-graph-runtime 82 1187 1208 2395 241 151kryo-serializer 81 2091 1858 3949 286 188fst 81 2075 2041 4116 316 203jboss-marshalling-river-ct 81 4057 2810 6867 298 199hessian 80 6683 7234 13917 501 313jboss-serialization 83 9529 8508 18036 932 582jboss-marshalling-river 81 5915 28347 34261 694 400java-built-in-serializer 81 7273 36274 43547 889 514stephenerialization 59 8396 37359 45756 1093 517jboss-marshalling-serial 80 15148 39180 54328 856 498yaml/jackson/databind 82 25969 41084 67053 505 260json/flexjson/databind 81 25717 61700 87417 503 273
跨语言二进制序列化框架cross Lang Binary Serializers
- 无循环引用
- schema预先已知
Ser Time+Deser Time (ns)
Size, Compressed in bytes
12345678910
pre. create ser deser total size +dflprotobuf/protostuff 113 695 927 1622 239 149protobuf/protostuff-runtime 81 971 1105 2075 241 150protobuf 149 1625 942 2567 239 149msgpack-databind 81 1123 1821 2944 233 146thrift-compact 139 1844 1101 2945 240 148thrift 139 2216 1253 3469 349 197cbor/jackson/databind 81 4112 2659 6771 397 246hessian 80 6683 7234 13917 501 313bson/jackson/databind 80 6974 8318 15291 506 286
XML/JSon序列化框架
- 基于文本
- Mixed regarding required preparation, object graph awareness (references).
Ser Time+Deser Time (ns)
Size, Compressed in bytes
123456789101112131415
pre. create ser deser total size +dfljson/fastjson/databind 82 1710 1633 3343 486 262json/jackson+afterburner/databind 81 2006 2548 4554 485 261json/protostuff-runtime 80 2008 2741 4748 469 243json/jackson/databind 80 2173 2972 5145 485 261json/jackson-jr/databind 81 2282 3435 5716 468 255xml/jackson/databind 81 3558 7028 10585 683 286json/gson/databind 81 7322 7063 14386 486 259xml/xstream+c 81 9050 28265 37315 487 244xml/exi-manual 83 19634 18063 37697 337 327json/javax-tree/glassfish 1558 16804 23814 40618 485 263yaml/jackson/databind 82 25969 41084 67053 505 260json/protobuf 142 11815 73133 84949 488 253json/flexjson/databind 81 25717 61700 87417 503 273json/json-lib/databind 81 45857 165134 210991 485 263
手工优化的序列化框架Manually optimized Serializers
Ser Time+Deser Time (ns)
Size, Compressed in bytes
123456789101112131415161718192021222324252627282930313233
pre. create ser deser total size +dflkryo-manual 81 670 792 1462 211 131protostuff-manual 81 608 915 1523 239 150wobly 48 1147 701 1848 251 151kryo-opt 81 837 1059 1896 209 129wobly-compact 48 1175 748 1923 225 139java-manual 80 1341 848 2190 255 147smile/jackson/manual 82 1270 1476 2746 341 244msgpack-manual 80 1141 1668 2809 233 146json/jackson/manual 83 1467 1949 3416 468 253jboss-marshalling-river-ct-manual 82 2314 1586 3900 289 167avro-generic 488 2485 1527 4012 221 133avro-specific 118 2191 1916 4108 221 133json/protostuff-manual 81 1757 2472 4229 449 233cbor/jackson/manual 80 3659 1667 5326 386 238xml/aalto-manual 82 2724 3902 6626 653 304jboss-marshalling-river-manual 81 2967 5620 8587 483 240json/gson/manual 81 4798 5826 10624 468 253xml/woodstox-manual 81 4801 6355 11156 653 304json/json-smart/manual-tree 82 7623 5110 12733 495 269json/gson/manual-tree 82 7234 8202 15437 485 259xml/fastinfo-manual 81 8406 7207 15613 377 284xml/javolution/manual 80 6781 10766 17547 504 263json/json.simple/manual 81 7394 10923 18317 495 269json/org.json/manual-tree 81 8368 10959 19327 485 259json/svenson/databind 81 5956 14026 19981 495 269xml/xstream+c-aalto 81 5641 14743 20384 525 273xml/xstream+c-fastinfo 81 10471 11640 22111 345 264bson/mongodb/manual 81 4283 19559 23842 495 278xml/xstream+c-woodstox 80 7326 18877 26203 525 273json/javax-stream/glassfish 81 12791 21756 34547 468 253json/jsonij/manual-jpath 83 38635 15094 53729 478 257json/argo/manual-tree 81 85473 19416 104889 485 263
特性对性能的影响Cost of features
shows performance vs convenience of manually-selected libs.
- 循环引用, schema预知,手工优化cycle free, schema known at compile time, manual optimization: kryo-manual, msgpack-manual
- 循环引用, schema预知cycle free, schema known at compile time: protostuff, fst-flat-pre, kryo-flat-pre. (note: protostuff uses class generation while the other two just require a list of classes to be written)
- 循环引用, schema编译时未知 cycle free, schema UNKNOWN at compile time: fst-flat, kryo-flat, protostuff-runtime, msgpack-databind
- 全图读写,schema编译时未知 full object graph awareness, schema UNKNOWN at compile time: fst, kryo.
Ser Time+Deser Time (ns)
Size, Compressed in bytes
123456789101112
pre. create ser deser total size +dflkryo-manual 81 670 792 1462 211 131protostuff 112 663 917 1580 239 150fst-flat-pre 81 908 984 1893 251 165kryo-flat-pre 81 831 1083 1914 212 132protostuff-runtime 82 839 1104 1943 241 151kryo-flat 81 1037 1468 2505 268 177fst-flat 81 1230 1469 2700 314 204msgpack-manual 80 1141 1668 2809 233 146msgpack-databind 81 1123 1821 2944 233 146kryo-serializer 81 2091 1858 3949 286 188fst 81 2075 2041 4116 316 203
全部的测试结果
1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677
pre. create ser deser total size +dflkryo-manual 81 670 792 1462 211 131protostuff-manual 81 608 915 1523 239 150protostuff 112 663 917 1580 239 150protobuf/protostuff 113 695 927 1622 239 149wobly 48 1147 701 1848 251 151fst-flat-pre 81 908 984 1893 251 165kryo-opt 81 837 1059 1896 209 129protostuff-graph 112 946 963 1909 239 150kryo-flat-pre 81 831 1083 1914 212 132wobly-compact 48 1175 748 1923 225 139protostuff-runtime 82 839 1104 1943 241 151protobuf/protostuff-runtime 81 971 1105 2075 241 150java-manual 80 1341 848 2190 255 147protostuff-graph-runtime 82 1187 1208 2395 241 151kryo-flat 81 1037 1468 2505 268 177protobuf 149 1625 942 2567 239 149fst-flat 81 1230 1469 2700 314 204smile/jackson/manual 82 1270 1476 2746 341 244msgpack-manual 80 1141 1668 2809 233 146msgpack-databind 81 1123 1821 2944 233 146thrift-compact 139 1844 1101 2945 240 148json/fastjson/databind 82 1710 1633 3343 486 262json/jackson/manual 83 1467 1949 3416 468 253thrift 139 2216 1253 3469 349 197scala/sbinary 166 2122 1451 3573 255 147smile/jackson+afterburner/databind 81 1757 1868 3625 352 252jboss-marshalling-river-ct-manual 82 2314 1586 3900 289 167kryo-serializer 81 2091 1858 3949 286 188avro-generic 488 2485 1527 4012 221 133avro-specific 118 2191 1916 4108 221 133fst 81 2075 2041 4116 316 203json/protostuff-manual 81 1757 2472 4229 449 233smile/jackson/databind 81 2095 2250 4346 338 241json/jackson+afterburner/databind 81 2006 2548 4554 485 261json/protostuff-runtime 80 2008 2741 4748 469 243json/jackson/databind 80 2173 2972 5145 485 261cbor/jackson/manual 80 3659 1667 5326 386 238json/jackson-jr/databind 81 2282 3435 5716 468 255xml/aalto-manual 82 2724 3902 6626 653 304cbor/jackson/databind 81 4112 2659 6771 397 246jboss-marshalling-river-ct 81 4057 2810 6867 298 199jboss-marshalling-river-manual 81 2967 5620 8587 483 240xml/jackson/databind 81 3558 7028 10585 683 286json/gson/manual 81 4798 5826 10624 468 253xml/woodstox-manual 81 4801 6355 11156 653 304json/json-smart/manual-tree 82 7623 5110 12733 495 269hessian 80 6683 7234 13917 501 313json/gson/databind 81 7322 7063 14386 486 259bson/jackson/databind 80 6974 8318 15291 506 286json/gson/manual-tree 82 7234 8202 15437 485 259xml/fastinfo-manual 81 8406 7207 15613 377 284xml/javolution/manual 80 6781 10766 17547 504 263jboss-serialization 83 9529 8508 18036 932 582json/json.simple/manual 81 7394 10923 18317 495 269json/org.json/manual-tree 81 8368 10959 19327 485 259json/svenson/databind 81 5956 14026 19981 495 269xml/xstream+c-aalto 81 5641 14743 20384 525 273xml/xstream+c-fastinfo 81 10471 11640 22111 345 264bson/mongodb/manual 81 4283 19559 23842 495 278xml/xstream+c-woodstox 80 7326 18877 26203 525 273jboss-marshalling-river 81 5915 28347 34261 694 400json/javax-stream/glassfish 81 12791 21756 34547 468 253xml/xstream+c 81 9050 28265 37315 487 244xml/exi-manual 83 19634 18063 37697 337 327json/javax-tree/glassfish 1558 16804 23814 40618 485 263java-built-in-serializer 81 7273 36274 43547 889 514java-built-in 82 7154 37804 44958 889 514stephenerialization 59 8396 37359 45756 1093 517json/jsonij/manual-jpath 83 38635 15094 53729 478 257jboss-marshalling-serial 80 15148 39180 54328 856 498yaml/jackson/databind 82 25969 41084 67053 505 260scala/java-built-in 164 11195 62423 73617 1312 700json/protobuf 142 11815 73133 84949 488 253json/flexjson/databind 81 25717 61700 87417 503 273json/argo/manual-tree 81 85473 19416 104889 485 263json/json-lib/databind 81 45857 165134 210991 485 263
1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677
pre. Effort Format Structure Misckryo-manual MANUAL_OPT BINARY FLAT_TREE [] manually optimizedprotostuff-manual MANUAL_OPT BINARY FLAT_TREE [] manualprotostuff CLASSES_KNOWN BINARY FLAT_TREE [] generated codeprotobuf/protostuff CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] protobuf + generated codewobly MANUAL_OPT BINARY FLAT_TREE []fst-flat-pre CLASSES_KNOWN BINARY FLAT_TREE [] fst in unshared mode with preregistered classeskryo-opt MANUAL_OPT BINARY FLAT_TREE [] manually optimizedprotostuff-graph CLASSES_KNOWN BINARY FULL_GRAPH [] graph + generated codekryo-flat-pre CLASSES_KNOWN BINARY FLAT_TREE [] no shared refs, preregistered classeswobly-compact MANUAL_OPT BINARY FLAT_TREE []protostuff-runtime ZERO_KNOWLEDGE BINARY FLAT_TREE [] reflectionprotobuf/protostuff-runtime ZERO_KNOWLEDGE BIN_CROSSLANG FLAT_TREE [] protobuf + reflectionjava-manual MANUAL_OPT BINARY FLAT_TREE []protostuff-graph-runtime ZERO_KNOWLEDGE BINARY FULL_GRAPH [] graph + reflectionkryo-flat ZERO_KNOWLEDGE BINARY FLAT_TREE [] default, no shared refsprotobuf CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []fst-flat ZERO_KNOWLEDGE BINARY FLAT_TREE [] fst default, but unshared modesmile/jackson/manual MANUAL_OPT BINARY FLAT_TREE []msgpack-manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE []msgpack-databind CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []thrift-compact CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []json/fastjson/databind ZERO_KNOWLEDGE JSON FLAT_TREE []json/jackson/manual MANUAL_OPT JSON FLAT_TREE []thrift CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []scala/sbinary MISC MISC UNKNOWN [] nullsmile/jackson+afterburner/databind ZERO_KNOWLEDGE BINARY FLAT_TREE []jboss-marshalling-river-ct-manual MANUAL_OPT BINARY FULL_GRAPH [] full graph preregistered classes, manual optimizationkryo-serializer ZERO_KNOWLEDGE BINARY FULL_GRAPH [] defaultavro-generic MANUAL_OPT BIN_CROSSLANG FLAT_TREE []avro-specific MANUAL_OPT BIN_CROSSLANG UNKNOWN []fst ZERO_KNOWLEDGE BINARY FULL_GRAPH [] default: JDK serialization drop-in-replacement modejson/protostuff-manual MANUAL_OPT JSON FLAT_TREE [] json + manualsmile/jackson/databind ZERO_KNOWLEDGE BINARY FLAT_TREE []json/jackson+afterburner/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] uses bytecode generation to reduce overheadjson/protostuff-runtime ZERO_KNOWLEDGE JSON FLAT_TREE [] json + reflectionjson/jackson/databind ZERO_KNOWLEDGE JSON FLAT_TREE []cbor/jackson/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE []json/jackson-jr/databind ZERO_KNOWLEDGE JSON FLAT_TREE []xml/aalto-manual MANUAL_OPT XML UNKNOWN []cbor/jackson/databind ZERO_KNOWLEDGE BIN_CROSSLANG FLAT_TREE []jboss-marshalling-river-ct CLASSES_KNOWN BINARY FULL_GRAPH [] full graph with preregistered classesjboss-marshalling-river-manual MANUAL_OPT BINARY FULL_GRAPH [] full graph with manual optimizationsxml/jackson/databind ZERO_KNOWLEDGE XML FLAT_TREE []json/gson/manual MANUAL_OPT JSON FLAT_TREE []xml/woodstox-manual MANUAL_OPT XML UNKNOWN []json/json-smart/manual-tree MANUAL_OPT JSON FLAT_TREE []hessian ZERO_KNOWLEDGE BIN_CROSSLANG FULL_GRAPH []json/gson/databind ZERO_KNOWLEDGE JSON FLAT_TREE []bson/jackson/databind CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []json/gson/manual-tree MANUAL_OPT JSON FLAT_TREE []xml/fastinfo-manual MANUAL_OPT XML UNKNOWN []xml/javolution/manual MANUAL_OPT XML FLAT_TREE []jboss-serialization ZERO_KNOWLEDGE BINARY FULL_GRAPH []json/json.simple/manual MANUAL_OPT JSON FLAT_TREE []json/org.json/manual-tree MANUAL_OPT JSON FLAT_TREE []json/svenson/databind MANUAL_OPT JSON FLAT_TREE []xml/xstream+c-aalto MANUAL_OPT XML FLAT_TREE []xml/xstream+c-fastinfo MANUAL_OPT XML FLAT_TREE []bson/mongodb/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE []xml/xstream+c-woodstox MANUAL_OPT XML FLAT_TREE []jboss-marshalling-river ZERO_KNOWLEDGE BINARY FULL_GRAPH [] full graph zero knowledgejson/javax-stream/glassfish MANUAL_OPT JSON FLAT_TREE []xml/xstream+c ZERO_KNOWLEDGE XML FLAT_TREE []xml/exi-manual ZERO_KNOWLEDGE XML UNKNOWN []json/javax-tree/glassfish ZERO_KNOWLEDGE JSON FLAT_TREE []java-built-in-serializer ZERO_KNOWLEDGE BINARY FULL_GRAPH []java-built-in ZERO_KNOWLEDGE BINARY FLAT_TREE []stephenerialization ZERO_KNOWLEDGE BINARY FULL_GRAPH [] nulljson/jsonij/manual-jpath MANUAL_OPT JSON FLAT_TREE []jboss-marshalling-serial ZERO_KNOWLEDGE BINARY FULL_GRAPH []yaml/jackson/databind ZERO_KNOWLEDGE JSON FULL_GRAPH []scala/java-built-in MISC MISC UNKNOWN [] nulljson/protobuf CLASSES_KNOWN JSON FLAT_TREE []json/flexjson/databind ZERO_KNOWLEDGE JSON FULL_GRAPH []json/argo/manual-tree MANUAL_OPT JSON FLAT_TREE []json/json-lib/databind ZERO_KNOWLEDGE JSON FLAT_TREE []
- Java序列化框架性能比较
- Java序列化框架性能比较
- Java序列化框架性能比较
- Java序列化框架性能比较
- java序列化方式性能比较
- java序列化方式性能比较
- Java MVC框架性能比较
- Java MVC框架性能比较
- java集合框架性能比较
- Java MVC框架性能比较
- 几种 Java 序列化方案的性能比较
- java常用对象序列化对象性能简单比较
- java序列化、hessian和protostuff性能比较
- 序列化框架性能对比(kryo、hessian、java、protostuff)
- XSON,高性能的Java序列化框架
- java序列化框架性能对比(kryo,hessian,Protostuff)
- [原]Java MVC框架性能比较
- Java MVC框架性能比较(转)
- The Bonus Salary! (poj 3762 离散化+最小费用流)
- Android自定义ImageView,方角,圆角头像(可根据自己的需求来设定头像的圆角或者方角的大小)
- git fetch 同步太多不需要的
- Hibernate-简介
- (15/09/14)重新开始
- Java序列化框架性能比较
- c++primer plus 第九章-名称空间
- hdu1421经典dp
- 网络APP编写------云服务器用Bmob开发的
- //获取lable高度 并调整行间距等功能
- Unicode、UTF8、GB2312、ANSI关系
- caffe学习笔记(一):路线图
- 安装HP WebInspect时,SQLServer2008安装不上咋办
- Leetcode56: Invert Binary Tree