mongodb 3.0.2与wiredTiger存储引擎安装测试
来源：互联网 发布：linux sort 小数 编辑：程序博客网 时间：2024/05/20 09:21
mongodb3.0版本，除了之前默认的MMAP存储引擎，还新推出了wiredTiger存储引擎。
据官网测试报告称，mongodb 3.0版本使用wiredTiger存储引擎后，写性能能够提高7-10倍，数据压缩30%-80%，运维降低95%，这三个方面都还是很有吸引力的。
为了进行mongodb 2.6和mongodb 3.0的性能，先搭建一个mongodb 3.0环境，然后用YCSB工具进行测试。
mongodb 3.0.2 与wiredTiger的安装步骤如下：
1. 下载和安装mongodb 3.0软件
从mongodb官网下载mongodb 3.0的安装介质 mongodb-linux-x86_64-rhel62-3.0.2.tgz ，然后登陆的服务器上执行下面的命令安装：
cd /usr/local/
rz mongodb-linux-x86_64-rhel62-3.0.2.tgz
tar -zxvf mongodb-linux-x86_64-rhel62-3.0.2.tgz
ln -s mongodb-linux-x86_64-rhel62-3.0.2 mongodb30
chown -R mongodb:mongodb mongodb-linux-x86_64-rhel62-3.0.2 mongodb30
2. 准备mongodb实例目录和配置文件
创建mongodb实例所需目录：
rm -fR /data/mongodb30/
mkdir -p /data/mongodb30/{db,logs}
touch /data/mongodb30/logs/mongodb.log
chown -R mongodb:mongodb /data/mongodb30/
创建配置文件，配置启动参数，尤其注意添加wriedTiger存储引擎相关参数：
vim /data/mongodb30/mongodb30.conf
storageEngine = wiredTiger
wiredTigerCacheSizeGB = 2
syncdelay = 30
wiredTigerCollectionBlockCompressor = snappy
port=38019
dbpath=/data/mongodb30/db
oplogSize=2048
logpath=/data/mongodb30/logs/mongodb.log
logappend=true
fork=true
rest=true
journal = true
上面的参数中，标红的参数是wriedTiger相关参数，storageEngine 是设置存储引擎；wiredTigerCacheSizeGB 是设置mongodb存储引擎所用的内容，默认为系统内存的50%；syncdelay 是设置从内存同步到硬盘的时间间隔，默认为60秒，可以设置的少一些，在mongodb故障时，丢失的日志会少一些；wiredTigerCollectionBlockCompressor 是设定压缩策略 snappy 是一种压缩速度非常快的压缩策略。
由此可见，在mongodb 3.0中想要启用wriedTiger存储引擎，只需要增加该引擎的几个参数即可。
注：mongodb实例的启动，可以用命令行启动，也可以用配置文件启动；为了方便操作，并且可以保存启动的的参数，建议使用配置文件的方式启动mongodb实例。
修改实例目录和文件的属主为mongodb：
chown -R mongodb:mongodb /data/mongodb30/
3. 启动mongodb实例，并登录测试
使用mongod命令，以配置文件的方式启动mongodb实例：
/usr/local/mongodb30/bin/mongod --config /data/mongodb30/mongodb30.conf
确认启动后的进程状态：
ps -ef | grep mongo
使用mongo命令登录到mongodb实例中：
/usr/local/mongodb30/bin/mongo --port=38019
实际操作过程记录如下：
[root@test07 local]# [root@test07 local]# rm -fR /data/mongodb30/[root@test07 local]# mkdir -p /data/mongodb30/{db,logs}[root@test07 local]# touch /data/mongodb30/logs/mongodb.log[root@test07 local]# chown -R mongodb:mongodb /data/mongodb30/[root@test07 local]# [root@test07 local]# vim /data/mongodb30/mongodb30.conf[root@test07 local]# [root@test07 local]# [root@test07 local]# cat /data/mongodb30/mongodb30.confstorageEngine = wiredTiger wiredTigerCacheSizeGB = 2syncdelay = 30wiredTigerCollectionBlockCompressor = Snappyport=38019dbpath=/data/mongodb30/dboplogSize=2048logpath=/data/mongodb30/logs/mongodb.loglogappend=truefork=truerest=truejournal = true[root@test07 local]# [root@test07 local]# chown -R mongodb:mongodb /data/mongodb30/[root@test07 local]# [root@test07 local]# su - mongodb[mongodb@test07 ~]$ [mongodb@test07 ~]$ /usr/local/mongodb30/bin/mongod --config /data/mongodb30/mongodb30.conf2015-10-27T11:06:12.889+0800 F CONTROL Failed global initialization: BadValue storage.wiredTiger.collectionConfig.blockCompressor must be a string of the format: (none/snappy/zlib)[mongodb@test07 ~]$ sed -i 's/Snappy/snappy/g' /data/mongodb30/mongodb30.conf [mongodb@test07 ~]$ [mongodb@test07 ~]$ /usr/local/mongodb30/bin/mongod --config /data/mongodb30/mongodb30.conf2015-10-27T11:07:04.640+0800 I CONTROL ** WARNING: --rest is specified without --httpinterface,2015-10-27T11:07:04.640+0800 I CONTROL ** enabling http interfaceabout to fork child process, waiting until server is ready for connections.forked process: 3098child process started successfully, parent exiting[mongodb@test07 ~]$ [mongodb@test07 ~]$ ps -ef | grep mysqlmongodb 3344 3063 0 11:42 pts/0 00:00:00 grep mysql[mongodb@test07 ~]$ [mongodb@test07 ~]$ [mongodb@test07 ~]$ ps -ef|grep mongodbmongodb 2953 1 0 11:00 ? 00:00:16 /usr/local/mongodb26/bin/mongod --config /data/mongodb26/mongodb26.confroot 3062 2802 0 11:05 pts/0 00:00:00 su - mongodbmongodb 3063 3062 0 11:05 pts/0 00:00:00 -bashmongodb 3098 1 0 11:07 ? 00:00:13 /usr/local/mongodb30/bin/mongod --config /data/mongodb30/mongodb30.confmongodb 3346 3063 0 11:42 pts/0 00:00:00 ps -efmongodb 3347 3063 0 11:42 pts/0 00:00:00 grep mongodb[mongodb@test07 ~]$ [mongodb@test07 ~]$ [mongodb@test07 ~]$ /usr/local/mongodb30/bin/mongo --port=38019MongoDB shell version: 3.0.2connecting to: 127.0.0.1:38019/testServer has startup warnings: 2015-10-27T11:07:04.640+0800 I CONTROL ** WARNING: --rest is specified without --httpinterface,2015-10-27T11:07:04.640+0800 I CONTROL ** enabling http interface> > show dbs;local 0.000GB> use admin;switched to db admin> show collections;> > > db.serverStatus(){ "host" : "test07:38019", "version" : "3.0.2", "process" : "mongod", "pid" : NumberLong(3098), "uptime" : 2697, "uptimeMillis" : NumberLong(2697265), "uptimeEstimate" : 2457, "localTime" : ISODate("2015-10-27T03:52:01.900Z"), "asserts" : { "regular" : 0, "warning" : 0, "msg" : 0, "user" : 0, "rollovers" : 0 }, "connections" : { "current" : 1, "available" : 818, "totalCreated" : NumberLong(2) }, "cursors" : { "note" : "deprecated, use server status metrics", "clientCursors_size" : 0, "totalOpen" : 0, "pinned" : 0, "totalNoTimeout" : 0, "timedOut" : 0 }, "extra_info" : { "note" : "fields vary by platform", "heap_usage_bytes" : 31212656, "page_faults" : 0 }, "globalLock" : { "totalTime" : NumberLong("2697266000"), "currentQueue" : { "total" : 0, "readers" : 0, "writers" : 0 }, "activeClients" : { "total" : 8, "readers" : 0, "writers" : 0 } }, "locks" : { "Global" : { "acquireCount" : { "r" : NumberLong(724), "w" : NumberLong(2), "W" : NumberLong(4) } }, "Database" : { "acquireCount" : { "r" : NumberLong(723), "R" : NumberLong(1), "W" : NumberLong(2) } }, "Collection" : { "acquireCount" : { "r" : NumberLong(722) } } }, "network" : { "bytesIn" : 1371, "bytesOut" : 3116, "numRequests" : 18 }, "opcounters" : { "insert" : 0, "query" : 1, "update" : 0, "delete" : 0, "getmore" : 0, "command" : 19 }, "opcountersRepl" : { "insert" : 0, "query" : 0, "update" : 0, "delete" : 0, "getmore" : 0, "command" : 0 }, "storageEngine" : { "name" : "wiredTiger" }, "wiredTiger" : { "uri" : "statistics:", "LSM" : { "sleep for LSM checkpoint throttle" : 0, "sleep for LSM merge throttle" : 0, "rows merged in an LSM tree" : 0, "application work units currently queued" : 0, "merge work units currently queued" : 0, "tree queue hit maximum" : 0, "switch work units currently queued" : 0, "tree maintenance operations scheduled" : 0, "tree maintenance operations discarded" : 0, "tree maintenance operations executed" : 0 }, "async" : { "number of allocation state races" : 0, "number of operation slots viewed for allocation" : 0, "current work queue length" : 0, "number of flush calls" : 0, "number of times operation allocation failed" : 0, "maximum work queue length" : 0, "number of times worker found no work" : 0, "total allocations" : 0, "total compact calls" : 0, "total insert calls" : 0, "total remove calls" : 0, "total search calls" : 0, "total update calls" : 0 }, "block-manager" : { "mapped bytes read" : 0, "bytes read" : 12288, "bytes written" : 126976, "mapped blocks read" : 0, "blocks pre-loaded" : 0, "blocks read" : 3, "blocks written" : 27 }, "cache" : { "tracked dirty bytes in the cache" : 0, "tracked bytes belonging to internal pages in the cache" : 1245, "bytes currently in the cache" : 14644, "tracked bytes belonging to leaf pages in the cache" : 2147482403, "maximum bytes configured" : 2147483648, "tracked bytes belonging to overflow pages in the cache" : 0, "bytes read into cache" : 0, "bytes written from cache" : 20178, "pages evicted by application threads" : 0, "checkpoint blocked page eviction" : 0, "unmodified pages evicted" : 0, "page split during eviction deepened the tree" : 0, "modified pages evicted" : 0, "pages selected for eviction unable to be evicted" : 0, "pages evicted because they exceeded the in-memory maximum" : 0, "pages evicted because they had chains of deleted items" : 0, "failed eviction of pages that exceeded the in-memory maximum" : 0, "hazard pointer blocked page eviction" : 0, "internal pages evicted" : 0, "maximum page size at eviction" : 0, "eviction server candidate queue empty when topping up" : 0, "eviction server candidate queue not empty when topping up" : 0, "eviction server evicting pages" : 0, "eviction server populating queue, but not evicting pages" : 0, "eviction server unable to reach eviction goal" : 0, "pages split during eviction" : 0, "pages walked for eviction" : 0, "eviction worker thread evicting pages" : 0, "in-memory page splits" : 0, "percentage overhead" : 8, "tracked dirty pages in the cache" : 0, "pages currently held in the cache" : 10, "pages read into cache" : 0, "pages written from cache" : 16 }, "connection" : { "pthread mutex condition wait calls" : 59275, "files currently open" : 7, "memory allocations" : 21765, "memory frees" : 19667, "memory re-allocations" : 64, "total read I/Os" : 8, "pthread mutex shared lock read-lock calls" : 1336, "pthread mutex shared lock write-lock calls" : 2958, "total write I/Os" : 141 }, "cursor" : { "cursor create calls" : 568, "cursor insert calls" : 24, "cursor next calls" : 12, "cursor prev calls" : 3, "cursor remove calls" : 0, "cursor reset calls" : 119, "cursor search calls" : 604, "cursor search near calls" : 3, "cursor update calls" : 0 }, "data-handle" : { "connection dhandles swept" : 0, "connection candidate referenced" : 0, "connection sweeps" : 269, "connection time-of-death sets" : 1, "session dhandles swept" : 0, "session sweep attempts" : 56 }, "log" : { "log buffer size increases" : 0, "total log buffer size" : 1048576, "log bytes of payload data" : 8051, "log bytes written" : 18560, "yields waiting for previous log file close" : 0, "total size of compressed records" : 5113, "total in-memory size of compressed records" : 9524, "log records too small to compress" : 91, "log records not compressed" : 5, "log records compressed" : 6, "maximum log file size" : 104857600, "pre-allocated log files prepared" : 1, "number of pre-allocated log files to create" : 1, "pre-allocated log files used" : 0, "log read operations" : 0, "log release advances write LSN" : 102, "records processed by log scan" : 0, "log scan records requiring two reads" : 0, "log scan operations" : 0, "consolidated slot closures" : 0, "logging bytes consolidated" : 0, "consolidated slot joins" : 0, "consolidated slot join races" : 0, "slots selected for switching that were unavailable" : 0, "record size exceeded maximum" : 0, "failed to find a slot large enough for record" : 0, "consolidated slot join transitions" : 0, "log sync operations" : 92, "log sync_dir operations" : 1, "log server thread advances write LSN" : 0, "log write operations" : 102 }, "reconciliation" : { "page reconciliation calls" : 16, "page reconciliation calls for eviction" : 0, "split bytes currently awaiting free" : 0, "split objects currently awaiting free" : 0 }, "session" : { "open cursor count" : 54, "open session count" : 59 }, "thread-yield" : { "page acquire busy blocked" : 0, "page acquire eviction blocked" : 0, "page acquire locked blocked" : 0, "page acquire read blocked" : 0, "page acquire time sleeping (usecs)" : 0 }, "transaction" : { "transaction begins" : 50, "transaction checkpoints" : 89, "transaction checkpoint generation" : 89, "transaction checkpoint currently running" : 0, "transaction checkpoint max time (msecs)" : 16, "transaction checkpoint min time (msecs)" : 0, "transaction checkpoint most recent time (msecs)" : 0, "transaction checkpoint total time (msecs)" : 52, "transactions committed" : 3, "transaction failures due to cache overflow" : 0, "transaction range of IDs currently pinned by a checkpoint" : 0, "transaction range of IDs currently pinned" : 1, "transactions rolled back" : 46 }, "concurrentTransactions" : { "write" : { "out" : 0, "available" : 128, "totalTickets" : 128 }, "read" : { "out" : 1, "available" : 127, "totalTickets" : 128 } } }, "writeBacksQueued" : false, "mem" : { "bits" : 64, "resident" : 37, "virtual" : 339, "supported" : true, "mapped" : 0, "mappedWithJournal" : 0 }, "metrics" : { "commands" : { "getLog" : { "failed" : NumberLong(0), "total" : NumberLong(2) }, "isMaster" : { "failed" : NumberLong(0), "total" : NumberLong(10) }, "listCollections" : { "failed" : NumberLong(0), "total" : NumberLong(1) }, "listDatabases" : { "failed" : NumberLong(0), "total" : NumberLong(1) }, "replSetGetStatus" : { "failed" : NumberLong(2), "total" : NumberLong(2) }, "serverStatus" : { "failed" : NumberLong(0), "total" : NumberLong(1) }, "whatsmyuri" : { "failed" : NumberLong(0), "total" : NumberLong(2) } }, "cursor" : { "timedOut" : NumberLong(0), "open" : { "noTimeout" : NumberLong(0), "pinned" : NumberLong(0), "total" : NumberLong(0) } }, "document" : { "deleted" : NumberLong(0), "inserted" : NumberLong(0), "returned" : NumberLong(0), "updated" : NumberLong(0) }, "getLastError" : { "wtime" : { "num" : 0, "totalMillis" : 0 }, "wtimeouts" : NumberLong(0) }, "operation" : { "fastmod" : NumberLong(0), "idhack" : NumberLong(0), "scanAndOrder" : NumberLong(0), "writeConflicts" : NumberLong(0) }, "queryExecutor" : { "scanned" : NumberLong(0), "scannedObjects" : NumberLong(0) }, "record" : { "moves" : NumberLong(0) }, "repl" : { "apply" : { "batches" : { "num" : 0, "totalMillis" : 0 }, "ops" : NumberLong(0) }, "buffer" : { "count" : NumberLong(0), "maxSizeBytes" : 268435456, "sizeBytes" : NumberLong(0) }, "network" : { "bytes" : NumberLong(0), "getmores" : { "num" : 0, "totalMillis" : 0 }, "ops" : NumberLong(0), "readersCreated" : NumberLong(0) }, "preload" : { "docs" : { "num" : 0, "totalMillis" : 0 }, "indexes" : { "num" : 0, "totalMillis" : 0 } } }, "storage" : { "freelist" : { "search" : { "bucketExhausted" : NumberLong(0), "requests" : NumberLong(0), "scanned" : NumberLong(0) } } }, "ttl" : { "deletedDocuments" : NumberLong(0), "passes" : NumberLong(44) } }, "ok" : 1}> 0 0
- mongodb 3.0.2与wiredTiger存储引擎安装测试
- MongoDB 3.2版WiredTiger存储引擎性能测试
- Mongodb Wiredtiger存储引擎实现原理
- Mongodb Wiredtiger存储引擎实现原理
- MongoDB Wiredtiger存储引擎实现原理
- MongoDB 存储引擎：WiredTiger和In-Memory
- MongoDB 存储引擎Wiredtiger原理剖析
- MongoDB WiredTiger 存储引擎(1) cache_pool设计
- MongoDB 存储引擎：WiredTiger和In-Memory
- MongoDB 存储引擎：WiredTiger和In-Memory
- 解析MongoDB存储引擎WiredTiger：事务实现
- MongoDB 存储引擎：WiredTiger和In-Memory
- WiredTiger存储引擎分析
- Mongodb（1）——存储引擎WiredTiger的使用
- MongoDB WiredTiger 存储引擎cache_pool设计 (下) -- 实践篇
- Mongo3.4 Storage Engines存储引擎（将MongoDB实例更改为WiredTiger存储引擎）
- mongo wiredTiger存储引擎相关
- 【Mongo】存储引擎-WiredTiger概览
- POJ3046 多重集组合数 dp+前缀和优化+滚动数组 （包含类似优化的小总结）
- 了解@命令语法及应用
- php 二分查找
- java applet数字签名以及取消浏览器警告提示
- 九度OJ 1202：排序 （排序）
- mongodb 3.0.2与wiredTiger存储引擎安装测试
- poj 2100
- IO的同步异步、阻塞非阻塞
- Excel绘制甘特图
- 九度OJ 1203：IP地址 （字符串处理）
- 韩顺平循序渐进学java从入门到精通视频教程在线观看（总汇），1-94集全，以及视频和ppt,课后笔记
- 二叉树的序列化和反序列化
- 九度OJ 1204：农夫、羊、菜和狼的故事 （遍历、BFS）
- Wince在进程控制程序里的解决办法 error LNK2019错误解决办法
