MongoDB 索引之全文索引

来源:互联网 发布:js冒泡排序法 编辑:程序博客网 时间:2024/04/28 04:18
mongodb full text search(fts:全文搜素)是在版本2.4新加的特性。在以前的版本,是通过精确匹配和正则表达式来查询,这效率是很低的。全文索引,能够从大量的文本中搜索出所需的内容,内置多国语言和分词方法。不支持宇宙第一语言—中文。全文索引会导致mongodb写入性能下降,因为所有字符串都要拆分,存储到不同地方。 
全文索引是一种技术,并大量的使用。如搜索引擎,站内搜索等等。常使用到的全文搜索有: 
lucene 
sphinx 
redis-search 
riak search 
不过,对中文的搜索不尽如人意。 
mongodb用的是开源的snowball分词器。参见http://snowball.tartarus.org/texts/stemmersoverview.html
mongodb 全文索引支持的语言有: 
danish 
dutch 
english 
finnish 
french 
german 
hungarian 
italian 
norwegian 
portuguese 
romanian 
russian 
spanish 
swedish 
turkish 
如果希望使用其他语言,需要在创建索引时指定要使用的语言。默认是支持英文的。 
>db.collection.ensureIndex({content:"text"},{default_language:"spanish"}) 
一、开启全文索引 
默认是关闭的。否则会报错"err" : "text search not enabled" 
可以在脚本中声明启用: 
> db.adminCommand({setParameter:1,textSearchEnabled:true}) 
{ "was" : true, "ok" : 1 } 
也修改配置启用:mongod --setParameter textSearchEnabled=true 
二、插入测试数据 
下面是插入一些《加州旅馆》这首二十世纪非常著名的流行音乐。 
> db.ttlsa_com.insert({"song":"1. Hotel California", "lyrics": "On a dark desert highway, cool wind in my hair. Warm smell of colitas, rising up through the air."}) > db.ttlsa_com.insert({"song":"2. Hotel California", "lyrics": "Up ahead in the distance, I saw a shimmering light. My head grew heavy and my sight grew dim."}) > db.ttlsa_com.insert({"song":"3. Hotel California", "lyrics": "Such a lovely place, Such a lovely face."}) > db.ttlsa_com.insert({"song":"4. Hotel California", "lyrics": "Some dance to remember, some dance to forget."}) > db.ttlsa_com.insert({"song":"5. Hotel California", "lyrics": "Welcome to the Hotel California"}) > db.ttlsa_com.insert({"song":"hell world", "lyrics": "Welcome to beijing"}) 
> db.ttlsa_com.insert({"song":"加州旅馆", "lyrics": "Welcome to the Hotel California"}) 
三、创建全文索引 
> db.ttlsa_com.ensureIndex({"song":"text", "lyrics":"text"}) 
或者 
> db.ttlsa_com.ensureIndex({"$**": "text"}) 
$**表示在所有的字符串字段上创建一个全文索引。 
也可以指定权重 
> db.ttlsa_com.ensureIndex({"song":"text"},{"weights":{"song": 2, "$**": 3}}) 
四、查看索引信息 
>db.system.indexes.find().toArray() [{"v": 1,"key": {"_id": 1},"name": "_id_","ns": "test.ttlsa_com"},{"v": 1,"key": {"_fts": "text","_ftsx": 1},"name": "song__lyrics_","ns": "test.ttlsa_com","weights": {"lyrics": 1,"song": 1},"default_language": "english","language_override": "language","textIndexVersion": 2}] 
五、查询 
全文索引是通过 
db.collection.runCommand( "text", { search: <string>, 
filter: <document>, 
project: <document>, 
limit: <number>, 
language: <string> } ) 
来查询的,非通过find()命令来实现的。 也可以通过find查询,如:db.ttlsa_com.find({$text:{$search:"aa bb"}});
1.搜索一个词,文本命令是不区分大小写的 
> db.ttlsa_com.runCommand("text",{search:"Welcome"}) { "results" : [ { "score" : 0.6666666666666666, "obj" : { "_id" : ObjectId("550a615dd8511e4dbcb8c77a"), "song" : "5. Hotel California", "lyrics" : "Welcome to the Hotel California" } }, { "score" : 0.6666666666666666, "obj" : { "_id" : ObjectId("550a6163d8511e4dbcb8c77b"), "song" : "加州旅馆", "lyrics" : "Welcome to the Hotel California" } } ], "stats" : { "nscanned" : 2, "nscannedObjects" : 2, "n" : 2, "timeMicros" : 1486, "shards" : { "shard_a" : { "nscanned" : NumberLong(2), "nscannedObjects" : NumberLong(2), "n" : 2, "timeMicros" : 917 } } }, "ok" : 1 } 
2.模糊搜索 
> db.ttlsa_com.runCommand("text",{search:"Such lovely"}) { "results" : [ { "score" : 1.125, "obj" : { "_id" : ObjectId("550a6154d8511e4dbcb8c778"), "song" : "3. Hotel California", "lyrics" : "Such a lovely place, Such a lovely face." } } ], "stats" : { "nscanned" : 1, "nscannedObjects" : 1, "n" : 1, "timeMicros" : 618, "shards" : { "shard_a" : { "nscanned" : NumberLong(1), "nscannedObjects" : NumberLong(1), "n" : 1, "timeMicros" : 272 } } }, "ok" : 1 } 
3.匹配短语 
> db.ttlsa_com.runCommand("text",{search:"\"Some dance to remember\""}) { "results" : [ { "score" : 1.75, "obj" : { "_id" : ObjectId("550a6158d8511e4dbcb8c779"), "song" : "4. Hotel California", "lyrics" : "Some dance to remember, some dance to forget." } } ], "stats" : { "nscanned" : 2, "nscannedObjects" : 1, "n" : 1, "timeMicros" : 743, "shards" : { "shard_a" : { "nscanned" : NumberLong(2), "nscannedObjects" : NumberLong(1), "n" : 1, "timeMicros" : 306 } } }, "ok" : 1 } 
4.匹配一些词但是不能包含指定的词 
> db.ttlsa_com.runCommand("text",{search:"Welcome -California"}) { "results" : [ { "score" : 0.75, "obj" : { "_id" : ObjectId("550a687fd8511e4dbcb8c781"), "song" : "hell world", "lyrics" : "Welcome to beijing" } } ], "stats" : { "nscanned" : 4, "nscannedObjects" : 4, "n" : 1, "timeMicros" : 743, "shards" : { "shard_a" : { "nscanned" : NumberLong(4), "nscannedObjects" : NumberLong(4), "n" : 1, "timeMicros" : 345 } } }, "ok" : 1 } 
5.限制结果集条目 
>db.ttlsa_com.runCommand("text",{search:"Welcome",limit: 1}) 
6.在结果集中指定返回的字段 
>db.ttlsa_com.runCommand("text",{search:"Welcome",project:{"song":1,"_id":0}}) 
7.带额外查询条件的搜索 
>db.ttlsa_com.runCommand("text",{search:"Welcome",filter: {"song":"hell world"}}) 
8.使用特定语言搜索文本 
>db.ttlsa_com.runCommand("text",{search:"Welcome",language:"spanish"}) 
9.分词效果不是很理想。如 
>db.ttlsa_com.runCommand("text",{search:"the"}) { "results" : [ ], "stats" : { "nscanned" : 0, "nscannedObjects" : 0, "n" : 0, "timeMicros" : 432, "shards" : { "shard_a" : { "nscanned" : NumberLong(0), "nscannedObjects" : NumberLong(0), "n" : 0, "timeMicros" : 151 } } }, "ok" : 1 } 
就搜索不到的。 
mongodb是不支持中文搜索的。 全文索引可以通过相似度,来查询与条件更匹配的文章,如下:
>db.ttlsa_com.find({$text:{$search:"aa bb"}},{score:{$meta:"textScore"}})
查询结果返回相似度分数。可以结合sort进行相似度排序。
>db.ttlsa_com.find({$text:{$search:"aa bb"}},{score:{$meta:"textScore"}}).sort({score:{$meta:"textScore"}});
要用到复杂的搜索功能,还是用sphinx。 
sphinx内容可以参见:http://www.ttlsa.com/?s=sphinx
详细使用参考:http://blog.csdn.net/black_ox/article/details/21547651

转至:http://www.ttlsa.com/mongodb/mongodb-full-text-search-mongodb-ttlsa-tutorial-series/
0 0
原创粉丝点击