Week2-4Morphological similarity:stemming
来源:互联网 发布:ios图片模糊软件 编辑:程序博客网 时间:2024/05/30 23:20
Whether 2 words are morphologically related.
Stemming
to reduce the word to its basic form, which is called the stem, after removing various suffixes and endings, and sometimes performing additional transformations.
Remark: In practice, prefixes are sometimes preserved(rescan).
Porter’s methods for stemming
- rule-based methods
- paper An algorithm for stripping
- the method is not always accurate
Measure
The measure of the word is an indication of the number of syllables in it
- Each sequence of consonants is denoted by C
- Each sequence of vowels is denoted by V
- The initial C and the ending V can be optional
The measure is the repeated [VC] times
Porter’s algorithm
The initial word is checked against a sequence of transformation patterns, in order.
one of the patterns: if the word ends with ation, then the pattern of the word is the part without ation(meditation - medit)
- whenever the pattern matches, the word is transformed and the algorithm restarts from the beginning of the list of patterns with the transformed word
- if no pattern matches, the algorithm stops and outputs the most recently transformed version of the word
0 0
- Week2-4Morphological similarity:stemming
- Week2-3Text similarity:introduction
- Week2-5Spelling similarity:edit distance
- week2
- Week2
- week2
- Week2
- week2
- week2
- morphological antialiasing
- Morphological Antialiasing
- 浙大 数据结构基础 week2 4-1
- MLAA--Morphological Anti-Aliasing
- Gray-Scale Morphological Operations
- Morphological filtering/形态学滤波
- The Porter Stemming Algorithm
- Morphological Filtering Dilate, erode, reconstruct, and perform other morphological operations
- test Week2
- chromium 进程创建分析
- c/c++的全局变量初始化顺序
- C++中的RTTI机制
- 杭电1397--素数问题-哥德吧猜想
- Pyqt实现无边框窗口拖动及改变窗口大小
- Week2-4Morphological similarity:stemming
- POJ-2533Longest Ordered Subsequence(LIS)
- JAVA编程思想之内部类
- PARALLEL hint
- 3des加密代码
- mysql两种表存储结构myisam和innodb的性能比较测试
- 仿QQ聊天(5)—聊天表情的适配
- Android Studio 混淆打包 IOException: Please correct the above warnings first
- 黑马程序员——JAVA基础----JAVA概述