Location:
Search - shingling
Search list
Description: 网页查重算法Shingling和Simhash研究.对初学者很有用。-Web search algorithms Shingling and Simhash of weight. Useful for beginners.
Platform: |
Size: 291840 |
Author: fsdaf |
Hits:
Description: 大型网页去重算法之一，bloomfliter算法，基于shingling算法进行改良，可处理海量网页数据。-One of large Web pages De-emphasis algorithms: bloomfliter algorithm.Based on the shingling algorithm and be improved, which can handle massive web data.
Platform: |
Size: 1024 |
Author: 杜骊英 |
Hits:
Description: shingling算法实现，比较弱，但是思想是对的，对新手可以有些帮助-shingling algorithm is relatively weak, but the idea is right, can help the novice
Platform: |
Size: 164864 |
Author: zhang |
Hits:
Description: 我使用的是面向局部敏感的最小哈希签名的方法进行文档查重。设计采用了集合的思想，因为是要在一个文件夹中查找相似的文档，决定采用shingling 来表示一篇文档，运用了K-shingles技术,将一篇文档看成是一个字符串，k-shingle就是这篇文档中出现过的任何长度为k的一个字符串，在进行处理之前会去掉文档中不必要的标点符号，空格，和换行。对于k的取值，若是一般的文档则取5就够了，若是文档较长的话取9是相对而言比较安全的。(I used a locally sensitive minimum Hashi signature method for document retrieval. The design uses a collection of ideas, because it is to find a similar document in a folder, decided to use shingling to represent a document, using K-shingles technology, a document as a string of any length is k-shingle in this document as a string of K, in before processing will remove punctuation, unnecessary document spaces and newlines. For the value of K, if the general document is 5 enough, if the document is longer, it is relatively safe to take 9.)
Platform: |
Size: 39936 |
Author: lala_
|
Hits: