Mirrors/privacore-open-source-search-engine
1
0
Fork 1
mirror of https://github.com/privacore/open-source-search-engine.git synced 2025-12-25 23:11:51 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
master
privacore-open-source-searc…/utf8.h
Ivan Skytte Jørgensen ce26026076 tokenizer: uise phase-2 tokens 
Ended up disabling use of Phrases and countTable in XmlDoc::hashWords3() becuase Phrases+Pos have hard assumptions about token order that are hard to bypass.
Also disable diversityrank calculation.
2018-03-13 17:12:42 +01:00

5.7 KiB
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink