Mirrors/privacore-open-source-search-engine
1
0
Fork 1
mirror of https://github.com/privacore/open-source-search-engine.git synced 2025-12-28 23:31:51 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
master
privacore-open-source-searc…/utf8.cpp
Ivan Skytte Jørgensen ce26026076 tokenizer: uise phase-2 tokens 
Ended up disabling use of Phrases and countTable in XmlDoc::hashWords3() becuase Phrases+Pos have hard assumptions about token order that are hard to bypass.
Also disable diversityrank calculation.
2018-03-13 17:12:42 +01:00

2.6 KiB
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink