Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity
Files
master
privacore-open-source-searc…/utf8.cpp
Ivan Skytte Jørgensen ce26026076 tokenizer: uise phase-2 tokens 
Ended up disabling use of Phrases and countTable in XmlDoc::hashWords3() becuase Phrases+Pos have hard assumptions about token order that are hard to bypass.
Also disable diversityrank calculation.
2018-03-13 17:12:42 +01:00

2.6 KiB
Raw Permalink Blame History

View Raw
View Git Blame Copy Permalink