Commit Graph

75 Commits

Author SHA1 Message Date
fc07e62f10 Moved read-size logic from issuing instance / Msg39Request ot the processing instance
Each instance should be resposnsible for limiting processing sizes according to disk speed, cpu load, cpu speed and memory size. Having the issuing instacne do that doesn't make a lot of sense.
2016-08-01 16:14:34 +02:00
af4e70a051 Revert "Copied over changes from broken 'nomerge' branch"
This reverts commit 9e48989e93.
2016-08-01 14:52:50 +02:00
9e48989e93 Copied over changes from broken 'nomerge' branch 2016-08-01 14:52:09 +02:00
e3336521fb Removed Msg39::m_stackBuf
Misnamed member - it hasn't been on the stack for a long time. m_lists is now a regular array allocated with new[]
2016-07-19 16:19:45 +02:00
80cd8d78ba Remvoed Msg39Request::m_reserved* members 2016-07-11 17:16:48 +02:00
a30d24ed13 Removed Msg39Request::m_makeReply 2016-07-11 17:16:48 +02:00
e315dda7a0 Msg39 member renames
m_tt -> m_toptree
m_r -> m_msg39req
2016-07-11 17:10:53 +02:00
16f9aff736 Simplify Msg39::getDocIds() 2016-07-11 16:40:04 +02:00
3b6c9e9a5e Close of more of Msg39 2016-07-11 15:57:23 +02:00
096856e9cb Close of more of Msg39 2016-07-11 15:48:02 +02:00
83070b1078 Close of more of Msg39 2016-07-11 15:33:40 +02:00
51017cd683 #include cleanup 2016-07-11 14:57:14 +02:00
ad81c9518c Close of more of Msg39 2016-07-11 14:48:20 +02:00
0472b96dc8 Made Msg39Request::reset() non-inline 2016-07-11 14:26:43 +02:00
8d54c24991 Close of more of Msg39 2016-07-11 12:36:29 +02:00
d634c7bff4 Renamed Msg39::m_tmpq to m_query 2016-07-11 12:31:03 +02:00
0865ef7f09 Removed superfluous Msg39::m_docIdStart/m_docIdEnd 2016-07-07 16:02:39 +02:00
de2b46a09e Split Posdb.* source files
Posdb.* split into Posdb.* (the DB) and PosdbTable.* (ranking)
2016-07-04 15:06:55 +02:00
c42c46cb14 Support fx_qid. Carried all the way through to msg39request 2016-06-17 14:03:31 +02:00
8dab0db467 Remove extra semicolons 2016-05-19 18:37:26 +02:00
a746eb91e5 Support enabling/disabling high-freq-term-cache via CGI parameter 2016-05-13 16:07:58 +02:00
be9840d1c0 Replaced Threads.* with a jobscheduler
Threads were being created and destroyed which can be expensive. The
thread-per-job model has been changed to a job scheduler that manages the job
queues and threads in pools. The submission of a job now specifies start/finish
routines, state, and as precisely what kind of job it is. The job scheduler then
takes care of the rest. it is hidden how many queues and pools there are.
2016-04-29 14:27:27 +02:00
d95976ac03 IndexList cleanup
Removed most uses of IndexList. Removed unused member functions from IndexList.
2016-04-12 16:25:10 +02:00
e57fb2f72c Removed explicit m_buf[0] from Msg39Request/Msg39Reply
This also fixes the sizeof/(...) versus &m_buf-this confusion which is currently
harmless but a bug in the upcoming encoding changes.
2016-04-04 12:36:32 +02:00
12265b4ed9 Removed double assignment of m_getDocIdScoringInfo 2016-03-11 11:36:39 +01:00
ab0b9d03ea Standardize header guards 2016-03-08 22:16:02 +01:00
035a2f3e59 Send back in results an estimate of how much of the desired index scope was actually searched.
Dead shards and deadline-cutoff docid splits subtract from this. Unavailable
summaries have no influence on the estimate.
2016-03-01 14:14:58 +01:00
92d29e62e5 Removed unused macro MAX_MSG39_REQUEST_SIZE in Msg39.h 2016-03-01 11:52:24 +01:00
b69c90df10 Remove m_boolFlag variable 2016-02-28 13:03:02 +01:00
b5d7b6e26c Remove more facet codes 2016-02-25 16:54:56 +01:00
19918297cd Remove more sections codes 2016-02-24 13:42:56 +01:00
bd4ad2feb3 Do not docid ranges if the deadline would be crossed 2016-02-22 17:45:06 +01:00
5ecdd52131 Remove unused Msg39::doDocIdSplitLoop 2016-02-17 16:08:13 +01:00
80b8f1bb91 Changed Msg39::m_timeout (currently unused) to milliseconds 2016-02-15 12:12:06 +01:00
abd465f5a4 Removed unused members Msg39::m_nowUTC and Msg40::m_nowUTC 2016-02-15 11:40:22 +01:00
60d94b8ba1 Removed Msg39Request::m_useSeoResultsCache and related code 2016-02-05 14:33:31 +01:00
df810c7d10 Cleanup of Msg39 (private members, friend declarations, etc) 2016-02-04 17:44:32 +01:00
2946ed654e Removed even more unused memebrs from Msg39 2016-02-04 17:17:29 +01:00
c472a824fb Remvoed 'hack' members of Msg39
Apparently they are used by Matt's secret edition, there is no need to us to
carry over complexity only useful to non-public code.
2016-02-04 17:09:58 +01:00
9705538f32 Removed unused Msg39 members m_topScore50/m_topDocId50 2016-02-04 16:58:22 +01:00
46f8453c92 Remove unused m_fastIntersection 2016-01-27 00:02:09 +01:00
d49cc62223 Remove unused m_useNewAlgo 2016-01-26 23:57:21 +01:00
1177eaee35 Remove unused variable m_useMinAlgo 2016-01-26 23:34:56 +01:00
f1a52d3d15 Removed effectively constant-value Msg39::m_restrictPosdbForQuery (always false) 2016-01-21 15:20:27 +01:00
2480728703 Removed outdated comments and commented-out code 2016-01-21 14:21:11 +01:00
725df6b6e5 Removed unused member Msg39::m_seoDebug 2015-12-29 16:17:44 +01:00
dd21abf042 Clear Msg39Request in reset() so we don't send uninitialized bytes over the network 2015-11-13 11:04:09 +01:00
eaeb641680 Remove uncompiled/unused files 2015-11-05 12:01:47 +01:00
c8cf0e5440 fix some mem leaks from allowing really big queries.
added a max query term control to search controls to
limit users doing really big queries. but default it
very high to 1M.
2015-07-13 23:17:53 -06:00
f088e734f6 allow up to 3000 query terms. really we can allow
much more since we are mostly dynamically allocating,
only a few smaller arrays use the 3000 on the stack.
2015-07-10 19:02:30 -06:00