Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity

Commit Graph

  • b92b9c0053 Simplify loop condition in PosdbTable::delNonMatchingDocIdsFromSubLists() Ivan Skytte Jørgensen 2017-05-29 15:10:29 +02:00
  • 8ce39f96d8 const Ivan Skytte Jørgensen 2017-05-29 15:04:07 +02:00
  • 312ab7ebb9 Removed useless 'continue' and end of loop Ivan Skytte Jørgensen 2017-05-29 14:52:28 +02:00
  • 20c0a751d3 Slight code cleanup in PosdbTable::delNonMatchingDocIdsFromSubLists() Ivan Skytte Jørgensen 2017-05-29 14:43:29 +02:00
  • 299c0d5fd9 Removed weird sanity check Ivan Skytte Jørgensen 2017-05-29 14:21:33 +02:00
  • 14bcb9cd7a Unwrap lines and minor stylistic changes in Query.cpp Ivan Skytte Jørgensen 2017-05-29 14:20:43 +02:00
  • ec2a25ab69 Don't lock RdbTree/RdbBucket when calling isSaving function. It's already an atomic. Ai Lin Chia 2017-05-29 14:16:51 +02:00
  • 81daa0bd3e Remove commented out code and unnecessary white space Ai Lin Chia 2017-05-29 11:58:33 +02:00
  • ea3375e4a0 We should clear based on m_dgramToRead and not m_dgramToSend Ai Lin Chia 2017-05-29 10:45:29 +02:00
  • 709bd721ed Clear receive buffer if we're doing a full resend. The response may be different Ai Lin Chia 2017-05-29 10:34:41 +02:00
  • 930a105677 Set thread-name for vaugs-poll thread, otherwise it inherits the name 'main' which just confuses Ivan Skytte Jørgensen 2017-05-26 17:11:39 +02:00
  • 8d4caad878 Add more logs Ai Lin Chia 2017-05-26 16:34:59 +02:00
  • 5655601dbf Parms::syncParmsWithHost0: turned backward gotos into separate error handling allowing distinct log messages Ivan Skytte Jørgensen 2017-05-26 14:44:41 +02:00
  • 97fe2f55c1 vagus: log if there are dead instances Ivan Skytte Jørgensen 2017-05-26 14:41:14 +02:00
  • 6730c79a0c Comment to avoid confusion again Ivan Skytte Jørgensen 2017-05-26 13:46:33 +02:00
  • b494d9b1a2 Removed checks for UdpSlot::m_readBuf being m_shortSendBuffer (it never is) Ivan Skytte Jørgensen 2017-05-26 12:36:01 +02:00
  • 79c8555cb3 Renamed UdpSlot::m_tmpBuf to m_shortSendBuffer Ivan Skytte Jørgensen 2017-05-26 12:25:07 +02:00
  • 9951b8ac0f Split UdpSlot::sendAck() into two clearly named methods Ivan Skytte Jørgensen 2017-05-26 12:20:22 +02:00
  • 4e102029a7 Fix coverity warning null pointer dereference Ai Lin Chia 2017-05-24 15:34:21 +02:00
  • 8834040c1e Initialize m_readBuf to 0xfe Ai Lin Chia 2017-05-24 15:13:41 +02:00
  • 55fb0f7092 Fix out of memory error when resuming a merge Ai Lin Chia 2017-05-24 14:26:07 +02:00
  • 5f50c23939 Add more validation in an attempt to track down message corruption Ai Lin Chia 2017-05-24 13:34:22 +02:00
  • 976481aa5a Add more validation when responding Msg25 Ai Lin Chia 2017-05-24 11:43:34 +02:00
  • 55bd577596 Add initial implementation of getting lang from CLD2 Ai Lin Chia 2017-05-24 09:35:59 +02:00
  • 02d1b2210c Add cld3 as third-party submodule Ai Lin Chia 2017-05-24 09:33:31 +02:00
  • a454cbb4e1 PosdbTable::mergeTermSubListsForDocId(): postpone local variable decl. until first use Ivan Skytte Jørgensen 2017-05-23 17:16:25 +02:00
  • 4df8d5281a Fix tldhint for query input Ai Lin Chia 2017-05-23 16:47:17 +02:00
  • 0d550a8554 Fix window initialization (make sure we initialize everything before the datagram that hasn't been initialized Ai Lin Chia 2017-05-23 16:24:57 +02:00
  • f983c4b0fa More const in PosdbTable Ivan Skytte Jørgensen 2017-05-23 16:00:03 +02:00
  • 3c4a62af14 When testing for empty lists use RdbList::isEmpty() instad of RdbList::getListSize() Ivan Skytte Jørgensen 2017-05-23 15:29:45 +02:00
  • 29812033ca Removed commented-out obsoletecode Ivan Skytte Jørgensen 2017-05-23 15:25:17 +02:00
  • 15dfb7b8dc Align left(right bigram and wikihalfstopbigram code in PosdbTable::PosdbTable::setQueryTermInfo() Ivan Skytte Jørgensen 2017-05-23 15:22:05 +02:00
  • 0aedaf4227 More udpslot debug log Ai Lin Chia 2017-05-23 15:04:53 +02:00
  • 18adbe54fa More trace log in PosdbTable.cpp concerning QueryTermInfo Ivan Skytte Jørgensen 2017-05-23 13:47:11 +02:00
  • b4c27521ef Changed QueryTerm::m_isWikiHalfStopBigram from bitfield to bool Ivan Skytte Jørgensen 2017-05-23 13:46:10 +02:00
  • fda245daf7 Old logic seems to be wrong when calculating the size of the final datagram. Don't validate with old logic but instead use the simplified logic Ai Lin Chia 2017-05-23 13:30:22 +02:00
  • 4466825f52 Simplify UdpSlot::readDatagramOrAck logic Ai Lin Chia 2017-05-23 12:11:20 +02:00
  • bd2abdb73c Remove unused printTermList Ai Lin Chia 2017-05-23 10:57:07 +02:00
  • 9ac463a2c1 aaaand changed to actually use the new Titledb trace option Brian Rasmusson 2017-05-23 12:05:51 +02:00
  • 14ff90b147 changed Titledb log to trace log and made Titledb trace log configurable Brian Rasmusson 2017-05-23 11:07:51 +02:00
  • bceaee7c17 changed Titledb log to trace log and made Titledb trace log configurable Brian Rasmusson 2017-05-23 11:07:27 +02:00
  • a40c908559 Add lock to isDead detected. Make sure we don't deadlock Ai Lin Chia 2017-05-22 21:50:59 +02:00
  • a7355cc96c Revert "Lock m_mtxPinginfo when checking if a host is dead" Ai Lin Chia 2017-05-22 21:41:38 +02:00
  • dc1bb8c2e0 Fix compilation error Ai Lin Chia 2017-05-22 17:57:09 +02:00
  • 04348a95e0 Lock m_mtxPinginfo when checking if a host is dead Ai Lin Chia 2017-05-22 17:49:50 +02:00
  • 056b2f9fb5 QueryTerm/QueryTermInfo: mor econst Ivan Skytte Jørgensen 2017-05-22 16:46:18 +02:00
  • 96221c7882 Posdbtabl/QueryTermInfo: more const Ivan Skytte Jørgensen 2017-05-22 16:15:48 +02:00
  • dc7c5a735e Removed unused UdpServer::m_outstandingConverts Ivan Skytte Jørgensen 2017-05-22 15:24:48 +02:00
  • cf80142c29 Initialize UdpServer::m_nextTransId using hostid Ivan Skytte Jørgensen 2017-05-22 15:19:27 +02:00
  • 8fb676dcfd More udp debug logs Ai Lin Chia 2017-05-22 14:53:42 +02:00
  • 3558e64edf Move log debug variables around (more alphabetical?) Ai Lin Chia 2017-05-22 12:56:39 +02:00
  • 9b77d851b9 msg3a: check correctly for deserialization errors from deserializeMsg() Ivan Skytte Jørgensen 2017-05-22 12:53:18 +02:00
  • 1aff69d524 Msg3a: use sizeof() instead of hardcoded (and incorrect) value 29 Ivan Skytte Jørgensen 2017-05-22 12:45:11 +02:00
  • 51fcc7696e Separate multicast debug messages from net Ai Lin Chia 2017-05-22 12:21:28 +02:00
  • f980441da4 log bytes sent in UdpSlot Brian Rasmusson 2017-05-21 23:22:33 +02:00
  • 6c30ebdc6a Added more checks for corrupted titledb records Brian Rasmusson 2017-05-21 23:22:07 +02:00
  • 30bed51d1d Fix corrupted LinkInfo if detected in Msg20 and Msg25 Brian Rasmusson 2017-05-21 22:49:45 +02:00
  • db8c2145f8 Renamed QueryTerm::m_userWeight* to more explicit names Ivan Skytte Jørgensen 2017-05-19 16:16:22 +02:00
  • 739d22ccbb Fix incorrect comment Ivan Skytte Jørgensen 2017-05-19 16:10:04 +02:00
  • a8e0163b20 Removed m_userType* from Query/QueryTerm/QueryWord Ivan Skytte Jørgensen 2017-05-19 16:01:37 +02:00
  • 22cbeabfd7 Log filtereredQuery if it is different from original query string Ivan Skytte Jørgensen 2017-05-19 13:59:21 +02:00
  • b10ea7d1e9 Use g_hostdb.getHostIdWithSpideringEnabled instead to get spider host Ai Lin Chia 2017-05-19 12:24:25 +02:00
  • 21f75870ca Add spider hostid on page info view Ai Lin Chia 2017-05-19 12:14:10 +02:00
  • 7b4a2ba072 Use m_waitingTree lock to make sure m_waitingTree & m_waitingTable are in sync Ai Lin Chia 2017-05-18 16:12:42 +02:00
  • 56edf49dad Cater for NULL CollectionRec Ai Lin Chia 2017-05-19 00:24:38 +02:00
  • f044de3f68 Add simple verify titledb tool (currently only verifies linkinfo) Ai Lin Chia 2017-05-19 00:24:08 +02:00
  • 2c5cde8023 Cater for collection number other than 0 Ai Lin Chia 2017-05-18 23:17:56 +02:00
  • 9fee2eb8ca Simplify logic in Query.cpp: continue -> else Ivan Skytte Jørgensen 2017-05-18 17:01:50 +02:00
  • 834c781851 Fix recursion loop introduced with 0c9a5d6d71 Ivan Skytte Jørgensen 2017-05-18 16:27:52 +02:00
  • a1799c88d9 Use hardcoded value again for doCmdAll udp slots as g_conf is not loaded when using cmd line Ai Lin Chia 2017-05-18 15:25:25 +02:00
  • 0c9a5d6d71 More constness in Inlink class Ivan Skytte Jørgensen 2017-05-18 14:30:18 +02:00
  • 2c7d1f6fae Highlight::set() now takes a const char* Ivan Skytte Jørgensen 2017-05-18 13:12:43 +02:00
  • feac1e7e31 Don't shut down in printInlinkText if linkinfo looks corrupt Ivan Skytte Jørgensen 2017-05-18 13:03:41 +02:00
  • 8309112a83 Abort when we see Msg20Reply corruption Ai Lin Chia 2017-05-18 12:42:23 +02:00
  • b7943f03c1 Add more checks around LinkInfo Ai Lin Chia 2017-05-18 12:39:53 +02:00
  • 9f9b3f08e3 More validation around RdbIndexQuery and make sure we don't return the default m_numFiles when we're merging. We want to catch out of sync dat & index files Ai Lin Chia 2017-05-17 14:04:09 +02:00
  • 5ced4d237a Reset Msg13::m_replyBufSize & Msg13::m_replyBufAllocSize when Msg13::m_replyBuf size is set to NULL Ai Lin Chia 2017-05-17 12:31:04 +02:00
  • 22b567617c Reset m_readBufMaxSize & m_readBufSize whenever m_readBuf is set to NULL Ai Lin Chia 2017-05-17 12:20:54 +02:00
  • 313b8ba544 Let's make sure more sizes are reset Ai Lin Chia 2017-05-17 12:00:29 +02:00
  • fb23e44e28 Reset read/send UdpSlot buf size Ai Lin Chia 2017-05-17 11:47:01 +02:00
  • 2bbad454d9 Configurable max udp slots Ai Lin Chia 2017-05-17 11:10:36 +02:00
  • 005c88bc96 Remove commented out code Ai Lin Chia 2017-05-17 11:10:15 +02:00
  • feaf300d7b trace-log term weights Ivan Skytte Jørgensen 2017-05-16 14:52:34 +02:00
  • f657888049 Add unlocked version of sendErrorReply & sendReply Ai Lin Chia 2017-05-16 14:34:06 +02:00
  • 49b881bc8c Move ScopedLock to top of UdpServer::sendPoll so m_needToSend changes is done under lock Ai Lin Chia 2017-05-16 14:21:47 +02:00
  • 891794ec73 Remove commented out code Ai Lin Chia 2017-05-16 14:21:31 +02:00
  • 580b28664a Add unlocked version of UdpServer::destroySlot. Fix a potential deadlock Ai Lin Chia 2017-05-16 14:02:02 +02:00
  • 97fdc921f6 Rename getTransId to getTransId_unlocked. Make sure mutex is locked when calling getTransId_unlocked Ai Lin Chia 2017-05-16 12:46:47 +02:00
  • 63319d10f4 Remove unused includes Ai Lin Chia 2017-05-16 12:34:16 +02:00
  • 573ec2ac0e Rename UdpServer::getBestSlotToSend to UdpServer::getBestSlotToSend_unlocked Ai Lin Chia 2017-05-16 12:28:48 +02:00
  • 4df0010035 Renamed UdpServer::doSending to UdpServer::doSending_unlocked, make sure it's locked before calling, and add lock when calling it Ai Lin Chia 2017-05-16 12:27:49 +02:00
  • 6868bc66fd Add lock to UdpServer::getNumUsedSlotsIncoming Ai Lin Chia 2017-05-16 12:25:38 +02:00
  • 14cbb34ec0 #inclue cleanup (UdpServer was included for various headerfiles) Ivan Skytte Jørgensen 2017-05-16 12:20:06 +02:00
  • 94ed876caa Use correct 'queryExpansion' for Query:.set2() Ivan Skytte Jørgensen 2017-05-16 12:11:24 +02:00
  • f7f8bc6a88 Renamed functions to *_unlocked so that it's easier to see if we're locking in the function or not. Move some locks into function instead of just before calling it. Move some comments around. Ai Lin Chia 2017-05-16 11:10:44 +02:00
  • 335284f682 Remove commented out code Ai Lin Chia 2017-05-16 10:41:26 +02:00
  • 015589195e Assign on the same line as variable declaration Ai Lin Chia 2017-05-15 17:39:48 +02:00
  • f5177a366a Whitespace changes Ai Lin Chia 2017-05-15 17:39:17 +02:00
  • ad2fff1917 Don't cheat and call heartbest. We really want to know when main thread is slow Ai Lin Chia 2017-05-15 16:46:01 +02:00
  • 25255e63c2 Add UdpSlot::m_slotStatus and add checks in udpserver for it. Ai Lin Chia 2017-05-15 16:44:48 +02:00