Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity

Commit Graph

  • 304e6ceec9 Fxed save&exit in UI only shutting down one instance Ivan Skytte Jørgensen 2017-03-23 16:49:30 +01:00
  • 76383bd761 Avoid deadlock on shutdown in msg20 threads waiting for jobs that were cancelled Ivan Skytte Jørgensen 2017-03-23 16:37:35 +01:00
  • cef46976b6 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-23 15:51:16 +01:00
  • c9d52b6033 Remvoed double-assignment to m->m_group Ivan Skytte Jørgensen 2017-03-23 15:50:53 +01:00
  • e908e34c92 Made crawlinfo update interval configurable Ivan Skytte Jørgensen 2017-03-23 15:46:26 +01:00
  • fd1e307670 Fix comment and declaration in SpiderLoop.cpp Ivan Skytte Jørgensen 2017-03-23 15:33:46 +01:00
  • 7872cd5090 Send only getcrawlinfo to hosts that have spidering enabled Ivan Skytte Jørgensen 2017-03-23 15:32:34 +01:00
  • 0bb9593de6 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-23 15:03:15 +01:00
  • 8b78367d8d Make msg20 shard fallback configurable Ivan Skytte Jørgensen 2017-03-23 15:02:00 +01:00
  • 7abaebbd9e Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-22 23:23:13 +01:00
  • 9f95945668 Make UdpServer stats threadsafe Ai Lin Chia 2017-03-22 23:22:29 +01:00
  • 2dce3935f3 Make matches2 threadsafe by separating result variables from Needles Ai Lin Chia 2017-03-22 23:12:20 +01:00
  • 6b187a2245 Change static global variable s_lastTimeStart to XmlDoc member variable Ai Lin Chia 2017-03-22 21:23:13 +01:00
  • 213cb460cd Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-22 20:46:44 +01:00
  • 1778d66315 Remove statsdb Ai Lin Chia 2017-03-22 20:37:38 +01:00
  • 033959513a Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-22 15:48:53 +01:00
  • 2d6fa5431d Log error when there is a mismatch in idx/data file Ai Lin Chia 2017-03-22 15:21:23 +01:00
  • cb8e24b0b1 Check pending docIds as well when verifying index Ai Lin Chia 2017-03-22 15:20:18 +01:00
  • 42a5415ef0 Fix uninitialized scalar field warning Ai Lin Chia 2017-03-22 13:50:52 +01:00
  • dd9ac19a5a Don't cat logs anymore Ai Lin Chia 2017-03-22 13:47:47 +01:00
  • b94035a57d Minor rearrange of RdbTree class functions Ai Lin Chia 2017-03-22 12:59:16 +01:00
  • d7d651c21b Code style changes Ai Lin Chia 2017-03-22 12:52:48 +01:00
  • 6a2cf4651d Add constness to RdbTree functions Ai Lin Chia 2017-03-22 12:52:22 +01:00
  • 186b05b14f Remove commented out code Ai Lin Chia 2017-03-22 12:51:21 +01:00
  • 0d5c048fcd Implement verifyIntegrity for RdbTree (calling checkTree) Ai Lin Chia 2017-03-22 12:50:17 +01:00
  • e80f0290dd Remove unused variable in SpiderLoop Ai Lin Chia 2017-03-22 12:31:51 +01:00
  • 9180b93424 Remove unused functions and variable from SpiderColl Ai Lin Chia 2017-03-22 12:28:54 +01:00
  • 0328233ab9 Remove unused functions Ai Lin Chia 2017-03-22 12:21:07 +01:00
  • b4537e2794 Remove non const version of RdbTree::getKey Ai Lin Chia 2017-03-22 12:10:13 +01:00
  • ad954b5e4a Code style changes Ai Lin Chia 2017-03-22 12:09:12 +01:00
  • ffc0e02171 Remove RdbTree friend class Ai Lin Chia 2017-03-22 12:08:48 +01:00
  • df4821a785 Make more function in RdbTree private Ai Lin Chia 2017-03-22 11:53:34 +01:00
  • c5a62eaf03 Use Process::EXIT_MODE directly instead of Process::Process::EXIT_MODE Ai Lin Chia 2017-03-22 11:53:08 +01:00
  • 62ab9468d0 Make some function private Ai Lin Chia 2017-03-22 11:51:47 +01:00
  • 8b3aad6773 Add constness to function Ai Lin Chia 2017-03-22 11:51:33 +01:00
  • a5c4a30788 Remove unused functions from Rdb Ai Lin Chia 2017-03-22 11:35:45 +01:00
  • 0f42928031 Remove RdbMem::freeDumpedMem dependency with RdbTree Ai Lin Chia 2017-03-22 11:10:02 +01:00
  • 77f582559f Remove unused RdbBuckets::addList Ai Lin Chia 2017-03-22 11:06:06 +01:00
  • 5d6d7a0ce5 Remove unused include from Rdb.h Ai Lin Chia 2017-03-22 11:05:23 +01:00
  • 8b212ff20b Remove unused variable from Rdb Ai Lin Chia 2017-03-22 11:04:57 +01:00
  • b2409a237f Code style changes Ai Lin Chia 2017-03-22 10:34:51 +01:00
  • 2c516be131 Make more functions private for RdbBuckets Ai Lin Chia 2017-03-21 17:17:58 +01:00
  • c359c996f6 Remove unused RdbBuckets function Ai Lin Chia 2017-03-21 17:01:44 +01:00
  • db32a7f45c Hide RdbBucket declaration in cpp file Ai Lin Chia 2017-03-21 17:00:29 +01:00
  • f76d5ce176 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-21 16:43:32 +01:00
  • 6f9d49e96b Remove write only variable Collectiondb::m_treeCount Ai Lin Chia 2017-03-21 16:42:19 +01:00
  • 0d0aaaf89e Remove unused functions in RdbBuckets Ai Lin Chia 2017-03-21 16:36:03 +01:00
  • a85a460ff6 Use reinterpret_cast instead Ai Lin Chia 2017-03-21 16:27:08 +01:00
  • 6126f97ce3 Add constness to function Ai Lin Chia 2017-03-21 16:08:24 +01:00
  • 2fdd1f5800 Hide member variable/function that is unused from outside Statsdb class Ai Lin Chia 2017-03-21 15:31:30 +01:00
  • 83f3115933 Remove commented out code from Statsdb Ai Lin Chia 2017-03-21 15:29:55 +01:00
  • 2802a64763 Delete commented out code Ai Lin Chia 2017-03-21 15:28:13 +01:00
  • cb161e96be Hide Statsdb::m_disable and provide enable/disable functions instead Ai Lin Chia 2017-03-21 15:26:35 +01:00
  • ce5ff1878c Use const version of RdbTree::getData Ai Lin Chia 2017-03-21 15:02:41 +01:00
  • 4a66432ed0 Simplified Hostdb::getBestHosts2IP() Ivan Skytte Jørgensen 2017-03-21 16:25:02 +01:00
  • e6b62fa0ce More const in Hostdb.* Ivan Skytte Jørgensen 2017-03-21 16:15:04 +01:00
  • 325de0c9f8 Removed commented-out code dealing with g_hostdb2 Ivan Skytte Jørgensen 2017-03-21 15:57:44 +01:00
  • 740bba6136 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-21 15:09:01 +01:00
  • 8ca910cc12 More changes for coverity scan Ai Lin Chia 2017-03-21 14:56:26 +01:00
  • da471f5133 Move some public functions to be private Ai Lin Chia 2017-03-21 14:19:12 +01:00
  • 145c0ddbc5 Remove unused function from RdbTree Ai Lin Chia 2017-03-21 14:19:02 +01:00
  • d0458f61ac Remove unused variable/commented out code Ai Lin Chia 2017-03-21 14:08:18 +01:00
  • 7bfae1e37c Avoid 32-bit integer overflor in RdbCache Ivan Skytte Jørgensen 2017-03-21 13:15:50 +01:00
  • f2886b5c4e Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-21 13:16:22 +01:00
  • 2c6e088bbc Add lock for Mem::getMemSlot Ai Lin Chia 2017-03-21 13:13:04 +01:00
  • ae5004c7f5 Remove unused functions & variable from RdbTree Ai Lin Chia 2017-03-21 12:48:11 +01:00
  • 88b9fbee55 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-21 12:29:05 +01:00
  • f5453544a7 Fix some timing issue with generate index. It wouldn't cause any data error, but when verifyIndex is enabled, the global index may not include recently dumped file and it assumes the global index is corrupted. This is now fixed Ai Lin Chia 2017-03-21 12:27:13 +01:00
  • 1e2ecd1e92 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-21 11:30:38 +01:00
  • 60a3b5a242 Add verify index Ai Lin Chia 2017-03-21 11:30:13 +01:00
  • 683d26b920 More logs for coverity build Ai Lin Chia 2017-03-20 17:16:55 +01:00
  • f103f30efe Removed unhelpful commnets and commented-out code in RdbCache.cpp Ivan Skytte Jørgensen 2017-03-20 16:58:22 +01:00
  • 2600e19723 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-20 16:20:19 +01:00
  • afc6bd1d2b Disable spider-indxing in thread (causes trouble elsewhere) Ivan Skytte Jørgensen 2017-03-20 16:19:54 +01:00
  • 37238ed6e7 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-20 16:17:31 +01:00
  • c30aae49bb Make sure we can update minFilesToMerge without restart Ai Lin Chia 2017-03-20 16:13:38 +01:00
  • b343ee6988 Remove tmp trace log Ai Lin Chia 2017-03-20 16:13:13 +01:00
  • af324ad9d3 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-20 16:16:35 +01:00
  • 338fadbcb1 Revert "Avoid two indexDoc jobs being submitted for an XmlDoc instance" Ivan Skytte Jørgensen 2017-03-20 16:16:15 +01:00
  • 473f9e9146 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-20 15:56:56 +01:00
  • 1064c13c8b Avoid two indexDoc jobs being submitted for an XmlDoc instance Ivan Skytte Jørgensen 2017-03-20 15:54:26 +01:00
  • 2f9ba8fe0c Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-20 15:48:56 +01:00
  • 369901e1b0 Remove trace log that only logs posdb keys Ai Lin Chia 2017-03-20 15:48:07 +01:00
  • df4bb194e3 Make sure all from the same meta list is sent out in the same Msg4 request Ai Lin Chia 2017-03-20 15:47:29 +01:00
  • 5434f1cf64 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-20 13:52:01 +01:00
  • e2355dc969 Sync changes commited on nomerge2 but not related to nomerge feature Ai Lin Chia 2017-03-20 13:51:31 +01:00
  • e19c1d9166 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-20 12:53:18 +01:00
  • 261db600a6 Expand scopedlock on host buffer in Msg4Out.cpp Ivan Skytte Jørgensen 2017-03-20 12:52:39 +01:00
  • 6f5da78d21 Change always return true function to void Ai Lin Chia 2017-03-20 11:14:10 +01:00
  • ef368c0f0f Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-20 10:45:38 +01:00
  • 7e93412d8d Show log to debug what's wrong Ai Lin Chia 2017-03-20 10:38:01 +01:00
  • 61a14f078f Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-18 18:41:37 +01:00
  • 20a6c195fe Merge Ivan Skytte Jørgensen 2017-03-17 17:43:14 +01:00
  • 9069118eda Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-17 17:39:13 +01:00
  • 6fe4d40f3e Made Msg4 queue thread-safe (and removed Msg4::m_next) Ivan Skytte Jørgensen 2017-03-17 17:13:52 +01:00
  • a84c9cd180 Remove write only variable. SpiderColl::m_msg4Start Ai Lin Chia 2017-03-17 17:27:19 +01:00
  • f1e38d46c6 Remove commented out code Ai Lin Chia 2017-03-17 17:26:03 +01:00
  • 1e3669fd97 Made Msg4 queue thread-safe (and removed Msg4::m_next) Ivan Skytte Jørgensen 2017-03-17 17:13:52 +01:00
  • 41f71d83a7 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-17 17:06:15 +01:00
  • 99793556f7 Minor log reclassification Ivan Skytte Jørgensen 2017-03-17 16:40:12 +01:00