Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity

Commit Graph

  • 480a6917a4 Make Msg4 'zid' generation thread-safe Ivan Skytte Jørgensen 2017-03-17 16:31:10 +01:00
  • c8bad7d27a De-clumsyfied buffer allocation in Msg4Out.cpp Ivan Skytte Jørgensen 2017-03-17 15:55:39 +01:00
  • f27190e251 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-17 15:12:58 +01:00
  • 98192ba79d Move generateGlobalIndex to thread Ai Lin Chia 2017-03-17 14:48:10 +01:00
  • 5fc128f8fb include cleanup in Msg4Out.* Ivan Skytte Jørgensen 2017-03-17 14:35:58 +01:00
  • 5cdb54e7b0 Use plain memcpy() when src+dst cant overlap in Msg4Out.cpp Ivan Skytte Jørgensen 2017-03-17 14:27:50 +01:00
  • 8bcccdd136 Try to fix coverity builds Ai Lin Chia 2017-03-17 14:12:44 +01:00
  • 7f247a19eb Removed unhelpful comments from Msg4Out.cpp Ivan Skytte Jørgensen 2017-03-17 14:10:17 +01:00
  • 1ebf50ebe8 Don't coredump if addsinprogress.dat is corrupted upon startup Ivan Skytte Jørgensen 2017-03-17 13:22:07 +01:00
  • 7c183d2e72 Make multicast handling thraeddsafe in Msg4Out.cpp Ivan Skytte Jørgensen 2017-03-17 13:20:36 +01:00
  • 255a0d95ad Reworking Msg4Out.cpp linked list to plain array. Ivan Skytte Jørgensen 2017-03-17 13:06:11 +01:00
  • 56cf4184e5 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-17 13:18:36 +01:00
  • cdaacd1bb5 Fix buffer overflow when adding a long UTF8 url Ai Lin Chia 2017-03-17 13:18:08 +01:00
  • 57e3ef3c1d Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-17 12:56:40 +01:00
  • c016369304 Revert "Support single-host rebuild/repair" Ai Lin Chia 2017-03-17 12:51:58 +01:00
  • 7f9b04e1dd Remove commented out code Ai Lin Chia 2017-03-17 12:47:28 +01:00
  • d7b9411659 Fix buffer overflow for RdbList when trace log is enabled Ai Lin Chia 2017-03-17 12:46:11 +01:00
  • 69f5784d27 Add comment for Posdb key Ai Lin Chia 2017-03-17 12:45:00 +01:00
  • 8faa58821d Add shardByTermId to Posdb::printKey Ai Lin Chia 2017-03-17 12:41:55 +01:00
  • 1f3e37fab1 Add some comment to getShardNum Ai Lin Chia 2017-03-17 12:40:42 +01:00
  • 2f71a3158b Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-17 12:44:49 +01:00
  • ed203f7f7f Removed Msg4::m_tmpBuf (Spider.cpp can handle memory allocation just fine without that hack) Ivan Skytte Jørgensen 2017-03-17 12:44:19 +01:00
  • df706a6915 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-17 12:25:50 +01:00
  • 876e2df597 Avoid (harmless) race condition in UdpServer::timePoll() on m_activeListHead Ivan Skytte Jørgensen 2017-03-17 12:25:01 +01:00
  • 9809dd0680 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-17 12:04:20 +01:00
  • 48dddbc90a Protect updating PingInfo with a mutex Ivan Skytte Jørgensen 2017-03-17 12:03:31 +01:00
  • b005a2a174 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-16 17:24:10 +01:00
  • d9b47779cc Merge Ivan Skytte Jørgensen 2017-03-16 17:21:44 +01:00
  • be131cb023 bugfix e90e1d210b Ivan Skytte Jørgensen 2017-03-16 17:18:55 +01:00
  • e90e1d210b Split Msg4.* into Msg4In and Msg4Out Ivan Skytte Jørgensen 2017-03-16 16:04:27 +01:00
  • 1e02bde997 Make Parms.h more self-contained Ivan Skytte Jørgensen 2017-03-16 15:45:39 +01:00
  • a93c7d798e Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-16 13:12:10 +01:00
  • 4118af23e3 Avoid potential race condition on XmlDoc::m_calledMsg22e Ivan Skytte Jørgensen 2017-03-16 13:11:48 +01:00
  • 3574b8f11d Avoid potential race condition on XmlDoc::m_calledMsg22e Ivan Skytte Jørgensen 2017-03-16 13:09:58 +01:00
  • a60b23c9eb Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-16 11:10:06 +01:00
  • f12074fb35 Make Msge1 threadsafe (just like Msge0) Ivan Skytte Jørgensen 2017-03-15 17:09:12 +01:00
  • 3275bdd28d Align code in Msg0.cpp with Msg1.cpp Ivan Skytte Jørgensen 2017-03-15 16:28:33 +01:00
  • 14878447b6 Fixed (harmless) * vs. *= typo (again) Ivan Skytte Jørgensen 2017-03-15 16:11:56 +01:00
  • f6e8412578 Fixed (harmless) * vs. *= typo Ivan Skytte Jørgensen 2017-03-15 16:11:17 +01:00
  • 86f4efa3f1 #include cleanup in Msge1.* Ivan Skytte Jørgensen 2017-03-15 16:08:49 +01:00
  • a9229cf0a9 Cannot pass non-POD m_list to varargs function logTrace() Ivan Skytte Jørgensen 2017-03-15 16:04:31 +01:00
  • e74a407ce0 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-15 16:04:41 +01:00
  • 21efc82b90 Don't preallocate m_pendingDocIds when we're not going to use it Ai Lin Chia 2017-03-15 15:58:52 +01:00
  • b54795202b Fallback for when unable to submit job should call function that needs to be called after running submitted job Ai Lin Chia 2017-03-15 15:19:18 +01:00
  • 377450e3a9 Another try at fixing coverity build Ai Lin Chia 2017-03-15 14:11:38 +01:00
  • 7d4f7df2c7 Call cov-configure for custom g++ version Ai Lin Chia 2017-03-15 11:56:06 +01:00
  • 19a317cecb Removed unused Msge1::m_addTags Ivan Skytte Jørgensen 2017-03-14 18:27:17 +01:00
  • 0284ab2d94 More alignment of Msge1 with Msge0: goto -> while() Ivan Skytte Jørgensen 2017-03-14 18:25:38 +01:00
  • 174278707e More alignment of Msge1 with Msge0 Ivan Skytte Jørgensen 2017-03-14 18:19:36 +01:00
  • fb9592a1ff Msge1::addTag() and doneAddingTag() were esentially no-ops Ivan Skytte Jørgensen 2017-03-14 18:13:58 +01:00
  • 6f1d2b06a2 More alignment of Msge1 with Msge0 Ivan Skytte Jørgensen 2017-03-14 18:07:49 +01:00
  • 2964539aee Removed obsolete and unhelpful comments Ivan Skytte Jørgensen 2017-03-14 18:02:18 +01:00
  • 4af3064d07 More alignment of Msge1 with Msge0 Ivan Skytte Jørgensen 2017-03-14 17:58:50 +01:00
  • 2fdd53faf2 More alignment of Msge1 with Msge0 Ivan Skytte Jørgensen 2017-03-14 17:57:13 +01:00
  • c322628cca Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-14 17:58:48 +01:00
  • 87f23e2f49 disable statsdb from dump to disk command Ai Lin Chia 2017-03-14 17:58:04 +01:00
  • 54d2713e5e Removed Msge1::m_coll (not used) Ivan Skytte Jørgensen 2017-03-14 17:53:05 +01:00
  • 2072b46022 Removed Msge1::m_skipOldLinks (always false) Ivan Skytte Jørgensen 2017-03-14 17:51:37 +01:00
  • 3fadf8e761 Align msge1 iwth Msge0: c'tor and reset() Ivan Skytte Jørgensen 2017-03-14 17:40:14 +01:00
  • 3cdb75e176 More const in Msge1 Ivan Skytte Jørgensen 2017-03-14 17:25:07 +01:00
  • 77fd7b2f18 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-14 16:57:03 +01:00
  • 74dc29f283 Don't silently ignore error and logging false info Ai Lin Chia 2017-03-14 16:03:49 +01:00
  • c6bca613e2 Check dumped file size Ai Lin Chia 2017-03-14 16:03:39 +01:00
  • 26419bc164 Don't move 0 byte file to trash. Shutdown instead Ai Lin Chia 2017-03-14 15:44:48 +01:00
  • 2e4d80c80e Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-14 15:41:32 +01:00
  • 36a167389e Use 2nd variants of KEYMIN/KEYMAX Ivan Skytte Jørgensen 2017-03-14 15:38:09 +01:00
  • d76e2192a8 Remoed RdbMerge::m_endKey (it was always KEYMAX) Ivan Skytte Jørgensen 2017-03-14 15:33:27 +01:00
  • 4be60a6454 Add checks for when src & dst have different sizes after moving/copying Ai Lin Chia 2017-03-14 15:24:24 +01:00
  • 4af955e174 Move document indexing from main thraed to a job Ivan Skytte Jørgensen 2017-03-14 15:23:15 +01:00
  • abfa828dbd Add check for zero byte file after merge Ai Lin Chia 2017-03-14 15:11:39 +01:00
  • cd75798b5b Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-14 14:48:18 +01:00
  • 91e1f599dd msg5/Msg3: don't log errors without LOG_ERROR/LOG_WARN Ivan Skytte Jørgensen 2017-03-14 14:48:01 +01:00
  • c8e082d2a0 Avoid selecting unreadable files for merging. Ivan Skytte Jørgensen 2017-03-14 14:41:39 +01:00
  • ad2b797695 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-14 14:40:33 +01:00
  • 61d2f0a545 Don't double decrement outstanding job when generateGlobalIndexWrapper can't be submitted Ai Lin Chia 2017-03-14 14:38:56 +01:00
  • 99312476b2 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-14 14:30:50 +01:00
  • d6d7febd39 Only call markNewFileReadable when base is not null Ai Lin Chia 2017-03-14 14:30:25 +01:00
  • d40bf04ca6 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-14 14:01:06 +01:00
  • a06dfdd02f Fix bug where new files are not marked as readable Ai Lin Chia 2017-03-14 13:30:54 +01:00
  • 2332b828dd Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-14 10:55:03 +01:00
  • ec7f7de73c Shutdown when we detect there are 0 positive records left Ai Lin Chia 2017-03-14 10:53:56 +01:00
  • 25abb6a0b3 Remove unused g_inHandler Ai Lin Chia 2017-03-13 16:58:08 +01:00
  • a3be4fbf47 Removed effectively unused XmlDoc::m_registeredSleepCallback and XmlDoc.cpp:indexDocWrapper2() Ivan Skytte Jørgensen 2017-03-13 15:56:22 +01:00
  • f686c3d448 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-13 15:18:04 +01:00
  • eb4cfa3c7c Increase RdbIndex reserve size to 3000000 Ai Lin Chia 2017-03-13 15:17:46 +01:00
  • 20c53bf8fe Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-13 15:17:16 +01:00
  • b8e7d9082c Don't call write on even numbered index files (merge files) Ai Lin Chia 2017-03-13 15:11:21 +01:00
  • 0ee7a7136f Made Msge0 safe to be used by non-main thread Ivan Skytte Jørgensen 2017-03-13 15:12:50 +01:00
  • 3fcdd92311 Removed unhelpful comments Ivan Skytte Jørgensen 2017-03-13 14:58:37 +01:00
  • ac48a639e8 Simplify Msge0::launchRequests() somewhat Ivan Skytte Jørgensen 2017-03-13 14:14:27 +01:00
  • ba25b1d3c7 Dropped 'skipOldLinks' parameter to Msge0::getTagRecs(). Always false Ivan Skytte Jørgensen 2017-03-13 13:53:06 +01:00
  • baf8b7b14e Removed no longer valid comment Ivan Skytte Jørgensen 2017-03-13 13:43:00 +01:00
  • 94caba613a Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-13 13:40:03 +01:00
  • 8265aa398a Don't free memory when it's RdbIndex for tree/bucket Ai Lin Chia 2017-03-13 13:39:10 +01:00
  • 5ed39e479e Msge0 constructor simplification Ivan Skytte Jørgensen 2017-03-13 13:35:02 +01:00
  • ac8b6be920 Simplify Msge0::reset() Ivan Skytte Jørgensen 2017-03-13 13:28:36 +01:00
  • ca3817ab18 Removed obsolete internal constant in msge0.cpp Ivan Skytte Jørgensen 2017-03-13 12:42:51 +01:00
  • 4ace29fa93 Made Msge0::reset() reset more (release memory) Ivan Skytte Jørgensen 2017-03-13 12:42:28 +01:00
  • 233f75b494 More const in Msge0 Ivan Skytte Jørgensen 2017-03-13 12:39:40 +01:00
  • dcb13f7d67 Simplified memory management in msge0 Ivan Skytte Jørgensen 2017-03-13 12:37:26 +01:00