Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity

Commit Graph

  • ce6ab93e6e Bugfix missing search results after dump Ivan Skytte Jørgensen 2017-03-30 17:08:48 +02:00
  • 0063e804b6 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-30 16:48:28 +02:00
  • ba8a260c91 Added RdbIndex::clear method Ai Lin Chia 2017-03-30 16:47:34 +02:00
  • e814d67ecf Remove now unused getCalendarFromMs Ai Lin Chia 2017-03-30 16:17:29 +02:00
  • 2eaee48d71 Code style changes & remove commented out code Ai Lin Chia 2017-03-30 15:58:56 +02:00
  • 8d59186887 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-30 15:41:36 +02:00
  • 786502d8b0 Remove unused Collectiondb::m_numCollsSwappedOut Ai Lin Chia 2017-03-30 15:29:52 +02:00
  • 9024b60e7c Remove now unused hackCollectionForInjection Ai Lin Chia 2017-03-30 15:28:10 +02:00
  • 9485f1d87e Don't crash in unittest when index is not enabled Ai Lin Chia 2017-03-30 15:27:01 +02:00
  • 0fdc2e9945 Remove treetest from gb. it will be moved to unittest Ai Lin Chia 2017-03-30 15:24:33 +02:00
  • 70b97c53a4 Remove tmp reference variable Ai Lin Chia 2017-03-30 15:20:30 +02:00
  • 967e6849e1 Rename unused variable in CrawlInfo to m_reserved* Ai Lin Chia 2017-03-30 15:19:35 +02:00
  • d54956e2f9 Code style changes Ai Lin Chia 2017-03-30 15:18:36 +02:00
  • f134a3cea5 Remove commented out code Ai Lin Chia 2017-03-30 15:16:56 +02:00
  • 560d9c49e7 Use CrawlInfo::reset instead of manual memset Ai Lin Chia 2017-03-30 15:11:05 +02:00
  • 09e04aa8e6 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-30 15:11:39 +02:00
  • 52b1504fb6 Reworked loop in Rdb::dumpCollLoop(9 to something more streamlined Ivan Skytte Jørgensen 2017-03-30 14:54:41 +02:00
  • f7b5ab1173 Remove g_conf.m_noInMemoryPosdbMerge Ai Lin Chia 2017-03-30 14:11:19 +02:00
  • 361a33e7d0 Extract common code out into functions Ai Lin Chia 2017-03-30 14:03:43 +02:00
  • 6babc5c1c3 Remove unused RdbTree::m_isLoading Ai Lin Chia 2017-03-30 13:51:05 +02:00
  • 9a429655af Code style changes Ai Lin Chia 2017-03-30 13:40:48 +02:00
  • 9eb9957566 Code style changes Ai Lin Chia 2017-03-30 10:40:09 +02:00
  • 94ec4eb992 Remove commented out code Ai Lin Chia 2017-03-29 17:53:09 +02:00
  • 1f116855e2 Remove duplicated resets Ai Lin Chia 2017-03-29 17:52:22 +02:00
  • 1f99ff169c Remove now unused function Ai Lin Chia 2017-03-29 17:44:37 +02:00
  • 5384462d73 Use log_warn instead for warnings Ai Lin Chia 2017-03-29 17:43:59 +02:00
  • ae2ddba460 Make CollectionRec::m_needsSave thread safe Ai Lin Chia 2017-03-29 17:42:28 +02:00
  • 475f2eebe0 Extract common code out into functions Ai Lin Chia 2017-03-30 14:03:43 +02:00
  • 7e7be6c7ac Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-30 13:55:49 +02:00
  • 4e6fac1832 Remove unused RdbTree::m_isLoading Ai Lin Chia 2017-03-30 13:51:05 +02:00
  • 772b63283a Code style changes Ai Lin Chia 2017-03-30 13:40:48 +02:00
  • f2d6e8c521 Code style changes Ai Lin Chia 2017-03-30 10:40:09 +02:00
  • 8f8ab57317 Remove commented out code Ai Lin Chia 2017-03-29 17:53:09 +02:00
  • ef448b4e2b Remove duplicated resets Ai Lin Chia 2017-03-29 17:52:22 +02:00
  • 96502fbdc9 Remove now unused function Ai Lin Chia 2017-03-29 17:44:37 +02:00
  • e99e01cf5e Use log_warn instead for warnings Ai Lin Chia 2017-03-29 17:43:59 +02:00
  • 3b75814945 Make CollectionRec::m_needsSave thread safe Ai Lin Chia 2017-03-29 17:42:28 +02:00
  • 096523bd25 Removed CollectionRec::getBasePtr() because it is identical to CollectionRec::getBase() Ivan Skytte Jørgensen 2017-03-30 13:48:09 +02:00
  • 9751e61c29 Sanity check for invalid rdbid in CollectionRec::getBase() just like CollectionRec::getBasePtr() Ivan Skytte Jørgensen 2017-03-30 13:44:46 +02:00
  • 8dd3ac87c6 negative keys in RdbBuckets are fine if g_conf.m_noInMemoryPosdbMerge is false Ivan Skytte Jørgensen 2017-03-30 13:42:12 +02:00
  • 4052547327 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-30 12:44:00 +02:00
  • e6d056587f Mid-file #include cleanup of Collectiondb.cpp Ivan Skytte Jørgensen 2017-03-30 12:43:45 +02:00
  • 659a552602 Unwrapped some wrapped log lines, so they are now easier to grep for. Ivan Skytte Jørgensen 2017-03-30 12:38:56 +02:00
  • 5f5c83e9c0 Removed obsolete goto (SA_RESTART is used on all signals now) Ivan Skytte Jørgensen 2017-03-30 12:28:07 +02:00
  • 75ae032b36 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-29 14:29:42 +02:00
  • bfc445762c Fix compilation error Ai Lin Chia 2017-03-29 14:09:00 +02:00
  • 2e9929cd41 Remove statsdb specific code Ai Lin Chia 2017-03-29 12:01:00 +02:00
  • c53410d2c9 Remove commented out codes Ai Lin Chia 2017-03-29 12:00:13 +02:00
  • b1786f9522 Remove more statsdb related code Ai Lin Chia 2017-03-29 11:53:20 +02:00
  • cc4c3ac8b3 Remove collectionless logic Ai Lin Chia 2017-03-29 11:51:20 +02:00
  • 1697f4f4ec Remove gb inject command Ai Lin Chia 2017-03-29 11:40:15 +02:00
  • e833ec6e4f Remove usage of RdbTree nodeNum from Rdb Ai Lin Chia 2017-03-28 15:47:00 +02:00
  • 1c0efcf160 Make RdbTree::m_corrupt private Ai Lin Chia 2017-03-28 15:46:32 +02:00
  • a1ea2bd80b Remove commented out code Ai Lin Chia 2017-03-28 15:45:22 +02:00
  • 17dc6ad663 Remove unused RdbTree::deleteList Ai Lin Chia 2017-03-28 15:31:44 +02:00
  • 00a67cc7cd Remove unused variable/method from Parms Ai Lin Chia 2017-03-28 23:28:17 +02:00
  • ff559334b5 Remove unused config variables Ai Lin Chia 2017-03-28 23:18:49 +02:00
  • f95ee7b39a Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-28 15:29:12 +02:00
  • 6c50d23e90 Only call g_spiderLoop.spiderDoledUrls from one place. We call it every 50ms from sleep callback. There is no need to call it after indexing every document Ai Lin Chia 2017-03-28 14:34:08 +02:00
  • 75ee0568e1 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-28 14:31:11 +02:00
  • 4b02b5da6c Remove unused variables. Use logDebug instead Ai Lin Chia 2017-03-28 14:23:34 +02:00
  • 8078304744 Remove commented out code Ai Lin Chia 2017-03-28 14:20:24 +02:00
  • 601731e1cf Use const pointer for loop Ai Lin Chia 2017-03-28 14:19:09 +02:00
  • 76ac26ff80 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-28 14:26:39 +02:00
  • 125efa8027 use StatckBuf<> instead of direct conditional memory allocation Ivan Skytte Jørgensen 2017-03-28 14:12:37 +02:00
  • 3d6bf8732a Use sizeof() instead of repeating the size macro Ivan Skytte Jørgensen 2017-03-28 13:15:10 +02:00
  • 63e14e1a0d Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-28 13:08:10 +02:00
  • 418d20544e Change static method to static in Doledb. Clean up unused methods in Doledb. Ai Lin Chia 2017-03-28 13:07:09 +02:00
  • 580c556c16 Remove commented out code Ai Lin Chia 2017-03-28 13:05:56 +02:00
  • 976fbc77fd Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-28 12:43:51 +02:00
  • db9425e862 Don't load what is not saved Ai Lin Chia 2017-03-28 12:43:10 +02:00
  • edcd220490 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-28 12:36:57 +02:00
  • edba87957c Remoed clock synchronization, time adjustment etc. Ivan Skytte Jørgensen 2017-03-28 12:28:12 +02:00
  • 7dcc85540d Modify io stats to something that make more sense than using timerange stats Ai Lin Chia 2017-03-28 12:27:22 +02:00
  • 0e14136293 Don't shutt down if a zero-sized file is a merge file Ivan Skytte Jørgensen 2017-03-28 12:13:06 +02:00
  • 1fc7a6112b Collectionrec: char->bool Ivan Skytte Jørgensen 2017-03-28 12:07:41 +02:00
  • e1de43d81a Call tree+meme clear() at end of dump instead of deleteList() for each chunk Ivan Skytte Jørgensen 2017-03-28 11:56:14 +02:00
  • a39eb54ae7 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-28 11:15:09 +02:00
  • 94674449bd Remove slowDiskReads statistics Ai Lin Chia 2017-03-28 11:11:00 +02:00
  • a4708e06a8 Remove commented out code Ai Lin Chia 2017-03-28 11:07:49 +02:00
  • ad833cae73 Add BigFile statistics to Statistics Ai Lin Chia 2017-03-28 11:06:16 +02:00
  • b854390ef4 Remove collectionless flag from Rdb::init Ai Lin Chia 2017-03-27 23:12:18 +02:00
  • 85c2cf8157 Fix compilation error Ai Lin Chia 2017-03-27 22:25:57 +02:00
  • 438add1ceb Remove unused config variables Ai Lin Chia 2017-03-27 22:25:04 +02:00
  • 6a911c9c22 Remove statsdb related config Ai Lin Chia 2017-03-27 22:06:16 +02:00
  • 923523d400 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-27 21:15:01 +02:00
  • 31b80bda75 Remove unused functions from Profiler Ai Lin Chia 2017-03-27 21:12:54 +02:00
  • 44b25c8ad1 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-27 20:38:23 +02:00
  • c09c6448cb Remove QUICKPOLL from Msg3 Ai Lin Chia 2017-03-27 20:37:22 +02:00
  • 89e72d7141 Don't save unloaded hashtable (spider proxy stats) Ai Lin Chia 2017-03-27 17:43:13 +02:00
  • 69d8a24243 Fix unittest compilation Ai Lin Chia 2017-03-27 17:18:45 +02:00
  • 35d8c03440 Removed non-functional sanity check Ivan Skytte Jørgensen 2017-03-27 16:45:23 +02:00
  • e122472a83 Merge branch 'master' into nomerge2 Ai Lin Chia 2017-03-27 16:38:42 +02:00
  • 1d907057ff Make SpiderColl::m_cdTable threadsafe Ai Lin Chia 2017-03-27 16:37:10 +02:00
  • 4ea445a206 make SpiderColl::m_sniTable threadsafe Ai Lin Chia 2017-03-27 16:36:31 +02:00
  • e220fff4ef Don't populate doledb when adding to waiting tree. it will be populated from sleep callback anyway Ai Lin Chia 2017-03-27 16:34:08 +02:00
  • 5f9f892b9d Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2017-03-27 16:31:30 +02:00
  • a46e553b33 Encapsulate topTree better Ivan Skytte Jørgensen 2017-03-27 16:31:17 +02:00
  • e31cb910e6 Removed RdbDump::first-/last-key-in-queue members (not needed anymore) Ivan Skytte Jørgensen 2017-03-27 16:14:36 +02:00
  • 9b0bb74f1e Simplify Rdb::addRecord() is-dumping check to match Rdb::hasRoom() Ivan Skytte Jørgensen 2017-03-27 16:07:52 +02:00