Commit Graph

  • 71f0fc67f0 Reset m_ptr1/m_ptr2/m_memSize too in RdbMem::reset() Ivan Skytte Jørgensen 2016-10-06 16:04:55 +02:00
  • ba17caed34 Removed RdbDump::m_fd (only used once for error checking) Ivan Skytte Jørgensen 2016-10-06 15:37:05 +02:00
  • 9d16ac674f Removed obsolete comment Ivan Skytte Jørgensen 2016-10-06 15:25:44 +02:00
  • 8ce3b603da More constness in Rdb* Ivan Skytte Jørgensen 2016-10-06 15:20:46 +02:00
  • c78592970b Add RdbIndexQuery::printIndex to log global & tree index in RdbIndexQuery. Ai Lin Chia 2016-10-06 14:37:41 +02:00
  • 4e89c93a60 Fix bug with RdbIndexQuery where wrong offset is used Ai Lin Chia 2016-10-06 14:36:12 +02:00
  • 5eb8d10f97 Add calls to generateGlobalIndex where necessary to make sure we regenerate global index after dumping tree/bucket to file Ai Lin Chia 2016-10-06 14:32:32 +02:00
  • 645a297ce9 Remove tmp comment Ai Lin Chia 2016-10-06 14:30:13 +02:00
  • 930c8db49d Add constness Ai Lin Chia 2016-10-06 14:28:08 +02:00
  • 2029acc41a Make tagdb tight-mergable just like all most other DBs Ivan Skytte Jørgensen 2016-10-06 14:19:23 +02:00
  • 30716ba1fd Remove no-op functions addCollnumToLinkedListOfMergeCandidates & removeFromMergeLinkedList Ai Lin Chia 2016-10-06 14:09:57 +02:00
  • 4eae664afe Remove always false s_inside Ai Lin Chia 2016-10-06 14:04:12 +02:00
  • 6deba4ff3c Remove QUICKPOLL from Msg1 Ai Lin Chia 2016-10-05 12:13:10 +02:00
  • 4d262a8987 Remove QUICKPOLL from Msg0 Ai Lin Chia 2016-10-05 12:09:39 +02:00
  • 2cd371fb41 Use KEYNEG instead of testing bits manually Ai Lin Chia 2016-10-04 15:53:17 +02:00
  • ceb7f69ac4 Simplified disable-thrads logic in Process::shutdown2() Ivan Skytte Jørgensen 2016-10-06 14:00:28 +02:00
  • 41c705a673 Removed obsolete todo from JobScheduler.h Ivan Skytte Jørgensen 2016-10-06 12:35:10 +02:00
  • 5baabf9929 Make Rdb::m_numMergesOut atomic so it is safely maintained by threads Ivan Skytte Jørgensen 2016-10-06 12:31:31 +02:00
  • 1f83519f93 constness in parameters to RdbBase::getListSize() Ivan Skytte Jørgensen 2016-10-06 12:14:20 +02:00
  • 7fa6d5d665 Made more RdbBase methods private Ivan Skytte Jørgensen 2016-10-06 12:07:05 +02:00
  • 03e70d5702 Made Rdb access g_collectiondb via methods instead of direct member access Ivan Skytte Jørgensen 2016-10-06 11:55:14 +02:00
  • d0ea5cbc31 if -> switch Ivan Skytte Jørgensen 2016-10-06 11:46:05 +02:00
  • 75fc0b3f9b Removed commented-out code Ivan Skytte Jørgensen 2016-10-06 11:43:31 +02:00
  • 7cae91c637 if -> switch Ivan Skytte Jørgensen 2016-10-06 11:36:23 +02:00
  • e05bafc6c2 Remvoed unused RdbBase::m_maxTreeMem Ivan Skytte Jørgensen 2016-10-04 16:44:25 +02:00
  • 1614bf54ac Removed RdbBase::m_checkedForMerge (unused) Ivan Skytte Jørgensen 2016-10-04 16:18:40 +02:00
  • 9d335f099f Removed urgent merge mode from RdbBase Ivan Skytte Jørgensen 2016-10-04 16:15:09 +02:00
  • 8240f7eae9 More constness in RdbBase Ivan Skytte Jørgensen 2016-10-04 16:08:36 +02:00
  • ad91b93fba Removed unused RdbBase::moveToDir() Ivan Skytte Jørgensen 2016-10-04 15:53:29 +02:00
  • 571ecf81ba Add RdbList unit test to verify behaviour of removeNegRecords Ai Lin Chia 2016-10-04 15:46:23 +02:00
  • 6bcbd3bdcf Pass in useIndexFile to RdbList::posdbMerge_r. Make more function private in RdbList Ai Lin Chia 2016-10-04 15:44:23 +02:00
  • b13357f92f Use KEYNEG instead of manually checking bits Ai Lin Chia 2016-10-04 15:43:33 +02:00
  • d567bf9d7a Use KEYNEG instead of testing manually Ai Lin Chia 2016-10-04 15:34:04 +02:00
  • ce582bdc95 Remvoed unused and commented-out methods in RdbBase Ivan Skytte Jørgensen 2016-10-04 15:47:59 +02:00
  • ae338c4ab5 Removed g_numThreas (RdbBase.*) Ivan Skytte Jørgensen 2016-10-04 15:21:13 +02:00
  • a41b687517 Stop Rdb from using g_numThreads Ivan Skytte Jørgensen 2016-10-04 15:19:51 +02:00
  • d63fda7772 Made RdbBase::m_x and m_a private Ivan Skytte Jørgensen 2016-10-04 15:17:15 +02:00
  • 91797c68eb Don't prevent multiple merges for different RDBs running Ivan Skytte Jørgensen 2016-10-04 15:15:31 +02:00
  • 26c34c6fc6 Added nice BigFile::invalidateFileSize() instead of other code knowing to set m_fileSize=-1 Ivan Skytte Jørgensen 2016-10-04 15:11:39 +02:00
  • 4ad7549430 Changed 5 separate RdbBase member arrays into array-of-struct Ivan Skytte Jørgensen 2016-10-04 15:06:54 +02:00
  • aac177e709 Use Rdbbase:.getMap() instead of access m_maps array directly Ivan Skytte Jørgensen 2016-10-04 14:47:24 +02:00
  • 75bdd53961 Use Rdbbase:.getMap() instead of access m_maps array directly Ivan Skytte Jørgensen 2016-10-04 14:45:48 +02:00
  • a79d033bf4 Use Rdbbase::getMap() instead of access m_maps array directly Ivan Skytte Jørgensen 2016-10-04 14:40:52 +02:00
  • ede15bbc29 typo in log message Ivan Skytte Jørgensen 2016-10-04 12:48:25 +02:00
  • 3b5389531f Removed decl of unimplemented member Ivan Skytte Jørgensen 2016-10-04 12:48:14 +02:00
  • b26a6186ab Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-10-04 12:43:22 +02:00
  • 0f1e1966ee Simplify code Ai Lin Chia 2016-10-04 12:31:07 +02:00
  • d4346a46da Fix deadlock Ai Lin Chia 2016-10-04 12:30:40 +02:00
  • 231de49cb9 Fix valgrind warning Ai Lin Chia 2016-10-04 12:29:09 +02:00
  • 8062a61c4c Add other rdb reset Ai Lin Chia 2016-10-04 12:28:50 +02:00
  • 225fff9fad Add XmlDoc unit test for getMetaList Ai Lin Chia 2016-10-04 11:26:56 +02:00
  • 2ff1582b33 Remove redundant new line in log message Ai Lin Chia 2016-10-04 11:24:01 +02:00
  • 56e24393ce Remove commented out code Ai Lin Chia 2016-10-04 11:20:28 +02:00
  • c0156b8915 Add some print functions in XmlDoc for ease of debugging Ai Lin Chia 2016-10-04 11:19:42 +02:00
  • c0d16ac281 Simplify code Ai Lin Chia 2016-10-04 11:18:29 +02:00
  • 55148fff82 Add constness Ai Lin Chia 2016-10-04 11:17:49 +02:00
  • 4e3edf31e7 Only attempt to read/regenerate RdbIndex if RdbTree/RdbBuckets contains data Ai Lin Chia 2016-10-04 11:16:33 +02:00
  • e3bf93faf0 Remove quickpoll from msg22 Ai Lin Chia 2016-10-03 11:28:37 +02:00
  • f91113f529 Code style changes, add warning/error logs where needed Ai Lin Chia 2016-09-30 16:28:37 +02:00
  • d18518a122 Add constness Ai Lin Chia 2016-09-30 16:11:22 +02:00
  • 397b2a0d06 Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-04 12:35:42 +02:00
  • 9731bf615f Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-04 12:22:31 +02:00
  • 895a104852 Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-04 12:18:20 +02:00
  • 7ba3a8c9af Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-04 12:13:12 +02:00
  • bc2904dee7 Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-04 12:08:36 +02:00
  • 616aca6d10 Changed main.cpp's direct access to RdbBase memebrs go mostly via a method Ivan Skytte Jørgensen 2016-10-04 12:03:41 +02:00
  • 3ddad7df2d Improve encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-03 17:34:02 +02:00
  • 17fdf98102 Removed isTitledb parameter to Rdb::init() Ivan Skytte Jørgensen 2016-10-03 17:27:24 +02:00
  • 1a1974d496 fix merge error in makefile Ivan Skytte Jørgensen 2016-10-03 17:18:27 +02:00
  • a0941d4ebe Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-10-03 17:17:45 +02:00
  • 2e0484eeb9 Improve encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-03 17:16:26 +02:00
  • b53b21b4ee Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-03 16:38:05 +02:00
  • 1061f3afb1 Better encapsulation of RdbBase Ivan Skytte Jørgensen 2016-10-03 16:19:20 +02:00
  • 523b1a8f6f char -> bool Ivan Skytte Jørgensen 2016-10-03 16:14:42 +02:00
  • e76532db58 split sliding scale algorithm from intersectLists into separate function Brian Rasmusson 2016-10-03 16:25:38 +02:00
  • fb29181f4a More paralellism in Rdb::dumpTree() Ivan Skytte Jørgensen 2016-10-03 16:11:32 +02:00
  • c46ad79d5a Made SafeBuf::operator[]() const Ivan Skytte Jørgensen 2016-10-03 15:47:32 +02:00
  • dd2f9def17 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-10-03 15:45:07 +02:00
  • 7f5493be36 Changed a goto-loop into a for(;;) loop Ivan Skytte Jørgensen 2016-10-03 15:40:45 +02:00
  • 2c30da9f86 Changed a goto-loop into a for(;;) loop Ivan Skytte Jørgensen 2016-10-03 15:34:26 +02:00
  • c87bd265a6 Removed always-false condition on g_errno Ivan Skytte Jørgensen 2016-10-03 15:30:58 +02:00
  • 6ad583e257 char -> bool Ivan Skytte Jørgensen 2016-10-03 15:23:53 +02:00
  • 9a8631664b More constness in SafeBuf Ivan Skytte Jørgensen 2016-10-03 15:03:35 +02:00
  • 57c1ac9122 Removed superfluous if() (always false) Ivan Skytte Jørgensen 2016-10-03 14:56:08 +02:00
  • 7f64c22c45 Changed g_dumpMode from char to bool Ivan Skytte Jørgensen 2016-10-03 14:41:05 +02:00
  • 92a3c13259 Made g__numUrgentMerges local to RdbBase Ivan Skytte Jørgensen 2016-10-03 14:35:31 +02:00
  • 7f8f18f0b1 Removed unused 'doNicenessConversion' calculation in UdpServer Ivan Skytte Jørgensen 2016-10-03 14:31:27 +02:00
  • 4239c527bc Optimized utf8Size() a bit Ivan Skytte Jørgensen 2016-10-03 14:28:10 +02:00
  • a976396449 Merge branch 'master' of github.com:privacore/open-source-search-engine Ivan Skytte Jørgensen 2016-10-03 12:08:53 +02:00
  • b54e979a56 check for get file size err before trying to alloc mem in loadUnicodeTable Brian Rasmusson 2016-10-02 20:13:15 +02:00
  • 526eedcb6e don't access prev if null in Sections::setMenus Brian Rasmusson 2016-10-02 09:44:50 +02:00
  • 504d4ebaa7 init class members in UdpServer Brian Rasmusson 2016-10-02 09:43:03 +02:00
  • bbe348c893 init class members in TcpServer Brian Rasmusson 2016-10-02 09:41:19 +02:00
  • 9bf1fa5ba5 don't close fd if it is -1 in Wiktionary::load Brian Rasmusson 2016-10-02 09:38:16 +02:00
  • e5e178d22b do not call fstat on fd that failed to open in Wiktionary::load Brian Rasmusson 2016-10-01 23:32:24 +02:00
  • 5c60642877 do not call list->setLastKey with null ptr in dedupSpiderdbList (Spider.cpp) - log warning if it would have happened (it would core) Brian Rasmusson 2016-10-01 23:24:30 +02:00
  • 23292313d2 check cr for null before use in expandHtml Brian Rasmusson 2016-10-01 23:19:08 +02:00
  • ae4c13ce6d don't try to use mem in Images::downloadImages if it cannot be reserved Brian Rasmusson 2016-10-01 23:14:48 +02:00
  • 85d2d489c0 don't try to use mem in ImportState::importLoop (PageInject.cpp) if it cannot be reserved Brian Rasmusson 2016-10-01 23:12:37 +02:00
  • 208a9dfda2 don't try to use mem in gotCrawlInfoReply (SpiderLoop.cpp) if it cannot be reserved Brian Rasmusson 2016-10-01 23:09:21 +02:00