Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity

Commit Graph

  • ea0714743c Remove commented out code & whitespace changes Ai Lin Chia 2017-04-07 12:06:18 +02:00
  • c3de1a9151 Removed Conf::m_giveupOnDeadHosts Ivan Skytte Jørgensen 2017-04-07 15:54:19 +02:00
  • adc254e69b slot->m_host can apparently be NULL in some cases ? Ivan Skytte Jørgensen 2017-04-07 15:33:48 +02:00
  • 4f92c2b085 Document message types Ivan Skytte Jørgensen 2017-04-07 15:30:16 +02:00
  • 31265e7fc7 Simplification and style change in Multicast::gotReply2() Ivan Skytte Jørgensen 2017-04-07 14:57:01 +02:00
  • 15409077d9 const Ivan Skytte Jørgensen 2017-04-07 14:37:19 +02:00
  • d541c679cd goto -> for() Ivan Skytte Jørgensen 2017-04-07 14:20:52 +02:00
  • 66c45db9c0 Remoed unused UdpServer::printState() and UdpSlot::printState() Ivan Skytte Jørgensen 2017-04-07 13:03:36 +02:00
  • f0f9c2364a Time out slots toward dead hosts Ivan Skytte Jørgensen 2017-04-07 12:30:57 +02:00
  • 1fd57fc971 Remove unused UrlLock variable Ai Lin Chia 2017-04-07 11:45:23 +02:00
  • b296dfca88 Remove always true UrlLock::m_confirmed Ai Lin Chia 2017-04-07 11:38:15 +02:00
  • 7b176c345a Remove some unused UrlLock variable Ai Lin Chia 2017-04-07 11:36:49 +02:00
  • 2dc5b02cc6 Remove unused printLockTable Ai Lin Chia 2017-04-07 11:27:57 +02:00
  • edc79e8b32 Remove UrlLock::m_expires as it's not used Ai Lin Chia 2017-04-07 11:25:47 +02:00
  • 0b90bf67c8 Don't update lock only to remove it right after Ai Lin Chia 2017-04-07 11:00:58 +02:00
  • 7f44c67b0f Remove non-working urlfilter criteria domainpages & domainadds. Remove unused urlfilter criteria siteadds. Ai Lin Chia 2017-04-06 23:11:06 +02:00
  • 6794516f75 Remove shallow url filters that are not selectable from UI Ai Lin Chia 2017-04-06 20:50:24 +02:00
  • 4c56414601 Remove now unused g_corruptCount Ai Lin Chia 2017-04-06 19:48:36 +02:00
  • c659f5ee8b Remove unused DirIterator Ai Lin Chia 2017-04-06 19:45:27 +02:00
  • b8318c094e Remove always 0 parameter to addToWaitingTree Ai Lin Chia 2017-04-06 16:35:38 +02:00
  • 09adb5e173 Only call populateWaitingTreeFromSpiderdb when m_waitingTreeNeedsRebuild is true Ai Lin Chia 2017-04-06 15:52:17 +02:00
  • 9e7a6a66e4 Modify maxTreeMem for linkdb for test compilation Ai Lin Chia 2017-04-06 15:09:32 +02:00
  • 7c3d7b6375 Remove commented out code Ai Lin Chia 2017-04-06 14:54:31 +02:00
  • 766facf75d Remove blaster/blasterdiff command that seems to be processing gb output log and injecting url. We should do that outside of gb and use the admin/inject interface if needed. Ai Lin Chia 2017-04-06 14:49:23 +02:00
  • 00d91dc2e3 Removed dead-host (defunct) functionality in PingServer Ivan Skytte Jørgensen 2017-04-06 17:21:42 +02:00
  • a57aa86bb6 Send watchdog messge to hosts we haven't interacted with recently. Ivan Skytte Jørgensen 2017-04-06 17:18:56 +02:00
  • 813c4e2350 Remove now unused Timezone.cpp Ai Lin Chia 2017-04-06 14:37:27 +02:00
  • 3de8568997 Remove commented out code Ai Lin Chia 2017-04-06 14:30:12 +02:00
  • fbc19edfe3 Remove unused functions Ai Lin Chia 2017-04-06 14:27:47 +02:00
  • b27ac02f3a Replace SPIDERDBKEY define with typdef spiderdbkey_t Ai Lin Chia 2017-04-06 13:49:58 +02:00
  • d24fa078eb Remvoed 'discard' paramter to UdpSlot::readDatagramOrAck() Ivan Skytte Jørgensen 2017-04-06 14:39:19 +02:00
  • 969cce3b75 Make m_rdb private Ai Lin Chia 2017-04-06 13:45:51 +02:00
  • f38d175440 Code style changes Ai Lin Chia 2017-04-06 13:45:39 +02:00
  • 41c300b845 Remove commented out code Ai Lin Chia 2017-04-06 13:45:22 +02:00
  • 4ab8984b31 Remove unused Spiderdb::verify method Ai Lin Chia 2017-04-06 13:45:04 +02:00
  • 136bb7459c Remove unused Tagdb::verify method Ai Lin Chia 2017-04-06 13:44:40 +02:00
  • 9f115c4054 Remove unused Linkdb::verify method Ai Lin Chia 2017-04-06 13:44:11 +02:00
  • 5c6f9855c7 Remove unused Clusterdb::verify method Ai Lin Chia 2017-04-06 13:43:51 +02:00
  • 6496b8a4d0 Remove unused Posdb methods Ai Lin Chia 2017-04-06 13:39:30 +02:00
  • 11bd3ea372 Change error log from debug to warning level. Remove g_corruptCount as it is only used to supress one log message, but 3 different places are incrementing it. We'll just log it for every occurance now. Ai Lin Chia 2017-04-06 12:53:40 +02:00
  • 701d17a132 Remove always true flag Ai Lin Chia 2017-04-06 12:46:22 +02:00
  • 2d6686ba79 Remove unused variable. Make methods/variables private where possible Ai Lin Chia 2017-04-06 12:37:13 +02:00
  • e6c94fa0a9 Simplify return statement Ai Lin Chia 2017-04-06 12:36:42 +02:00
  • 122f99f680 Fix pinginfo resends and etryagains Ivan Skytte Jørgensen 2017-04-06 12:09:29 +02:00
  • f1fc4767a5 We never have doledb dat files anymore Ai Lin Chia 2017-04-06 12:01:53 +02:00
  • 28beaad0a6 Remove write only variable Ai Lin Chia 2017-04-06 11:51:33 +02:00
  • b32084b347 Remove commented out code Ai Lin Chia 2017-04-06 11:51:24 +02:00
  • 5043a1a22e Make static function part of SpiderLoop class Ai Lin Chia 2017-04-06 11:50:57 +02:00
  • a918a0aee2 Remove unused SpiderColl variable. Make more SpiderColl member private Ai Lin Chia 2017-04-06 11:05:19 +02:00
  • 9b410a269b Fix unit test compilation & run Ai Lin Chia 2017-04-05 22:49:50 +02:00
  • a39aaa6b08 Use emplace_back instead of push_back to avoid copying of object Ai Lin Chia 2017-04-05 22:48:17 +02:00
  • abf8223b55 Fix a bug introduced in ed203f7f7f where the wrong variable is passed as state causing wrong pointer to be deleted on callback Ai Lin Chia 2017-04-05 16:54:13 +02:00
  • ff41e87ad0 Remove unused score8to32 & score32to8 function Ai Lin Chia 2017-04-05 16:26:21 +02:00
  • 8ae62f5e22 Move SpiderCache to separate file. Move spider page related code to PageSpider.cpp Ai Lin Chia 2017-04-05 16:13:51 +02:00
  • eee0aeaa91 Replace comma with semicolon (no logic difference, but looks like a typo anyway). Ai Lin Chia 2017-04-05 15:43:37 +02:00
  • 5ecebfd41d Add more locks/lock verification to RdbBuckets & append all unlocked methods with _unlocked Rename RdbBuckets::getListSize to RdbBuckets::estimateListSize Modify RdbBuckets::addNode to return boolean Ai Lin Chia 2017-04-05 15:11:50 +02:00
  • ccc738df65 Remove private function calls with direct variable access Ai Lin Chia 2017-04-05 14:37:03 +02:00
  • cfad354dd4 Code style changes Ai Lin Chia 2017-04-05 14:29:23 +02:00
  • 3c63793dbe Code style changes Ai Lin Chia 2017-04-05 14:26:54 +02:00
  • f43667c30a Remove script directory. Loops to be ia specific code Ai Lin Chia 2017-04-05 13:54:28 +02:00
  • 2cdb2c57a7 Remove injectme files Ai Lin Chia 2017-04-05 13:51:12 +02:00
  • 9f41463014 Move declaration around so methods dealing with isWritable bool are grouped together Ai Lin Chia 2017-04-05 12:38:19 +02:00
  • afa39b53d9 We should always save with the dbname set in RdbTree::set. Ai Lin Chia 2017-04-05 12:37:00 +02:00
  • b3f8fc889c Revert "Remove unused function" This is used on nomerge2 branch Ai Lin Chia 2017-04-05 12:01:49 +02:00
  • 66b385b8d7 Don't add to spiderdb when we're nospider host Ai Lin Chia 2017-04-05 11:38:22 +02:00
  • b9331cc589 Remove commented out code Ai Lin Chia 2017-04-05 11:35:20 +02:00
  • 3dbfdf365f Rename SpiderLoop::startLoop to SpiderLoop::init Ai Lin Chia 2017-04-05 11:35:04 +02:00
  • c07a88888b Move variable declaration closer to use Ai Lin Chia 2017-04-05 11:25:01 +02:00
  • a26c828896 Only call updateLastResponseReceiveTimestamp when host is not NULL Ai Lin Chia 2017-04-05 10:55:43 +02:00
  • a5e52ba0a8 Remove unused input argument Ai Lin Chia 2017-04-05 10:40:12 +02:00
  • a35d266d04 Remove unused function Ai Lin Chia 2017-04-05 10:39:37 +02:00
  • 120c9ea6d5 Remove commented out code Ai Lin Chia 2017-04-05 10:39:11 +02:00
  • 7053215990 'dgrams resent' and 'try agains recvd' colum headers were swapped Ivan Skytte Jørgensen 2017-04-04 17:07:33 +02:00
  • 524cd5ad85 Remove now unused Msg1 Ai Lin Chia 2017-04-04 16:22:54 +02:00
  • f7e6b05594 Replace use of Msg1 with Msg4 Ai Lin Chia 2017-04-04 16:19:04 +02:00
  • 8273ca1415 Remove commented out code Ai Lin Chia 2017-04-04 16:13:21 +02:00
  • 2292eaf897 Use Url class to normalize url before calling sitegetter Ai Lin Chia 2017-04-04 16:11:17 +02:00
  • 681fa4c0ce Make some Tagdb function static and use Tagdb:: instead of g_tagdb Ai Lin Chia 2017-04-04 16:10:14 +02:00
  • 299a021ad8 Add TDF_DEPRECATED & don't print on UI if it's not selected & it's deprecated. Remove comment from being deprecated Ai Lin Chia 2017-04-04 14:40:33 +02:00
  • 900588ef34 Completely remove Msg8a cache for now Ai Lin Chia 2017-04-04 14:39:29 +02:00
  • c79e72580a Preprocess incoming Msg4 to RdbItem Ai Lin Chia 2017-04-04 14:36:44 +02:00
  • 2af07f2786 Keep track request and response times per host Ivan Skytte Jørgensen 2017-04-04 14:28:38 +02:00
  • bb77977abe Removed obsolete and inaccurate comments in UdpServer::doSending() Ivan Skytte Jørgensen 2017-04-04 14:27:39 +02:00
  • e2ef4acb9b Removed obsolete comments in UdpSlot::getScore() Ivan Skytte Jørgensen 2017-04-04 14:09:13 +02:00
  • 217385db86 Simplified UdpSlot::getScore() a bit Ivan Skytte Jørgensen 2017-04-04 14:06:14 +02:00
  • 20b528c42e send the last 50 lines of log to slacktee instead of 100 (we don't seem to be printing the full 100 lines on slack) Ai Lin Chia 2017-04-04 13:44:17 +02:00
  • 683dcd6de4 Remove unused friend Ai Lin Chia 2017-04-04 10:37:12 +02:00
  • 62d53e4b05 Remove unused getRdbBase Ai Lin Chia 2017-04-04 10:37:03 +02:00
  • 2aedc50da4 Remove unused XmlDoc::getTitleRecKey Ai Lin Chia 2017-04-03 22:34:47 +02:00
  • 3a56f38812 Remove unused variable from Collectiondb.h Ai Lin Chia 2017-04-03 22:33:53 +02:00
  • f60cf303cb Remove unused include file Ai Lin Chia 2017-04-03 21:04:05 +02:00
  • 6f1d2f5c2c Rename m_inDumpLoop to m_isDumping Ai Lin Chia 2017-04-03 21:03:51 +02:00
  • b4a296fc5c Don't need to check Rdb::isInDumpLoop because it's already checked in Rdb::dumpTree Ai Lin Chia 2017-04-03 21:02:24 +02:00
  • 110b70b1eb Remove now unused m_rdb from RdbMem Ai Lin Chia 2017-04-03 17:48:02 +02:00
  • 377473d941 We're never allocating data during a dump anymore Ai Lin Chia 2017-04-03 17:45:50 +02:00
  • 990373e4b5 Remove now unused m_isDumping flag from RdbDump Ai Lin Chia 2017-04-03 17:31:34 +02:00
  • e7f457f752 Remove unused RdbBase::specialInjectFileInit Ai Lin Chia 2017-04-03 17:26:15 +02:00
  • aec151ed05 Remove unused RdbBase::getPercentNegativeRecsOnDisk Ai Lin Chia 2017-04-03 17:25:19 +02:00
  • 15d1793155 Remove now unused RdbBase::closeIndexes & RdbBase::closeMaps Ai Lin Chia 2017-04-03 17:23:43 +02:00
  • f719983c38 Remove now unused RdbDump from RdbBase Ai Lin Chia 2017-04-03 17:22:30 +02:00