Forks/privacore-open-source-search-engine
1
0
Fork 0
forked from Mirrors/privacore-open-source-search-engine
Code Pull Requests Activity

Commit Graph

  • f4baff1456 Remove quickpoll from Msg5 Ai Lin Chia 2016-12-15 11:40:39 +01:00
  • ce2b9c6834 Add complex redirection unit test. Cater for expiration of cookie in redirection flow Ai Lin Chia 2016-12-14 16:47:07 +01:00
  • 1ed7f50767 Add cookieJar functionality to cater for more complicated cookie redirection scenarios (eg: multi domain redirection) Ai Lin Chia 2016-12-14 15:13:51 +01:00
  • 91494c1d0d Add constness Ai Lin Chia 2016-12-14 15:11:10 +01:00
  • 9d56b112a4 Rename cookie to cookieJar Ai Lin Chia 2016-12-14 11:11:45 +01:00
  • 241d4568a3 bugfix repair: #if condition for safe version was reversed Ivan Skytte Jørgensen 2016-12-14 13:11:38 +01:00
  • 6f2dae936a fixed Ivan's repair fix so you can rebuild in non-safe mode again Brian Rasmusson 2016-12-14 12:25:46 +01:00
  • 515c6d23c2 Remove commented out code Ai Lin Chia 2016-12-14 10:57:43 +01:00
  • 812277644b Fix compilation error Ai Lin Chia 2016-12-13 12:10:48 +01:00
  • 03d30090b9 Remove unused TYPE_RETRIES, TYPE_CONSTANT, TYPE_SITERULE Ai Lin Chia 2016-12-13 11:50:08 +01:00
  • bc5b6f0bb0 Remove now unused printCheckBoxes Ai Lin Chia 2016-12-13 11:45:01 +01:00
  • f28be5215c Remove unused TYPE_BOOL2 from Parms Ai Lin Chia 2016-12-13 11:44:12 +01:00
  • cb2353ee67 Remove unused TYPE_UFP from Parms Ai Lin Chia 2016-12-13 11:40:33 +01:00
  • 68f9414eb2 Remove unused TYPE_RULESET & TYPE_FILTER Ai Lin Chia 2016-12-13 11:39:07 +01:00
  • 182519b51a Remove commented out code Ai Lin Chia 2016-12-13 11:37:34 +01:00
  • 9784e627c3 Remove unused TYPE_MONOD2 & TYPE_MONOM2 from Parms Ai Lin Chia 2016-12-13 11:31:52 +01:00
  • c822fb12a9 Remove unused TYPE_PRIORITY_BOXES from Parms Ai Lin Chia 2016-12-13 11:27:48 +01:00
  • a404a79cf7 Add comments about TYPE_DATE removal Ai Lin Chia 2016-12-13 11:19:15 +01:00
  • e035d169bf Remove unused TYPE_DATE & TYPE_DATE2 from Parms Ai Lin Chia 2016-12-13 11:15:30 +01:00
  • c211700f18 Add constness Ai Lin Chia 2016-12-13 11:04:52 +01:00
  • 328c5a1bcc Remove commented out code Ai Lin Chia 2016-12-13 11:03:11 +01:00
  • 9156968b18 Add constness Ai Lin Chia 2016-12-13 10:59:48 +01:00
  • 736c2709b9 Code style changes Ai Lin Chia 2016-12-13 10:59:02 +01:00
  • 0e8658e5b4 Move endsWith function to fctypes.h Ai Lin Chia 2016-12-13 10:58:35 +01:00
  • aaf7244b3b Remove commented out code Ai Lin Chia 2016-12-13 10:57:44 +01:00
  • 00b0973e65 Fix copy & paste error. We allocate with RdbIndex but free with RdbMap Ai Lin Chia 2016-12-12 14:09:31 +01:00
  • b23c1ec9a6 Merge branch 'master' into nomerge2 Ai Lin Chia 2016-12-14 10:56:44 +01:00
  • 52a5f832b6 Reduce the amount of memory used in RdbIndex Ai Lin Chia 2016-12-14 10:56:16 +01:00
  • c54c7e7fb6 #include cloeanup of Repair Ivan Skytte Jørgensen 2016-12-12 17:13:13 +01:00
  • f12fb17aab Removed 21 write-only members from Repai Ivan Skytte Jørgensen 2016-12-12 17:12:39 +01:00
  • 0b981d29cc #include cleanup of Repair.h Ivan Skytte Jørgensen 2016-12-12 16:55:51 +01:00
  • 25bbfb9a9e Removed unused Repair::m_msg4 Ivan Skytte Jørgensen 2016-12-12 16:52:12 +01:00
  • 34c3724118 Better encapsulation of Repair Ivan Skytte Jørgensen 2016-12-12 16:50:40 +01:00
  • fdf63a1be6 Use correct type_long_long for int64_t Conf::m_repairMem Ivan Skytte Jørgensen 2016-12-12 15:57:22 +01:00
  • e7124a1fd7 Support single-host rebuild/repair Ivan Skytte Jørgensen 2016-12-12 15:53:05 +01:00
  • fc39086efc Renamed Conf::m_maxRepairSpiders to m_maxRepairinjections Ivan Skytte Jørgensen 2016-12-12 15:05:52 +01:00
  • 84cdcf4e74 use symbolic constant instead of hardcoded value for max collections to rebuild at a time Ivan Skytte Jørgensen 2016-12-12 14:50:52 +01:00
  • 4d3315f745 de-commented Conf::m_collsToRepair to support multiple collections. Ivan Skytte Jørgensen 2016-12-12 14:46:28 +01:00
  • 9bd0a8f171 Merge branch 'nomerge2' of github.com:privacore/open-source-search-engine into nomerge2 Ivan Skytte Jørgensen 2016-12-12 14:05:03 +01:00
  • fcb874d022 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-12-12 14:04:46 +01:00
  • ed41203dc5 3include cleanup in Mem.h Ivan Skytte Jørgensen 2016-12-12 14:03:43 +01:00
  • c8e9ef86f7 goto-loop -> for-loop Ivan Skytte Jørgensen 2016-12-12 13:58:14 +01:00
  • f6c2aa817c when dumping titledb and findign corruption: log the docid in question Ivan Skytte Jørgensen 2016-12-12 13:55:06 +01:00
  • ab8883be8c Merge branch 'master' into nomerge2 Ai Lin Chia 2016-12-12 12:13:09 +01:00
  • 1dfce03399 Change out of memory log to error log Ai Lin Chia 2016-12-12 12:11:04 +01:00
  • 3b57798f5c Add specials block as unwanted utf8 character Ai Lin Chia 2016-12-12 10:52:28 +01:00
  • 3f87557a1a Fix compilation error Ai Lin Chia 2016-12-08 17:33:42 +01:00
  • b4c3de9baf Add newline at end of file Ai Lin Chia 2016-12-08 16:43:55 +01:00
  • 6c6622a61f We don't have any date json field anymore Ai Lin Chia 2016-12-08 16:09:14 +01:00
  • 7bc8acfd3d more const Ivan Skytte Jørgensen 2016-12-08 17:06:03 +01:00
  • f77c24db91 #include clean up HashTableT.h Ivan Skytte Jørgensen 2016-12-08 17:04:38 +01:00
  • e65b1e621d #include clean up HashTable.h Ivan Skytte Jørgensen 2016-12-08 16:58:56 +01:00
  • bdd8cb5338 #include clean up Query.h Ivan Skytte Jørgensen 2016-12-08 16:56:09 +01:00
  • ebc295f18a #include cleanup in HttpRequest.h Ivan Skytte Jørgensen 2016-12-08 16:41:38 +01:00
  • 181e111715 Removed unused mstrdup() Ivan Skytte Jørgensen 2016-12-08 16:37:17 +01:00
  • 8dd0036b8b nul-terminate temporary buffer in Url:.set() Ivan Skytte Jørgensen 2016-12-08 15:47:50 +01:00
  • ec516df857 Removed nul-termination-hack from Url::set() Ivan Skytte Jørgensen 2016-12-08 15:44:57 +01:00
  • 3b9612b329 Factor out web statistics page detection in linkspam detection functions Ivan Skytte Jørgensen 2016-12-07 19:45:41 +01:00
  • 38718f4015 Factor out guestbook/comment path check in linkspam detection functions Ivan Skytte Jørgensen 2016-12-07 19:37:20 +01:00
  • e73f8c0f31 Fix 2 digit year date parsing. 26-Nov-17 should not be intepreted as 26-Nov-1917 but 26-Nov-2017 Ai Lin Chia 2016-12-07 10:40:01 +01:00
  • ad0270b5d2 const on hostdb::getShardNumXxxx() Ivan Skytte Jørgensen 2016-12-06 13:52:34 +01:00
  • f76c7ec72f More constness in msg22 Ivan Skytte Jørgensen 2016-12-06 13:29:34 +01:00
  • f3454dd0c6 Simplify Titledb::getProbableDocId(Url*) Ivan Skytte Jørgensen 2016-12-06 13:19:25 +01:00
  • 094427a012 removed 'mask' default paramter to Titledb::getProbableDocId() Ivan Skytte Jørgensen 2016-12-06 13:16:31 +01:00
  • e251e3630d Merge branch 'master' of github.com:privacore/open-source-search-engine Ivan Skytte Jørgensen 2016-12-06 11:13:42 +01:00
  • 81226f8681 Align code in setLinkSpam() and isLinkSpam() Ivan Skytte Jørgensen 2016-12-06 11:13:04 +01:00
  • 0ef316e854 Changed Links::setAllSpamBits() into avoid method Ivan Skytte Jørgensen 2016-12-02 17:31:26 +01:00
  • 4a92c0c621 Fix valgrind uninitialized jump when build status log is enabled Ai Lin Chia 2016-12-02 17:11:24 +01:00
  • b35c764d47 Use strptime + timegm instead of atotime (gb internal method) Ai Lin Chia 2016-12-02 16:32:39 +01:00
  • fe3ae7f6e3 Add config for trace log for HttpMime Ai Lin Chia 2016-12-02 16:31:16 +01:00
  • ab998330cb Add constness Ai Lin Chia 2016-12-02 16:30:18 +01:00
  • 46bee9d52c Code style changes Ai Lin Chia 2016-12-02 16:29:31 +01:00
  • 3ebc1042bd Remove commented out code Ai Lin Chia 2016-12-02 16:28:59 +01:00
  • 6e034af617 Remove unused config m_spiderTimeMin & m_spiderTimeMax Ai Lin Chia 2016-12-02 16:22:48 +01:00
  • ad53218c89 Modify "ask for gzipped docs when downloading" to default to true. Ai Lin Chia 2016-12-02 15:49:23 +01:00
  • 5975945911 Removed commented-out signal handlers for SIGSEGV/SIGILL/SIGFPE/SIGBUS Ivan Skytte Jørgensen 2016-12-02 16:07:45 +01:00
  • 2cf9b5956b Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-12-02 15:21:34 +01:00
  • 3037ee7b05 Fixed indentation and formatting of g_map_xxx tables. Ivan Skytte Jørgensen 2016-12-02 15:17:14 +01:00
  • 8e5120156e Use explicit sizes of g_map_xxx for character lookup and conversion tables. Ivan Skytte Jørgensen 2016-12-02 14:56:40 +01:00
  • f97edaa438 Slightly better log in TcpServer Ivan Skytte Jørgensen 2016-12-02 14:07:44 +01:00
  • d2a51dce05 Change debug level log to warning level as it should be Ai Lin Chia 2016-12-02 12:33:59 +01:00
  • 36590fbbde Remove write only m_lastModifiedDate Ai Lin Chia 2016-12-02 11:31:09 +01:00
  • 4ce53515bc Code style changes Ai Lin Chia 2016-12-02 11:30:27 +01:00
  • 45345bbb64 Removed commented-out code, obsolete and unhelpful comments from HttpServer.cpp Ivan Skytte Jørgensen 2016-12-01 18:01:24 +01:00
  • 6328ef4af5 Removed incorrect comments Ivan Skytte Jørgensen 2016-12-01 17:47:08 +01:00
  • 97ec4fcd13 char ->bool/int Ivan Skytte Jørgensen 2016-12-01 17:33:10 +01:00
  • c5cdedffdb TcpSocket: #include cleanup, constness, removal of commmented-out code Ivan Skytte Jørgensen 2016-12-01 17:28:42 +01:00
  • ae98efc504 Removed write-only member TcpSocket::m_prefLevel Ivan Skytte Jørgensen 2016-12-01 17:25:05 +01:00
  • 9e900f68dd Removed write-only member TcpSocket::m_shutdownStart Ivan Skytte Jørgensen 2016-12-01 17:04:49 +01:00
  • df59a3db39 Changed tcp socket states from #defines into an enum Ivan Skytte Jørgensen 2016-12-01 17:01:18 +01:00
  • df4885210f Removed write-only member TcpSocket::m_tmp Ivan Skytte Jørgensen 2016-12-01 16:57:03 +01:00
  • 5b5e164ff5 Turned goto-loop into regular loop in TcpServer::readSocket() Ivan Skytte Jørgensen 2016-12-01 16:44:00 +01:00
  • ba3a11afef Remvoed got from TcpServer::init() Ivan Skytte Jørgensen 2016-12-01 16:35:23 +01:00
  • 15adeb1251 remoed more gotos Ivan Skytte Jørgensen 2016-12-01 16:28:40 +01:00
  • 4ceb8c67ba Remove more EINTR goto-retry Ivan Skytte Jørgensen 2016-12-01 16:02:33 +01:00
  • f369b80902 Removed unnecessary EINTR goto-retry Ivan Skytte Jørgensen 2016-12-01 15:55:06 +01:00
  • 945e1a35a9 Use clearer boolean expressions Ivan Skytte Jørgensen 2016-12-01 15:46:04 +01:00
  • ae7dae3124 Moved <base> handling logic to Url::calculateBaseUrl() Ivan Skytte Jørgensen 2016-12-01 12:48:32 +01:00
  • 888b461cd3 Added a comment about appending a slahs to bas href is not always correct Ivan Skytte Jørgensen 2016-12-01 12:16:14 +01:00
  • d053632c01 Use const Xml::getString() Ivan Skytte Jørgensen 2016-12-01 12:15:52 +01:00