Commit Graph

  • 23a9552d67 #include cleanup of Dns.* Ivan Skytte Jørgensen 2016-11-12 19:37:58 +01:00
  • 2e63833020 Moved internal #defines to Dns.cpp Ivan Skytte Jørgensen 2016-11-12 19:34:27 +01:00
  • 92d2ae6fc7 Removed DnsState::m_cacheNotFounds which was always true Ivan Skytte Jørgensen 2016-11-12 17:11:52 +01:00
  • d28a6f8a0c Removed always-true cacheNotFounds parameter from Dns::getIp() Ivan Skytte Jørgensen 2016-11-12 17:11:03 +01:00
  • aad6c618fe Moved implementation details in Dns out of header file Ivan Skytte Jørgensen 2016-11-12 17:08:38 +01:00
  • 376abb8e89 Better encapsulation of Dns Ivan Skytte Jørgensen 2016-11-12 16:51:54 +01:00
  • efc38568c6 constness in PageSockets.cpp Ivan Skytte Jørgensen 2016-11-12 16:44:07 +01:00
  • ffebe91286 Don't optimize out of a single malloc() in http-proxy state Ivan Skytte Jørgensen 2016-11-11 17:47:26 +01:00
  • 5144a69781 Make test fail (bug with ellipsis in existing code that happens in corner cases) & disable them. Ai Lin Chia 2016-11-11 16:48:25 +01:00
  • 8c9dac486b Add more logs & logTraceSummary Ai Lin Chia 2016-11-11 16:40:39 +01:00
  • 1aee61ce48 #include clenaup Ivan Skytte Jørgensen 2016-11-11 16:35:37 +01:00
  • e8b4ba277d Fix bug in adding horizontal ellipsis Ai Lin Chia 2016-11-11 16:32:11 +01:00
  • 2788f518c4 #include cleanup in Msg13.* Ivan Skytte Jørgensen 2016-11-11 15:51:30 +01:00
  • 52a05d9282 #include cleanup in Doledb.* Ivan Skytte Jørgensen 2016-11-11 15:45:39 +01:00
  • 120947ed5e Minor #include cleanup Ivan Skytte Jørgensen 2016-11-11 15:35:48 +01:00
  • f30bc53c9f Align misc/parse_iana_charsets.pl with modified iana_charset.* Ivan Skytte Jørgensen 2016-11-11 15:31:17 +01:00
  • dc064e8d1d Rename len to input_len Ai Lin Chia 2016-11-11 13:59:03 +01:00
  • 0c87a19507 Reduce minRemoveEllipsisLen. Do we even need this length? Ai Lin Chia 2016-11-11 13:57:47 +01:00
  • 6f844b7ed0 Add trace logs for Pos.cpp Ai Lin Chia 2016-11-11 13:51:55 +01:00
  • 33f7b637bc Use const_cast Ai Lin Chia 2016-11-11 13:45:35 +01:00
  • b77d46c67a Merge travisci_build_coverity_scan.sh into runCoverityAnalysis.sh Ai Lin Chia 2016-11-11 12:59:26 +01:00
  • 1bd47eb67b Bugfix shutdown (one thread pool wasn't notified properly) Ivan Skytte Jørgensen 2016-11-11 13:15:14 +01:00
  • 258d4c8728 #include cleanup in Lang.h Ivan Skytte Jørgensen 2016-11-11 13:05:03 +01:00
  • da5055282a zero out crazy local spider stats. corrupted from saving after memory got corrupted. Matt Wells 2015-12-17 09:43:41 -08:00
  • bdf6c6b4f0 Let's try with coverity project name url encoded Ai Lin Chia 2016-11-11 11:08:38 +01:00
  • dc43d8608c #include cleanup of Spider.* Ivan Skytte Jørgensen 2016-11-10 17:02:03 +01:00
  • 9826035947 #include cleanup of Posdb.* Ivan Skytte Jørgensen 2016-11-10 16:56:37 +01:00
  • 41a7ae92bd Added useful comment Ivan Skytte Jørgensen 2016-11-10 16:53:18 +01:00
  • fa3ad3da3e Check m_fstate.m_errno on error as well. This is to avoid coredump when "Read canceled due to JobScheduler exit type 1" Ai Lin Chia 2016-11-10 15:10:31 +01:00
  • b78e972301 Use hostId for mergedir instead of shardId Ai Lin Chia 2016-11-10 13:36:49 +01:00
  • e32919794a Separate job queue for file rename/unlink Ivan Skytte Jørgensen 2016-11-10 14:47:34 +01:00
  • 323602f314 Dropped thread_type_unlink enum element Ivan Skytte Jørgensen 2016-11-10 14:38:24 +01:00
  • 0430d94078 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-10 14:22:42 +01:00
  • ae47155cba #include cleanup of PosdbTable.h Ivan Skytte Jørgensen 2016-11-10 14:22:29 +01:00
  • 7980bea3f6 Don't attempt to relabel NULL Ivan Skytte Jørgensen 2016-11-10 14:13:14 +01:00
  • a810c62698 postpone local variable decl until needed Ivan Skytte Jørgensen 2016-11-10 14:08:42 +01:00
  • bf3ea9ece9 Renamed Msg3a::m_r to m_req39 Ivan Skytte Jørgensen 2016-11-10 14:06:08 +01:00
  • bb86d94de0 bugfix a05d260202 Ivan Skytte Jørgensen 2016-11-10 13:59:19 +01:00
  • 1a0175f108 Merge branch 'master' of github.com:privacore/open-source-search-engine Ivan Skytte Jørgensen 2016-11-10 12:26:36 +01:00
  • 16cb1a5884 added config option for word spam detection trace log Brian Rasmusson 2016-11-09 14:51:43 +01:00
  • 7c7c4b9965 Disable defective repetitive word check in word spam detection code Brian Rasmusson 2016-11-09 14:51:02 +01:00
  • 9473cedaed added config option for word spam detection trace log Brian Rasmusson 2016-11-09 14:48:30 +01:00
  • c437c54d06 Do not insert lost links anymore in linkdb & cleanup existing linkdb records Ai Lin Chia 2016-11-08 16:49:04 +01:00
  • 2d207d8a62 Merge branch 'master' of github.com:privacore/open-source-search-engine Ivan Skytte Jørgensen 2016-11-08 16:41:42 +01:00
  • 3a1a18d03a Don't check for unique docids in Msg3a::mergeLists() Ivan Skytte Jørgensen 2016-11-08 16:40:03 +01:00
  • 4fa7f311fa hanged goto-loop into plain do-while loop Ivan Skytte Jørgensen 2016-11-08 16:33:27 +01:00
  • 9faff3471d Remove commented out code Ai Lin Chia 2016-11-08 15:59:13 +01:00
  • 45c5f0c0d0 Add coverity scan to travis Ai Lin Chia 2016-11-08 15:47:51 +01:00
  • c0ad426ff5 Change log from debug to warning Ai Lin Chia 2016-11-08 14:19:13 +01:00
  • aa7bd74a41 Don't leave '00000 backlinks' in search results if document score info is missing/disabled Ivan Skytte Jørgensen 2016-11-08 15:39:11 +01:00
  • a05d260202 Changed prototypes for genDebugScoreInfo1:genDebugScoreInfo2 Ivan Skytte Jørgensen 2016-11-08 14:26:10 +01:00
  • 6aed99c406 Use memcpy() instead of gbmemcpy() where appropriate Ivan Skytte Jørgensen 2016-11-08 12:43:26 +01:00
  • 3c162c2fe3 Modify gitignore to ignore more files Ai Lin Chia 2016-11-08 12:33:48 +01:00
  • cda2405258 Remove extra semicolon Ai Lin Chia 2016-11-08 12:18:22 +01:00
  • 7af4e91073 Add unit test for update global index Ai Lin Chia 2016-11-08 12:17:59 +01:00
  • 66a80a6343 Add various methods to update global index Ai Lin Chia 2016-11-07 16:03:17 +01:00
  • 3fbb352245 Use RdbIndex for checking if document existence/location Ivan Skytte Jørgensen 2016-11-08 12:14:32 +01:00
  • 9cc06aa7c2 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-08 11:08:09 +01:00
  • cd3ad7e641 #include cleanup Ivan Skytte Jørgensen 2016-11-08 11:07:47 +01:00
  • 4e5c6cccf2 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-07 16:47:36 +01:00
  • 79255e16bc Moved locally-used intersection phase enum to source file instead of header file Ivan Skytte Jørgensen 2016-11-07 16:33:55 +01:00
  • b15f629ab7 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-07 16:01:57 +01:00
  • 504845bc9b Remved default values for parametres to Rdb::init() Ivan Skytte Jørgensen 2016-11-07 16:01:28 +01:00
  • 6db24d7ee5 Prepare for using rdb indexes Ivan Skytte Jørgensen 2016-11-07 15:48:14 +01:00
  • 02d9273878 Add RdbIndexQuery::documentIsInFile method Ai Lin Chia 2016-11-07 15:35:08 +01:00
  • 50fd62bf8f Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-07 14:40:14 +01:00
  • 5249f14d42 Encapsulate SafeBuf more Ivan Skytte Jørgensen 2016-11-07 14:38:43 +01:00
  • 96d700a3c7 Encapsualte SafeBuf more Ivan Skytte Jørgensen 2016-11-07 14:31:54 +01:00
  • 598b58ef5f Stop HttpRequest::copy form poking aroudn in safebuf directly Ivan Skytte Jørgensen 2016-11-07 14:27:47 +01:00
  • 9e8fc9c785 Use plain copy instead of stealBuf() in searchinput Ivan Skytte Jørgensen 2016-11-07 14:02:27 +01:00
  • 34c197e300 Use do/while wrapper around macro Ai Lin Chia 2016-11-07 14:20:47 +01:00
  • 476f52e0fc Only run with cron now Ai Lin Chia 2016-11-07 14:04:55 +01:00
  • 469feee21f Try to trigger analysis on all build for test Ai Lin Chia 2016-11-07 13:45:30 +01:00
  • 209b8d5f12 Removed 'encoding' parameter to SafeBuf:.setBuf() Ivan Skytte Jørgensen 2016-11-07 12:55:37 +01:00
  • 071d0d2657 Removed SafeBuf::m_encoding (it was ever only set to csUTF8) Ivan Skytte Jørgensen 2016-11-07 12:53:25 +01:00
  • 6062e5a590 Removed unused SafeBuf::m_renderHtml Ivan Skytte Jørgensen 2016-11-07 12:36:12 +01:00
  • 16692eb966 Fix travis yml if/else statements Ai Lin Chia 2016-11-07 12:53:03 +01:00
  • 61c43ee8c3 Only run sonarqube analysis in cron. Disable clang compiler in travis for now Ai Lin Chia 2016-11-07 12:27:35 +01:00
  • 0959812162 Let PageResults use printTimeAgo() in GbUtil.cpp (and also print full month name) Ivan Skytte Jørgensen 2016-11-07 12:27:11 +01:00
  • 06e886f4b7 make types match in calculation (no change really) Ivan Skytte Jørgensen 2016-11-07 12:26:46 +01:00
  • 00015a6f66 Add output directory for sonarqube build-wrapper Ai Lin Chia 2016-11-07 12:22:18 +01:00
  • f7e34ec55c Get build-wrapper for running sonarqube analysis Ai Lin Chia 2016-11-07 12:16:54 +01:00
  • 63dc040b6d Moved SafeBuf::printTimeAgo() functionality to GbUtil.cpp Ivan Skytte Jørgensen 2016-11-07 12:14:37 +01:00
  • cc57242610 Removed defunct code about merging when lots of negative records (and not much disk space) Ivan Skytte Jørgensen 2016-11-07 11:56:05 +01:00
  • 5135621170 Enable verbose mode for sonarqube Ai Lin Chia 2016-11-07 11:37:23 +01:00
  • 91b37c2d22 Limit sonarqube analysis to root directory Ai Lin Chia 2016-11-07 11:30:23 +01:00
  • e52de80e59 First try to enable sonarqube Ai Lin Chia 2016-11-07 11:22:04 +01:00
  • ebffd07b72 More input checks in high-freq-file loading Ivan Skytte Jørgensen 2016-11-04 20:26:58 +01:00
  • 86de43efb9 Use local variables; be more explicit about the bitmask calculation Ivan Skytte Jørgensen 2016-11-04 16:38:52 +01:00
  • 60c8c3d282 Check Dir::open() errors in main.cpp injectFile() Ivan Skytte Jørgensen 2016-11-04 16:22:17 +01:00
  • cfe9c91435 removed a few returns due to clang warnings of unused returns. PVS-Studio complained that no return was specified. clang wins. Brian Rasmusson 2016-11-04 15:29:31 +01:00
  • 8960494cac First version of travis config Ai Lin Chia 2016-11-04 14:55:12 +01:00
  • 507eaf53c1 Remove commented out code Ai Lin Chia 2016-11-04 13:09:52 +01:00
  • fec53fffdb Use log warning for warning logs Ai Lin Chia 2016-11-04 12:54:21 +01:00
  • 24f45f6d06 Fix memory leak in error path in copyFile() Ivan Skytte Jørgensen 2016-11-04 14:51:42 +01:00
  • 876bd0090a Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-04 14:44:13 +01:00
  • edb1d94993 Remember full 18-byte start- and end-key in high-freq-term Ivan Skytte Jørgensen 2016-11-04 14:35:40 +01:00
  • 692b50c202 Don't assume that high-freq-term-file has entries sorted Ivan Skytte Jørgensen 2016-11-04 14:17:06 +01:00
  • 03f8d1dd0e bugfix nullTerm4() Ivan Skytte Jørgensen 2016-11-04 13:48:34 +01:00
  • 201ab4560a Don't remove rebuild from treeIndex as there is no data in it and we're going to delete it anyway Ai Lin Chia 2016-11-04 12:52:22 +01:00