Commit Graph

  • 2c6a55a12a fix bug causing 'force delete' in URL filters to be 'inherited' to other filter groups due to missing clearing of data Brian Rasmusson 2016-06-27 16:00:24 +02:00
  • 992631a482 Remove unused rootlang Ai Lin Chia 2016-06-24 17:18:14 +02:00
  • 1dca8bc37d Clean up deprecated tags from tagdb while merging Ai Lin Chia 2016-06-24 14:45:59 +02:00
  • ee0c1d029c Remove commented out code Ai Lin Chia 2016-06-24 14:39:32 +02:00
  • 850a335b3d Fix a few constant-boolean expressions Ivan Skytte Jørgensen 2016-06-22 21:06:14 +02:00
  • 8e8611521e hint to flexelint about non-erturn of gbshutdownAbort() Ivan Skytte Jørgensen 2016-06-22 21:00:05 +02:00
  • 81e3af7cc3 Fix compilation warnings Ai Lin Chia 2016-06-22 15:22:40 +02:00
  • 7035ad4487 Remove set but unused variable Ai Lin Chia 2016-06-22 14:22:30 +02:00
  • 594a701101 Remove unused variable Ai Lin Chia 2016-06-22 14:12:16 +02:00
  • cefe5c5556 Add constness Ai Lin Chia 2016-06-22 14:08:42 +02:00
  • 9fc401da4d Remove unused atob function Ai Lin Chia 2016-06-22 13:33:55 +02:00
  • 72c799f21e Fix duplicated-cond warning Ai Lin Chia 2016-06-22 10:43:11 +00:00
  • 56a81b765a Fix misleading-indentation warning Ai Lin Chia 2016-06-22 10:40:55 +00:00
  • 0ac7fe1a8a Fix misleading-indentation warning Ai Lin Chia 2016-06-22 09:14:10 +00:00
  • 9c7fe9c63f Removed superfluous null checks Ivan Skytte Jørgensen 2016-06-21 16:45:42 +02:00
  • 14f30aff91 Fix logical 'and' of mutually exclusive tests is always false Ai Lin Chia 2016-06-21 15:02:43 +02:00
  • c785e6dad8 Fix pointer overflow checks in RdbList Ivan Skytte Jørgensen 2016-06-21 16:41:05 +02:00
  • 7c9be3a3a9 fix the fix Brian Rasmusson 2016-06-21 15:56:24 +02:00
  • e916c47a45 Merge branch 'master' of https://github.com/privacore/open-source-search-engine Brian Rasmusson 2016-06-21 15:01:46 +02:00
  • ae52752afc Corrected bounds check when reading fd close counts Brian Rasmusson 2016-06-21 15:01:36 +02:00
  • 6495de3744 Removed bogus sanity check Ivan Skytte Jørgensen 2016-06-21 14:59:10 +02:00
  • 0bb24cc483 Fix compilation of cld2 for gcc6 Ai Lin Chia 2016-06-21 14:42:48 +02:00
  • 34d1d1ddf6 Fix (style) Same expression on both sides of '&&' Ai Lin Chia 2016-06-21 13:26:26 +02:00
  • f83cb8d50b Removed superfluous null check Ivan Skytte Jørgensen 2016-06-21 14:35:16 +02:00
  • b769e4f5e1 boundry check fixes Brian Rasmusson 2016-06-21 13:32:26 +02:00
  • ccffa630f7 Fix compilation error Ai Lin Chia 2016-06-21 13:18:40 +02:00
  • f78c43d82a Fix redundant condition: '!A || (A && B)' is equivalent to '!A || B' Ai Lin Chia 2016-06-21 13:15:12 +02:00
  • 1951a30c4a Code style changes Ai Lin Chia 2016-06-21 12:50:52 +02:00
  • f3ec7d2f2c Code style changes Ai Lin Chia 2016-06-21 12:23:45 +02:00
  • af71bf96bf Code style changes Ai Lin Chia 2016-06-21 12:06:20 +02:00
  • b085428624 Remove commented out code Ai Lin Chia 2016-06-21 11:59:58 +02:00
  • 4838c2fedf Change bytesToRead from 32bit to 64bit to avoid convertion warnings Ai Lin Chia 2016-06-21 11:59:27 +02:00
  • d79262b73e Even more emergency shutdown streamlining Brian Rasmusson 2016-06-20 20:06:43 +02:00
  • 5c6baea48e More emergency shutdown streamlining Brian Rasmusson 2016-06-20 19:48:19 +02:00
  • 780696c0d1 More emergency shutdown streamlining Brian Rasmusson 2016-06-20 19:29:10 +02:00
  • be208fefaa spidering statistics: changed/unchanged documents Ivan Skytte Jørgensen 2016-06-20 17:38:39 +02:00
  • cfbb0366bb Merge branch 'master' of github.com:privacore/open-source-search-engine Ivan Skytte Jørgensen 2016-06-20 17:22:16 +02:00
  • d49b290d07 A few more emergency shutdown fixes Brian Rasmusson 2016-06-20 12:45:33 +02:00
  • f3f5eefcb6 First batch of changes streamlining emergency shutdown code Brian Rasmusson 2016-06-20 12:30:26 +02:00
  • b514bdfbed 32/64bit flag: simplify Ivan Skytte Jørgensen 2016-06-20 12:27:19 +02:00
  • 44732e5ae2 Streamline hard shutdown in RdbList Brian Rasmusson 2016-06-18 22:07:59 +02:00
  • f5797bb013 Removed more references to gigablast.com (hardcoded email address, service names, redirects, ...) Ivan Skytte Jørgensen 2016-06-17 14:43:06 +02:00
  • 1226d40169 Changed/removed references to mydomain and vtext Ivan Skytte Jørgensen 2016-06-17 14:26:35 +02:00
  • c773bcdf74 Use sizeof() instead of macro constants. Found bug wrt. Conf::m_clusterName Ivan Skytte Jørgensen 2016-06-17 14:22:51 +02:00
  • c42c46cb14 Support fx_qid. Carried all the way through to msg39request Ivan Skytte Jørgensen 2016-06-17 14:03:31 +02:00
  • 2ba2aaf5f5 Major cleanup in types.h Ivan Skytte Jørgensen 2016-06-14 16:17:52 +02:00
  • c8388d8d49 Some more constness in types.h Ivan Skytte Jørgensen 2016-06-14 15:46:05 +02:00
  • f46250af99 More cleanup in types.h Ivan Skytte Jørgensen 2016-06-14 15:37:03 +02:00
  • 14c154949a Cleanup in types.h Ivan Skytte Jørgensen 2016-06-14 15:28:23 +02:00
  • d63a39fd53 define->typedef of collnum_t Ivan Skytte Jørgensen 2016-06-14 14:34:00 +02:00
  • 3e6523a1d7 more constness in Rdb*.h Ivan Skytte Jørgensen 2016-06-14 14:06:37 +02:00
  • 8670d6c318 statistics for spidering (incomplete) and RdbCache Ivan Skytte Jørgensen 2016-06-14 12:51:33 +02:00
  • aa8accb7db more constness in RdbCache.h Ivan Skytte Jørgensen 2016-06-14 12:11:02 +02:00
  • a1dacc4070 histogram statistis on queries Ivan Skytte Jørgensen 2016-06-13 16:54:56 +02:00
  • ab8cbd5422 Optimize (-O2) Msg3.o/Msg2.o/Msg5.o/XmlDoc.o Ivan Skytte Jørgensen 2016-06-10 15:25:53 +02:00
  • a49e7db197 Fix system test for summary with ellipsis Ai Lin Chia 2016-06-10 14:36:41 +02:00
  • eaa3db64f2 removed unused Log::getFilename() Ivan Skytte Jørgensen 2016-06-10 14:29:18 +02:00
  • 5f82dc2379 Let image converters use normal stderr Ivan Skytte Jørgensen 2016-06-10 14:28:16 +02:00
  • 9087e102e3 Code style changes Ai Lin Chia 2016-06-10 14:16:19 +02:00
  • 62df7d2808 Remove diffbot specific matchesucp & matchesupp url filters Ai Lin Chia 2016-06-10 14:15:46 +02:00
  • 748d55abcc Remove rebuildUrlFiltersDiffbot & remove rebuildDiffbotRegexes Ai Lin Chia 2016-06-10 14:07:14 +02:00
  • 0d1e46630e Code style changes Ai Lin Chia 2016-06-10 12:11:21 +02:00
  • 558109bf23 Removed old temporary debug-log Ivan Skytte Jørgensen 2016-06-10 13:57:17 +02:00
  • b076bef63d Remove always false ignoreDocUnchangedError Ai Lin Chia 2016-06-10 11:37:33 +02:00
  • b18f23a311 Simplify code Ai Lin Chia 2016-06-10 11:10:05 +02:00
  • f0aa6ee15d Remove spiderlinkslinks (dmoz specific code) Ai Lin Chia 2016-06-10 11:09:25 +02:00
  • 6e9d199d51 Remove ignorelinksexternalerrors (dmoz specific code) Ai Lin Chia 2016-06-10 11:08:39 +02:00
  • 4b5320a98a Rename lists to a more accurate name (spiderRequests) Ai Lin Chia 2016-06-09 18:10:08 +02:00
  • 796332a9bb Change sample document to simpler example Ai Lin Chia 2016-06-09 18:09:05 +02:00
  • 0db7759098 Boost inlinks during ranking Ivan Skytte Jørgensen 2016-06-09 17:59:15 +02:00
  • c47bc2858a Print inhead section Ai Lin Chia 2016-06-09 17:07:45 +02:00
  • f83ae887a4 Fix summary generation for default summary Ai Lin Chia 2016-06-09 17:06:29 +02:00
  • 491a79ecae Remove commented out code Ai Lin Chia 2016-06-09 16:28:13 +02:00
  • a17f6b38f1 Simplify logic (remove goto) Ai Lin Chia 2016-06-09 16:16:49 +02:00
  • 6fc8f508cd Replace class Link with stl list Ai Lin Chia 2016-06-09 16:04:08 +02:00
  • 861cc8d219 Code style changes Ai Lin Chia 2016-06-09 15:24:44 +02:00
  • b5da0d29ec Fix all caps PDF title Ai Lin Chia 2016-06-09 14:51:52 +02:00
  • 17d5004f0e Add todo notes Ai Lin Chia 2016-06-09 11:27:26 +02:00
  • f81e63c801 Made changes to ranking settings take effect immediately without restarting. Ivan Skytte Jørgensen 2016-06-09 14:40:57 +02:00
  • 72abec16ec entities.* fixes Ivan Skytte Jørgensen 2016-06-09 13:43:43 +02:00
  • dd22b1e8d8 Make is_same_network_linkwise() always return false Ivan Skytte Jørgensen 2016-06-09 12:33:36 +02:00
  • 10467334ea Factor out same-ip-network checks in Linkdb.cpp Ivan Skytte Jørgensen 2016-06-09 12:30:41 +02:00
  • 322acc3c96 bugfix reuse of linkinfo Ivan Skytte Jørgensen 2016-06-09 12:24:59 +02:00
  • e24a0584ac Merge branch 'master' of github.com:privacore/open-source-search-engine Ivan Skytte Jørgensen 2016-06-09 12:20:45 +02:00
  • dd9f4063fd Code style changes & remove commented out code Ai Lin Chia 2016-06-09 11:14:44 +02:00
  • 4ef94d7e28 Clean up unwanted existing spiderdb records (that are not inserted anymore) Ai Lin Chia 2016-06-08 16:02:50 +02:00
  • e0c8026727 Avoid flexelint warning about too few initializers Ivan Skytte Jørgensen 2016-06-08 13:45:23 +02:00
  • 8a3b836628 Remove isnewoutlink (missed in previous commit) Ai Lin Chia 2016-06-08 12:10:03 +02:00
  • 3d29f7ac87 Remove isnewoutlink Ai Lin Chia 2016-06-08 12:09:39 +02:00
  • 994e0777b5 Remove redundent ismedia url filter. we're not inserting media url anymore into spiderdb Ai Lin Chia 2016-06-08 11:32:55 +02:00
  • 8802a253cf Code style changes. Remove commented out code. Simplify statements Ai Lin Chia 2016-06-08 10:37:31 +02:00
  • 7e432a14a1 Remove menuoutlink Ai Lin Chia 2016-06-07 23:15:17 +02:00
  • 4c99ef3d2e Remove wasparentsindexed Ai Lin Chia 2016-06-07 23:07:20 +02:00
  • 53885df461 optimize (-O3) IPAddressChecks.o Ivan Skytte Jørgensen 2016-06-07 16:32:47 +02:00
  • 5542b05571 Added useful comment Ivan Skytte Jørgensen 2016-06-07 16:12:23 +02:00
  • f8088e084d fix infinite loop from corrupt spider request Matt Wells 2016-06-06 08:06:20 -07:00
  • 0f5e9e5a98 Support multi-codepoint html entitites (such as ⊏̸) Ivan Skytte Jørgensen 2016-06-07 15:05:18 +02:00
  • d63b187c2f Fix off-by-one check for long entities Ivan Skytte Jørgensen 2016-06-07 14:17:24 +02:00
  • 667f36ba31 account for ampersand overhead Ivan Skytte Jørgensen 2016-06-07 13:56:59 +02:00
  • 52f7bd856a Remove parentlang support from url filters Ai Lin Chia 2016-06-07 12:32:20 +02:00