Commit Graph

  • 7f4e8045be Abort if Hostdb::getShard() iscalled for non-existing shard Ivan Skytte Jørgensen 2016-11-18 14:27:19 +01:00
  • 9e17a22733 Print tagdb & link data as well Ai Lin Chia 2016-11-18 10:51:37 +01:00
  • d7be91a24b Remove unused arguments Ai Lin Chia 2016-11-18 10:42:45 +01:00
  • 693d730851 Removed last traces of g_udpServer2 Ivan Skytte Jørgensen 2016-11-17 18:33:20 +01:00
  • db2fbdd460 Removed declaration of unimplemented PingServer::tapHost() Ivan Skytte Jørgensen 2016-11-17 18:16:34 +01:00
  • f2e30cdbf2 Removed write-only Host::m_inSync Ivan Skytte Jørgensen 2016-11-17 18:10:01 +01:00
  • b442fd3e1f Improved clumsy loop Ivan Skytte Jørgensen 2016-11-17 18:09:41 +01:00
  • 8e0531d543 Postpone local variable decl. until first use Ivan Skytte Jørgensen 2016-11-17 17:43:35 +01:00
  • 0e96613abf Changed direct access to Host::m_*http/httpsPort to methods Ivan Skytte Jørgensen 2016-11-17 17:31:42 +01:00
  • d3eb421248 Removed write-only Host::m_wasAlive and Host::m_wasEverAlive Ivan Skytte Jørgensen 2016-11-17 16:55:33 +01:00
  • 8a563dfc89 Removed write-only Host::m_timeOfDeath Ivan Skytte Jørgensen 2016-11-17 16:51:34 +01:00
  • f18f012364 Simplify if()-chain in PingServer.cpp Ivan Skytte Jørgensen 2016-11-17 16:42:28 +01:00
  • 9d326e525e Add get_titlerec tool (dump titlerec for specific instance) Ai Lin Chia 2016-11-17 16:40:13 +01:00
  • 47dfabc089 Replace use of 'shortcut' pointer in gotTitleList Ai Lin Chia 2016-11-17 13:38:00 +01:00
  • 099be1bb43 Removed write-only Spidercoll::m_twinDied Ivan Skytte Jørgensen 2016-11-17 16:30:56 +01:00
  • 9601750808 Removed unhelpful comments Ivan Skytte Jørgensen 2016-11-17 16:24:14 +01:00
  • 49ab639fde Removed unused Hostdb::getLiveHostInShard() Ivan Skytte Jørgensen 2016-11-17 16:18:53 +01:00
  • cb6383c33a Simplify logic in Hostdb::isShardDead() Ivan Skytte Jørgensen 2016-11-17 16:17:57 +01:00
  • e14ae14fc1 Better comments for some fields in Hostdb.h Ivan Skytte Jørgensen 2016-11-17 16:13:48 +01:00
  • b2dfb8006d Bit of spring cleaning of Multicast.cpp Ivan Skytte Jørgensen 2016-11-17 15:50:04 +01:00
  • cfd9d96b56 Code style changes Ai Lin Chia 2016-11-17 12:36:43 +01:00
  • 755cfae770 Remove unused niceness Ai Lin Chia 2016-11-17 12:36:31 +01:00
  • e74665cc78 Use tabs & print probabledocids as well Ai Lin Chia 2016-11-17 12:35:55 +01:00
  • 89843ae31e Remove commented out code Ai Lin Chia 2016-11-17 12:35:29 +01:00
  • dfad8d1d4e Add a boolean to enable/disable log prefix printing Ai Lin Chia 2016-11-17 12:34:24 +01:00
  • fd27a136ab Remove commented out code Ai Lin Chia 2016-11-17 12:25:10 +01:00
  • d07d529eac Remove commented out code & unused variable Ai Lin Chia 2016-11-17 12:24:49 +01:00
  • 7ca5cd4f96 Rename len to haystackLen to show that it's haystack length we need to pass and not needle length Ai Lin Chia 2016-11-17 12:23:59 +01:00
  • a677f8956f Use haystacklen instead of needleLen Ai Lin Chia 2016-11-17 12:22:44 +01:00
  • 971e35af38 Add SiteGetterTest Ai Lin Chia 2016-11-17 12:22:27 +01:00
  • 297917a5ac Remove unnecessary include Ai Lin Chia 2016-11-17 12:20:33 +01:00
  • 0e2c12c5e5 More fixes for runCoverityAnalysis Ai Lin Chia 2016-11-17 12:16:35 +01:00
  • fdb43e81ac Check for errors from Msge1 Ivan Skytte Jørgensen 2016-11-17 12:21:13 +01:00
  • 45856a1af1 Cleanup Msge1 (similar to Msge0) Ivan Skytte Jørgensen 2016-11-17 12:17:58 +01:00
  • 43fa4e4ce2 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-17 11:45:44 +01:00
  • a3d35b0425 Msge0: Call real TagRec constructor and destructor Ivan Skytte Jørgensen 2016-11-17 11:45:30 +01:00
  • 9437a654a1 char->bool Ivan Skytte Jørgensen 2016-11-17 11:35:15 +01:00
  • 3b8a1c492a Removed unused Msge0::m_i Ivan Skytte Jørgensen 2016-11-17 11:34:16 +01:00
  • e6a63262fd Initialize Msge0 members in C++-style Ivan Skytte Jørgensen 2016-11-17 11:32:21 +01:00
  • e3ddd4c941 Removed commented-out Msge0 member Ivan Skytte Jørgensen 2016-11-17 11:31:53 +01:00
  • 1a0062a726 Encapsulate Msge0 better Ivan Skytte Jørgensen 2016-11-17 11:21:57 +01:00
  • 5a596df57d Add print_urlinfo tool to print out hashes Ai Lin Chia 2016-11-16 14:58:00 +01:00
  • 9726d2d932 More debugging for coverity upload from travis Ai Lin Chia 2016-11-16 14:57:24 +01:00
  • b2c66eef5e Add constness to SiteGetter Ai Lin Chia 2016-11-16 14:51:50 +01:00
  • aa90b4b47d Code style changes Ai Lin Chia 2016-11-15 15:13:10 +01:00
  • c15af1adfe Remove commented out code Ai Lin Chia 2016-11-15 15:12:05 +01:00
  • 8b684c9215 Use Spiderdb instead of g_spiderdb for static functions Ai Lin Chia 2016-11-15 15:11:03 +01:00
  • 732cfefe91 Add spiderdb to decode_rdbkey Ai Lin Chia 2016-11-15 14:53:48 +01:00
  • 7a09a20197 Make Spiderdb function static Ai Lin Chia 2016-11-15 14:52:43 +01:00
  • 03a22c6733 Moved Msg25 stuff to Msg25.* Ivan Skytte Jørgensen 2016-11-15 15:10:04 +01:00
  • 7654b186d0 Break PageResults.cpp's dependence on Linkdb.h's MAX_INLINKS Ivan Skytte Jørgensen 2016-11-15 14:59:07 +01:00
  • fd57f351d5 Moved Msg25Request to new msg25.h file Ivan Skytte Jørgensen 2016-11-15 14:49:28 +01:00
  • 49479e6094 Don't include Xml.h from Linkdb.h Ivan Skytte Jørgensen 2016-11-15 14:40:15 +01:00
  • b0874297e2 Removed unused members from Conf Ivan Skytte Jørgensen 2016-11-15 14:25:12 +01:00
  • 1d31f53cd6 Add decode of linkdb key to decode_rdbkey tool Ai Lin Chia 2016-11-15 14:07:40 +01:00
  • 620efb827e Fix tools compilation error Ai Lin Chia 2016-11-15 14:06:03 +01:00
  • 7d2f87a9f9 bugfix e9d20f7919: lostDate was referneed in VALGRIND macro Ivan Skytte Jørgensen 2016-11-15 13:40:37 +01:00
  • 53747b0520 Made printHttpMime() local Ivan Skytte Jørgensen 2016-11-15 13:38:04 +01:00
  • 226815d299 Print response Ai Lin Chia 2016-11-15 12:23:55 +01:00
  • e9d20f7919 Remove always 0 lostDate (we don't store lostDate anymore) Ai Lin Chia 2016-11-15 12:19:18 +01:00
  • 87a7d306df Remove now unused lost links (we don't store lost links anymore) Ai Lin Chia 2016-11-15 12:18:56 +01:00
  • f4cfc56407 Move isSimilar_sorted from XmlDoc to Msg25 Ai Lin Chia 2016-11-15 12:18:10 +01:00
  • dab892fc05 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-15 12:13:43 +01:00
  • 39f586798f Prepend corefile backtrace with gb version so we can match line numbers correctly Ai Lin Chia 2016-11-15 11:23:34 +01:00
  • 44c4ee7fb5 Moved g_merge from RdbBase.cpp to RdbMerge.cpp, thereby also cleaning up #includes in RdbBase.h Ivan Skytte Jørgensen 2016-11-14 22:35:12 +01:00
  • 0d245b5ca3 Removed unused RdbMerge::m_numThreads Ivan Skytte Jørgensen 2016-11-14 22:31:16 +01:00
  • dbd9f86fee Removed unused RdbMerge::unlinkPartWrapper() Ivan Skytte Jørgensen 2016-11-14 22:30:31 +01:00
  • ed7e6a2476 Removed unused Conf::m_searchResultsMaxCacheMem and Conf::m_searchResultsMaxCacheAge Ivan Skytte Jørgensen 2016-11-14 17:37:37 +01:00
  • 98d15b8f90 Fix include files in unit test Ai Lin Chia 2016-11-14 17:32:16 +01:00
  • 9e34b8752b Handle rebuild finalization, particularly NULL treeindex Ivan Skytte Jørgensen 2016-11-14 16:59:04 +01:00
  • b6570ff536 Allow instance specific mergeDir override Ai Lin Chia 2016-11-14 15:25:28 +01:00
  • a6e02a052c Name local variables better Ivan Skytte Jørgensen 2016-11-14 16:21:14 +01:00
  • 00e2308cb3 bugfix Spidercoll: was using m_list instead of m_list2 for wiatingtree population Ivan Skytte Jørgensen 2016-11-14 16:01:29 +01:00
  • 38336ff25e truncate merge lock files when relinquished Ivan Skytte Jørgensen 2016-11-14 14:56:26 +01:00
  • ff97b92fbb Make merge initialization code clearer Ivan Skytte Jørgensen 2016-11-14 14:37:32 +01:00
  • c966c96ddc Handle more merge errors correctly Ivan Skytte Jørgensen 2016-11-14 13:47:25 +01:00
  • c279cccce1 merge: check if we could add a sleep calback. if not then handle error Ivan Skytte Jørgensen 2016-11-14 13:25:05 +01:00
  • 5f0eb07059 Print coverity upload response Ai Lin Chia 2016-11-14 13:09:01 +01:00
  • 83852d2d47 Use bash instead of sh Ai Lin Chia 2016-11-14 09:45:20 +01:00
  • 1394e4e481 #include cleanup in Repair.* Ivan Skytte Jørgensen 2016-11-13 20:35:25 +01:00
  • 7fc01ba470 Changed if-else chain to clearer switch() Ivan Skytte Jørgensen 2016-11-13 16:42:23 +01:00
  • d2f7759d14 #include cleanup of Hostdb.* Ivan Skytte Jørgensen 2016-11-13 16:33:43 +01:00
  • 63b202c1f0 #include cleanup in SpiderColl Ivan Skytte Jørgensen 2016-11-13 16:22:12 +01:00
  • f7d0c7e863 #include cleanup in SpiderLoop.* Ivan Skytte Jørgensen 2016-11-13 16:12:03 +01:00
  • 14dc0c5fec #include cleanup in RdbTree.* Ivan Skytte Jørgensen 2016-11-13 15:40:07 +01:00
  • d8d6e39441 More constness in Url.* Ivan Skytte Jørgensen 2016-11-13 14:44:30 +01:00
  • 401c751a83 More constness in Url.* Ivan Skytte Jørgensen 2016-11-13 14:36:08 +01:00
  • 5f934820ae More constness in Speller.h Ivan Skytte Jørgensen 2016-11-12 21:23:01 +01:00
  • 8ed362bc80 More constness in Speller.h Ivan Skytte Jørgensen 2016-11-12 21:20:38 +01:00
  • 81553cd8dd constness in Lang.* Ivan Skytte Jørgensen 2016-11-12 21:12:13 +01:00
  • 84acb2d50d Eliminated goto from Url.cpp Ivan Skytte Jørgensen 2016-11-12 21:06:30 +01:00
  • 3b53cd2a5c Eliminated goto from Rebalance.cpp Ivan Skytte Jørgensen 2016-11-12 21:04:45 +01:00
  • e0f6a4b826 Eliminated goto from PageAddColl.cpp Ivan Skytte Jørgensen 2016-11-12 21:02:58 +01:00
  • 2eb204addd Eliminated goto from HttpMime.cpp Ivan Skytte Jørgensen 2016-11-12 21:01:19 +01:00
  • 58b61e536f Eliminated goto from BigFile.cpp Ivan Skytte Jørgensen 2016-11-12 20:59:27 +01:00
  • 5af39f1358 Moved MAX_COLL_LEN and MAX_URL_LEN to separate header files Ivan Skytte Jørgensen 2016-11-12 20:44:42 +01:00
  • 665c4af407 Stop #including Collectiondb.h from header files (mostly) Ivan Skytte Jørgensen 2016-11-12 20:29:38 +01:00
  • aba937780d Stop #including Conf.h from header files Ivan Skytte Jørgensen 2016-11-12 20:24:20 +01:00
  • d52dabc828 #include cleanup of Url.h Ivan Skytte Jørgensen 2016-11-12 20:01:44 +01:00
  • 8a41de798f #include cleanup og MsgC.h Ivan Skytte Jørgensen 2016-11-12 19:43:59 +01:00