Forks/open-source-search-engine
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • 9be74debf5 qa fixes mwells 2014-07-11 08:35:20 -07:00
  • 5f26918910 lots of bug fixes. more qa fixes. mwells 2014-07-11 08:00:30 -07:00
  • 13e295b89d Merge branch 'diffbot-matt' into testing mwells 2014-07-11 05:41:22 -07:00
  • 2a570cc1ef got tag: support working in the sitelist and url filters mwells 2014-07-10 20:41:59 -07:00
  • 8384371926 squid/sections qa test mwells 2014-07-10 16:42:22 -07:00
  • 0ecc7933d6 qa test for squid/sections Matt Wells 2014-07-10 16:28:24 -07:00
  • 9969644d23 fix section stats display bugs Matt Wells 2014-07-10 15:55:18 -07:00
  • 3e7d72cc41 fix ECORRUPTHTTPGZIP bug Matt Wells 2014-07-10 14:40:09 -07:00
  • 073fdd7eca minor adjustments Matt Wells 2014-07-10 11:20:51 -07:00
  • 0177555361 qa setup for testing squid proxy returning sectiondb voting info. Matt Wells 2014-07-10 11:16:42 -07:00
  • 4d3353fc3c Merge branch 'diffbot-testing' into diffbot-matt Matt Wells 2014-07-10 10:07:11 -07:00
  • b393a1bbbe Merge branch 'testing' into diffbot-matt Matt Wells 2014-07-10 10:06:55 -07:00
  • bcb584c1fd Merge branch 'diffbot-matt' of github.com:gigablast/open-source-search-engine into diffbot-matt Matt Wells 2014-07-10 10:03:20 -07:00
  • e3532a9c5f fix core when getting facet values in xmldoc.cpp Matt Wells 2014-07-10 10:02:53 -07:00
  • 0da6063983 bring tags back in site list / url filters. mwells 2014-07-10 07:44:16 -07:00
  • 683abd3875 more api work mwells 2014-07-10 07:10:49 -07:00
  • 5bbdb8e172 got page add url and add url api working. mwells 2014-07-09 20:32:30 -07:00
  • 4c72e376fa fix core dump when no collrec Matt Wells 2014-07-09 17:36:23 -07:00
  • 950352d781 do not hash redundant xpaths that have the same inner sentence/alnum html as their children tags. waste of index space. mwells 2014-07-09 17:16:01 -07:00
  • b231bc8042 incorporate total # of docs with that xpathsitehash into the tag attr. so using the MxDy should be good enough to determine if something is chrome or not. mwells 2014-07-09 16:47:47 -07:00
  • 50c64f9369 fix printing of getInlineSectionVotingBuf() to be more accurate mwells 2014-07-09 15:44:41 -07:00
  • 05fcef9651 more vote infusion and squid proxy fixes. mwells 2014-07-09 14:57:58 -07:00
  • d4218e01d7 inject docs that come through our squid proxy mwells 2014-07-09 12:25:23 -07:00
  • d7b67f21e7 return error if we get CONNECT requests. we don't handle those because we can't cache them or inject the sectiondb voting info into their tags because they are encrypted from us. mwells 2014-07-09 11:06:46 -07:00
  • 0f9409235e some cleanups mwells 2014-07-09 10:41:38 -07:00
  • 62c920efd0 Merge branch 'testing' into diffbot-matt mwells 2014-07-09 10:23:27 -07:00
  • 205349cfbb added a clone coll page. for after creation cloning. mwells 2014-07-09 07:54:29 -07:00
  • 192b2ee393 added sendPageClone() entire page for cloning as well mwells 2014-07-09 07:33:14 -07:00
  • f7e7468e74 get clone working when adding new coll mwells 2014-07-09 07:13:24 -07:00
  • 0b64d7f0af show api/xml/json in serps mwells 2014-07-09 06:36:36 -07:00
  • a154f679d1 some setup for qaspider() mwells 2014-07-08 20:33:13 -07:00
  • 5ae476f34e print facets for each search result mwells 2014-07-08 19:38:54 -07:00
  • 1af75c5d88 send back facet field/value pairs in msg20reply mwells 2014-07-08 14:22:55 -07:00
  • 99872e9f72 Merge branch 'diffbot-testing' into testing mwells 2014-07-08 13:38:10 -07:00
  • 48d12eb147 application/xhtml+xml should be type html not xml otherwise we don't end up spidering the links Matt Wells 2014-07-08 13:34:53 -07:00
  • a09ba6261f fix ./gb installgb Matt Wells 2014-07-08 13:23:22 -07:00
  • a4273a1269 section voting markup updates mwells 2014-07-08 11:14:45 -07:00
  • 1e8f6ce474 forgot to specify coll for facet link mwells 2014-07-08 10:40:34 -07:00
  • e658ebc8f6 fix up sections page some more. useful for debugging sections stuff. mwells 2014-07-08 10:31:42 -07:00
  • 842d72b5db Merge branch 'testing' into diffbot-matt mwells 2014-07-08 09:58:54 -07:00
  • 5a557e765a added copyCollRec() function to clone setting of one coll to another. mwells 2014-07-08 07:57:49 -07:00
  • d7cc290a1f added a few new search parms that can be used to override collection defaults. hide all clustered results. max title len. max summary excerpt/line width. mwells 2014-07-08 07:01:51 -07:00
  • eb7d83cbad added &showimages=0 parm. also print image url. mwells 2014-07-08 06:26:42 -07:00
  • a7bddbcc0b return up to the first 3 h1 tags when &geth1tag=1 is specified for an xml or json feed. mwells 2014-07-07 21:01:07 -07:00
  • 445896e04c fix query reindex core Matt Wells 2014-07-07 19:11:01 -07:00
  • 67ba89dd11 added gbequalint: query operator for showing docs with a specific facet VALUE. mwells 2014-07-07 17:40:49 -07:00
  • c8567f8a24 sectioning stuff working halfway decent. still need to do docid-based stats perhaps. need to scroll to section hash when clicking the 'sections' link. mwells 2014-07-07 16:46:38 -07:00
  • a3ef40ccf5 pass qa test mwells 2014-07-07 12:42:30 -07:00
  • d9ae010371 shard gbfacetstr:gbxpathsitehash123456 terms by termid for speed. got them working again multicasting a msg 0x39 to the appropriate shard. set special msg39request flag for better performance for those guys. mwells 2014-07-07 12:32:27 -07:00
  • 6434e5cc04 Merge branch 'testing' into diffbot-matt mwells 2014-07-07 09:49:59 -07:00
  • 05065f7f8c treat http status 999 as forbidden. mwells 2014-07-07 09:46:24 -07:00
  • e22641997a fix geth1tag some more. fixed bad comment tag detection. was losing a good deal of some pages because of that. mwells 2014-07-07 08:20:21 -07:00
  • fed7b73b9f passing qa test again mwells 2014-07-06 22:06:33 -07:00
  • 38e64a6600 update qa loop mwells 2014-07-06 19:43:00 -07:00
  • dc6c97c59c basic qa tests running mwells 2014-07-06 18:53:05 -07:00
  • 4dee019107 qa fixes mwells 2014-07-06 16:47:04 -07:00
  • aeae6bb1a5 qa test updates mwells 2014-07-06 15:04:21 -07:00
  • 70e1eab935 more api updates mwells 2014-07-06 14:13:00 -07:00
  • 97ad9a62e0 support &addcoll= as well as &addColl= mwells 2014-07-06 12:09:41 -07:00
  • 574b3f9354 if netpbm pkg already installed use it. mwells 2014-07-06 09:54:28 -07:00
  • e4f43848d5 fix http://abc.com in sitelist some more. mwells 2014-07-06 08:31:27 -07:00
  • 43d0d636ee fix dmoz building. mwells 2014-07-05 22:20:15 -07:00
  • 6d425d0bdb use changelog in binary packages mwells 2014-07-05 18:51:49 -07:00
  • c8183399de makefile version bump mwells 2014-07-05 16:21:57 -07:00
  • d0345b7c75 fix respider link mwells 2014-07-05 16:19:16 -07:00
  • 183191520f only show h1tag if there mwells 2014-07-05 16:11:17 -07:00
  • 81a89f5975 added support for &geth1tag=1 for xml feeds. mwells 2014-07-05 16:08:48 -07:00
  • 1944b25beb parm fixes mwells 2014-07-05 15:00:16 -07:00
  • d47ffaaa41 fix widget bug mwells 2014-07-05 14:33:41 -07:00
  • af1f7e4590 do not launch spiders if in the middle of exiting. mwells 2014-07-05 14:29:46 -07:00
  • 41804611bb if logging to stderr then return err when trying to fetch logs. mwells 2014-07-05 14:16:33 -07:00
  • 4d98ec7407 fixed some parms bug i made mwells 2014-07-05 14:11:32 -07:00
  • 4059c84074 api updates mwells 2014-07-05 12:47:10 -07:00
  • 29d170631a more api updates mwells 2014-07-05 12:36:01 -07:00
  • cfd36af394 more api updates mwells 2014-07-05 10:16:21 -07:00
  • ea2650292a more api updates. will also be useful for running qa tests. mwells 2014-07-04 20:57:42 -07:00
  • 5a12fa8582 nothing mwells 2014-07-04 17:18:21 -07:00
  • 5bae438169 get 'gb qa' working somewhat. need to have more quick and robust smoketesting. mwells 2014-07-04 17:15:22 -07:00
  • 10bf6c3d35 fix bug in summary display mwells 2014-07-04 15:42:02 -07:00
  • 94d1b4e90c support og:image images. allow user to enter thumbnail max width/height. fix summary printing. was off a little. mwells 2014-07-04 15:33:27 -07:00
  • 641252d052 parm doc updates. mwells 2014-07-04 11:46:25 -07:00
  • 42552ea70a added GET/POST api note mwells 2014-07-04 11:28:40 -07:00
  • 0f3556206b fix default summary m_displayLen bug mwells 2014-07-04 10:55:46 -07:00
  • f9ae433ac1 fix addurl functionality on root page. mwells 2014-07-04 10:43:04 -07:00
  • 79f19d3aa3 addurl interface updates mwells 2014-07-04 10:08:32 -07:00
  • 19a8cd3967 fix statsdb/graph page mwells 2014-07-04 09:53:42 -07:00
  • 6a665430d3 fix federated search. like &c=main+test mwells 2014-07-04 09:31:07 -07:00
  • 3f8bbed3ac added note mwells 2014-07-04 09:22:09 -07:00
  • 888db7787d make patterns in the site list that start with http: or https: behave like the regex ^http: so it requires the start of the url match exactly. fixes pattern "http://xyz.com/". mwells 2014-07-04 09:18:46 -07:00
  • 53a7148634 keep thumbnail gen msgs in the log file mwells 2014-07-04 08:34:42 -07:00
  • dff47bf5cd remove spam checker to make debugging easier Matt Wells 2014-07-03 13:17:28 -07:00
  • d2996bad3a ease up on max redirects limit. was too low. Matt Wells 2014-07-03 13:09:09 -07:00
  • 00e111a182 make spider status msgs clickable to see the urls with that status. Matt Wells 2014-07-03 12:52:44 -07:00
  • c5815829e5 Merge branch 'testing' into diffbot-testing Matt Wells 2014-07-03 12:31:13 -07:00
  • 8ebda5ca51 little comment update Matt Wells 2014-07-03 12:26:02 -07:00
  • 886063a3bd fixes for query reindex. Matt Wells 2014-07-03 12:24:14 -07:00
  • 1586c2dcd7 minor parm change to back what it was mwells 2014-07-03 07:57:08 -07:00
  • 6153cd8ee2 double slash cleanup mwells 2014-07-03 07:39:02 -07:00
  • a327f9ceb0 Merge branch 'diffbot-testing' into testing mwells 2014-07-03 07:30:39 -07:00
  • b0caf3eb00 get summary "ns" parm and collectionrec knobs for summary gen working. mwells 2014-07-03 07:29:44 -07:00