Commit Graph

  • 95a020574c set spiderlinks=1 when doing ./gb blaster -i <fileofurls> to index/inject a file of urls so that we add the outlinks to spiderdb. this will slow things down a little since we will have to do a dns lookup of the subdomain of each outlink, unless it is cached. mwells 2013-08-19 16:15:58 -06:00
  • 72d7e42497 added a quick start note to admin.html. mwells 2013-08-19 15:34:07 -06:00
  • 24af21394d dns ip fix in gb.conf. mwells 2013-08-19 15:25:37 -06:00
  • e9297df240 listen on DNS port 5998 not 6000. 6000 seemed to cause issues on a particular install for some reason. mwells 2013-08-19 15:02:27 -06:00
  • 71aa03ab5d little admin.html update. mwells 2013-08-19 13:45:43 -06:00
  • eb4758b565 fix init error when injecting file of urls. mwells 2013-08-19 13:34:47 -06:00
  • 2c83b96ba4 Added support for 'gb blaster -i <fileofurls> <maxThreads>' to inject/index a file of urls. Committing older work for compare.html that shows differences between gigablast and solr, but has a lot of blanks. mwells 2013-08-19 13:26:46 -06:00
  • 5facc7d859 add injection timing stat point to compare.html mwells 2013-08-17 11:06:24 -06:00
  • 4092177e5f added injectme3 file and documentation into compare.html to describe how to inject a file of concatenated HTML documents into gb. Still have to find out how to do that in SOLR and elasticsearch for comparison. mwells 2013-08-17 11:02:26 -06:00
  • c0e1216022 stub for compare.html Matt Wells 2013-08-17 09:07:48 -07:00
  • f7f377a1f7 fixed a core dump in proxy.cpp. make doubly sure protocol is not 1.1 since we have keep alives disabled we need to force protocol to 1.0. Matt Wells 2013-08-17 08:58:28 -07:00
  • 410604c388 minor edits Matt Wells 2013-08-17 08:48:07 -07:00
  • 5bac648cc9 start up the gigablast blog again. Matt Wells 2013-08-17 08:44:32 -07:00
  • 5a2cb35e6c added gb.conf.txt and hosts.conf.txt for display from admin.html. Matt Wells 2013-08-11 00:45:27 -07:00
  • e42afac9d8 admin.html documentation updates. Matt Wells 2013-08-11 00:32:53 -07:00
  • 834128a076 Fixed heap breaches caused by our bult-in electric fence code from death queries. Use HTTP/1.0 not 1.1 since we disabled keep-alive support a long time ago. Matt Wells 2013-08-10 09:51:14 -07:00
  • 651b899453 oops, wrong sign direction. mwells 2013-08-09 22:14:13 -06:00
  • 9b94e0feac fix core from huge death query. Matt Wells 2013-08-09 21:05:38 -07:00
  • ef333f8937 fix bug in user accounting system summary stats recs. when sumbuf reallocated the hashtable of ptrs could be invalidated. so use offsets, not ptrs, in the hash table. Matt Wells 2013-08-09 16:40:12 -07:00
  • 4f4047a3ad new Make.depend. mwells 2013-08-09 17:13:45 -06:00
  • dbefaec10d Merge branch 'master' of git@github.com:gigablast/open-source-search-engine Matt Wells 2013-08-09 16:04:00 -07:00
  • 77325fe5fa Fixed a couple mostly proxy-related cores. Matt Wells 2013-08-09 16:03:48 -07:00
  • f15beeb297 Removed another unused variable (tidy make output)w Steve Cook 2013-08-09 12:37:25 -06:00
  • 5a5050d8d9 extend copyright line in LICENSE file. Matt Wells 2013-08-09 09:05:09 -07:00
  • 14688f1a7b remove more temp files Matt Wells 2013-08-09 08:54:45 -07:00
  • c386f0d1f0 remove temp file. Matt Wells 2013-08-09 08:53:36 -07:00
  • 2c7caf0653 Merge branch 'master' of git@github.com:gigablast/open-source-search-engine Matt Wells 2013-08-09 08:52:23 -07:00
  • 76cf68f7b1 Fixed some bugs. Matt Wells 2013-08-09 08:52:15 -07:00
  • fd88c6c3b2 add contact info to README.md. mwells 2013-08-08 15:31:20 -06:00
  • 0b94b31fbc Fix potential core issue in proxy. mwells 2013-08-08 15:14:36 -06:00
  • 7d54efef09 remove file addsinprogress.dat mwells 2013-08-08 14:45:16 -06:00
  • be7aab78b7 Fixed bugs with running a proxy. Added more comments into hosts.conf. mwells 2013-08-08 14:41:38 -06:00
  • d805696040 Merge branch 'master' of github.com:gigablast/open-source-search-engine mwells 2013-08-05 13:07:36 -06:00
  • 1b03e77db3 README.md update. mwells 2013-08-05 13:07:09 -06:00
  • 1883e392e9 Merge branch 'master' of github.com:gigablast/open-source-search-engine Steve Cook 2013-08-05 10:32:59 -06:00
  • 6ac55d3b75 Update Msg13.cpp Gigablast 2013-08-05 10:34:08 -06:00
  • 6f64568ef8 A bit of html cleanup and added <pre> style. Steve Cook 2013-08-05 10:31:52 -06:00
  • b002233b02 Updated some of the content and put some comments about possibly removing internal gigablast notes. Steve Cook 2013-08-05 10:17:41 -06:00
  • 1466b186dc Commented out two unused variables (dt, zadj), to remove compiler warnings. Steve Cook 2013-08-05 10:16:57 -06:00
  • d35d337f84 Merge pull request #1 from coconutpilot/master Gigablast 2013-08-05 04:47:47 -07:00
  • 0783c7395e Copied these global vars from main.cpp to fix compilation error David Sparks 2013-08-04 22:37:01 -07:00
  • f6e560c1f4 Initial file population. Matt Wells 2013-08-02 13:12:24 -07:00
  • d43acab215 Initial commit Gigablast 2013-08-02 13:07:43 -07:00