Commit Graph

  • ab12551c9c doc update mwells 2014-09-16 09:43:35 -0600
  • 595e02c782 Merge branch 'testing' mwells 2014-09-13 09:20:31 -0700
  • 1381a56928 shell for new injection code mwells 2014-09-12 18:03:31 -0700
  • 76af6b0732 keep redir hopcount same as parent mwells 2014-09-12 08:07:42 -0700
  • 53bead7049 formatting fix mwells 2014-09-12 03:17:47 -0700
  • 27d38059aa documentation updates mwells 2014-09-12 03:09:06 -0700
  • c093a70c25 update some html mwells 2014-09-12 03:03:24 -0700
  • 5df26b8bd4 sigalrm fixes mwells 2014-09-12 02:42:00 -0700
  • 5d7e7c2016 fix problem failing qatest mwells 2014-09-11 17:04:08 -0600
  • 3d0c6cf67f serp filter dropdown fix mwells 2014-09-11 16:35:30 -0600
  • 37a4ba9703 minor admin serp filter bar update mwells 2014-09-11 16:25:30 -0600
  • 5980d48471 fixed json parser bug Matt Wells 2014-09-11 13:40:07 -0700
  • fbd288d2a5 fix inifinite loop when rebalancing. was trying to read more bytes from titlerec than what it could support. Matt Wells 2014-09-11 12:11:34 -0700
  • ed75621ad3 Merge branch 'testing' into diffbot-testing Matt Wells 2014-09-11 10:22:01 -0700
  • b50d3ee016 more select polling fixes mwells 2014-09-11 07:16:39 -0700
  • 0b230995ee more fixes for inner loop code mwells 2014-09-11 05:56:47 -0700
  • ee070d9378 try to fix inner loop logic some more mwells 2014-09-11 05:26:14 -0700
  • 10f897e5be use gbsystem() not system() so it can turn off alarms since it forks. mwells 2014-09-11 05:01:55 -0700
  • 2870c1b0be fixed system call hanging. i guess system calls fork and it did not like or SIGALRMs because when i set the iterm off for those it was ok. mwells 2014-09-11 04:57:27 -0700
  • 8b1f19d077 put 'hosts' link back at user demand. mwells 2014-09-10 15:05:33 -0700
  • e5aa7a0247 fix loop stuff some more. now seems fast again. mwells 2014-09-10 14:56:56 -0700
  • 082b39e027 turn off images for qa tests. fix loop stuff some more. seewms to be slower mwells 2014-09-10 14:13:39 -0700
  • cc76a36458 sort str facets by their int values (str hashes) for consistency for now since we do not know the strings themselves at that time in Msg40.cpp mwells 2014-09-10 08:22:11 -0700
  • 8f14207fc9 fix core dump in qa testing mwells 2014-09-10 08:08:02 -0700
  • 46f6b55298 makefile fixes mwells 2014-09-10 08:01:05 -0600
  • d74df80f50 fix json parser core mwells 2014-09-10 06:58:18 -0700
  • 3cbf38be61 Merge pull request #19 from miketung/diffbot-testing Gigablast 2014-09-09 16:36:30 -0700
  • 0998a4f858 When printing facets in format==FORMAT_JSON: facets can have multiple values. Needs to be a JSON array. Mike Tung 2014-09-09 15:12:33 -0700
  • dc140e4224 fix /admin/security api mwells 2014-09-09 07:11:41 -0700
  • da63cb1f17 more website updates for gigabot guide mwells 2014-09-06 21:34:36 -0700
  • f4e8a8260b update faq.html mwells 2014-09-06 21:17:58 -0700
  • 8919e95ced turn on images by default now. mwells 2014-09-06 21:13:38 -0700
  • f21f2a282a gigabot advice updates mwells 2014-09-06 21:05:11 -0700
  • 7c5ba792d8 added spider log dropdown to search filters bar mwells 2014-09-06 13:05:18 -0700
  • e41b6109b9 Merge branch 'diffbot-testing' into testing mwells 2014-09-06 12:17:43 -0700
  • caf8d46b43 index spider status msg for force deletes mwells 2014-09-06 12:15:58 -0700
  • da4f6782fb syn fix for 'sports' when lang is unknown. we default to english rather than have no synonyms, since it is in french as well. mwells 2014-09-06 10:49:22 -0700
  • b30bc6cb20 fixed query reindex for query delete. added qa test. mwells 2014-09-06 10:38:32 -0700
  • 44f00da70e facet fixes mwells 2014-09-05 10:21:02 -0700
  • 1f61cb0d05 facet fixes mwells 2014-09-05 07:19:22 -0700
  • 01bf306890 fix json facet output. mwells 2014-09-04 22:44:44 -0700
  • 79ec8bd268 updates help/syntax page mwells 2014-09-04 22:36:28 -0700
  • 83f165e1b3 fix facets some more. was not computing over entire set of docids, just the winners. mwells 2014-09-04 22:32:58 -0700
  • 8dcb9363f9 more facet fixes mwells 2014-09-04 21:07:34 -0700
  • efc7f3c064 support facet ranges now like gbfacetint:gblang,0-1,1-2,2-3,3-4,5-6,6-18 mwells 2014-09-04 20:41:37 -0700
  • ccaad9d5da first stab at facet range buckets for histograms. mwells 2014-09-04 14:55:03 -0700
  • df21306ffe Merge branch 'master' into testing mwells 2014-09-04 11:14:10 -0700
  • f8487e7132 users.html update mwells 2014-09-04 11:13:32 -0700
  • f9e5869aed Merge branch 'master' into testing mwells 2014-09-04 11:13:21 -0700
  • 74385939c6 put dropped requests in bold red mwells 2014-09-04 11:01:49 -0700
  • 3623a49d6a we no longer use write callbacks they seem pointless. mwells 2014-09-04 10:56:27 -0700
  • 25669a94f7 Revert "Revert "comment out some webstuff"" mwells 2014-09-04 10:49:13 -0700
  • 1a3f1f6d09 Revert "Revert "oops forgot loop.h"" mwells 2014-09-04 10:48:48 -0700
  • be435d83bb Revert "oops forgot loop.h" mwells 2014-09-04 10:47:40 -0700
  • e392798d3f Revert "comment out some webstuff" mwells 2014-09-04 10:47:31 -0700
  • e4dc7c6d32 comment out some webstuff mwells 2014-09-04 10:44:25 -0700
  • 8be64f69e4 Merge branch 'testing' mwells 2014-09-04 10:43:08 -0700
  • a511274e47 udpserver slot overload fixes mwells 2014-09-04 10:41:57 -0700
  • 0aaea60b6b oops forgot loop.h mwells 2014-09-04 10:35:07 -0700
  • ea30e8d9b2 try to fix request rate limiting jam up in udpserver.cpp. pretty up Loop.cpp some more which now uses select(). mwells 2014-09-04 10:28:40 -0700
  • ed66bf57b7 git ride of select on writefds. pretty pointless unless we tried to write to a socket before and the buffer was full so the write failed. then we'd want to know if it was ready for writing again i guess.... anyway i'm not so sure that happens a lot so i took it out and i guess we'll see what happens. also added more udp/loop debugging statements. Matt Wells 2014-09-03 21:24:51 -0700
  • 0bcecfb0ce Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing Matt Wells 2014-09-03 20:03:38 -0700
  • 217fb1f1e9 Merge branch 'testing' into diffbot-testing Matt Wells 2014-09-03 20:00:04 -0700
  • 9e1332d34d Merge branch 'testing' into diffbot-testing Matt Wells 2014-09-03 11:32:47 -0700
  • 4bf7826acf limit pdftohtml to 30s mwells 2014-09-03 11:30:54 -0700
  • 21c32be2b2 try to tune query performance with higher max outstanding thread defaults. mwells 2014-09-03 11:08:01 -0700
  • 7e3215d176 verified SIGCHLD being sent when thread completes mwells 2014-09-03 11:05:15 -0700
  • c1a8053b52 compiler warning abatement mwells 2014-09-03 10:55:29 -0700
  • 7bd3b42477 comment out unused code. make thread cleanups basically untimed. mwells 2014-09-03 09:48:43 -0700
  • 55a1a4626f more signal count stats mwells 2014-09-03 09:18:30 -0700
  • bb76ffa8b2 do not bother doing fcntl(F_SETSIG,fd) since we use select() now. however we still do get thread-cleanup signals from a thread when it is done. mwells 2014-09-03 09:02:57 -0700
  • cd97944d1e fix cpu usage reporting mwells 2014-09-03 08:38:43 -0700
  • 959187893e default parm val updates for easier max spiders setting mwells 2014-09-03 07:48:07 -0700
  • 5931fb5ff1 raised MAX_SPIDERS from 100 to 300. watch out for oom though. mwells 2014-09-03 07:26:17 -0700
  • 5a508cad69 upped MAX_SPIDERS from 100 to 300. watch out for oom though. mwells 2014-09-03 07:25:40 -0700
  • 7866ff1196 added some files mwells 2014-09-03 06:40:04 -0700
  • d9462e740b handle threads on EINTR from select() in Loop.cpp. mwells 2014-09-03 06:39:19 -0700
  • 82edb9814f Merge branch 'master' into testing mwells 2014-09-03 06:10:03 -0700
  • 19feb94f29 imported new Loop.cpp using select() from testing branch so ppl can use it on ubuntu 14.04 mwells 2014-09-02 22:22:39 -0700
  • 71e4574c71 added status file type to search filter bar mwells 2014-09-02 22:17:27 -0700
  • 048aa60fd9 try polling fds now with select(). real-time signals were somewhat of an artifact from bygone days and the select() call when done right seems to not use any more cpu. plus it should work well with apple os x and cygwin etc. mwells 2014-09-02 22:05:15 -0700
  • 8f92a6d767 fix for diffbot. use objects not results for global-index. Matt Wells 2014-09-02 15:02:12 -0700
  • 2c81157031 fix search filters bar not coming up mwells 2014-09-02 14:07:04 -0700
  • c82c41540c if crawlbot, do not overwrite sitenuminlinks stuff in tagdb, because we imported that from big se. Matt Wells 2014-09-02 13:45:58 -0700
  • c392e6eade fix minserpscore parm. support TYPE_DOUBLE parms. mwells 2014-09-01 20:37:17 -0700
  • 91ab558eb5 fix widget from initializing with serps because 'cd' was a text node, "No Results Found..." and did not have the getAttribute() function available thus causing a javascript error. mwells 2014-09-01 19:24:04 -0700
  • 65e533bbb7 website updates mwells 2014-09-01 17:23:15 -0700
  • 58d8861a34 widget page updates mwells 2014-09-01 17:04:08 -0700
  • 48a3239276 spider status widget fixes mwells 2014-09-01 14:22:03 -0700
  • 25b79684c5 website gui fixes mwells 2014-09-01 13:31:13 -0700
  • 2ccc4626dc more support for cloud initiative mwells 2014-08-31 21:55:27 -0700
  • 7f622bd416 fixes for cloud support. mwells 2014-08-31 16:23:11 -0700
  • 0aca84a5b2 website updates mwells 2014-08-31 15:35:53 -0700
  • 1bc5fecb33 website updates mwells 2014-08-31 11:11:12 -0700
  • ef8cb47590 website updates. mwells 2014-08-31 10:51:37 -0700
  • 0d4baf228e fix display of dmoz pages mwells 2014-08-31 10:11:16 -0700
  • 754d5b4755 rename admin.html to faq.html etc. file juggling. mwells 2014-08-31 09:51:21 -0700
  • 6a5ad8a3e4 bio update mwells 2014-08-30 22:41:44 -0700
  • c68874240a gigabot advice blurb fixes mwells 2014-08-30 22:26:12 -0700
  • 253ed05074 gigabot advice blurb. mwells 2014-08-30 22:14:53 -0700