27 Commits

Author SHA1 Message Date
c0766cda9b Removed XmlDoc::m_slot by using a state structure in msg20.cpp 2016-09-08 15:50:34 +02:00
b744a9c47c Removed unused members from PageResults.h: State0 2016-08-09 12:40:03 +02:00
abeabe1e71 Made functions local in PageResults.*
Local functions made local, unused functions removed.
2016-03-12 16:02:42 +01:00
ab0b9d03ea Standardize header guards 2016-03-08 22:16:02 +01:00
f8e9dac6de Removed AutoBan, dmoz & related code (Categories and related Msg/Db), scraping code. 2015-12-11 21:56:05 +01:00
0b98f2c337 Remove some unused methods/class. Minor restructuring of test files. 2015-12-10 12:12:50 +01:00
6184e376a4 Cleanup related to languages/Compiler warnings 2015-11-23 14:45:18 +01:00
ed9c5c580a some debug statement to track down the socket snafu on host 0 2015-09-10 19:18:48 -07:00
34ec49e804 get mike's super long query working 2015-07-13 14:59:44 -06:00
a2feab9a4a tap in some fixes for running the newly updated smokes
for dealing with the new urls.csv format
2015-04-21 15:20:57 -07:00
48435c55b1 Revert "fix json search results formatting."
This reverts commit 7879537ab6.
2015-03-12 15:42:20 -07:00
7879537ab6 fix json search results formatting. 2015-03-12 14:25:37 -07:00
4e8a42e024 text replacements for bad int32_t substitutions 2014-11-17 18:24:38 -08:00
96b8197ad3 now it compiles with -m32 2014-11-10 14:45:11 -08:00
e7dd8f7956 replace long long with int64_t 2014-10-30 13:36:39 -06:00
7ce45e8712 get html head and tail working again now. 2014-06-21 21:07:38 -07:00
3cf3cddc5c beginning of total parm overhaul.
new injection parms, just need to engage them.
2014-06-12 21:27:06 -07:00
6664faa792 fix printing back-to-back commas when showing
results in json with &icc=1.
2014-05-20 13:23:29 -07:00
2f331d55e5 widget updates 2014-05-06 10:47:57 -07:00
4d059109f1 work on infinite scrolling better updating
so user doesn't lose scrollbar position
2014-05-02 14:33:05 -07:00
5c0d646133 fix invalid json when doing &s=1 2014-04-25 13:46:20 -07:00
58a1feeea5 specify &header=1 explicitly to get json serp header
lest we break our clients parsers
2014-03-05 07:41:59 -08:00
cd6069e5a6 send single space to socket if not streaming
and search results still not ready after 10 seconds.
send it every 10 seconds to prevent client from closing socket.
sped up all downloads, json and csv, but not doing "fuzzy"
deduping of search results, but just deduping on page
content hash. added TcpSocket::m_numDestroys to ensure we
do not send heartbeat on a socket that was closed and
re-opened for another client.
2014-02-13 08:45:13 -08:00
189999509b code checkpoint. time slicing, faster spider code
compiling. now needs debug.
2014-02-04 17:34:43 -08:00
4cbb31e180 added searchbox for dmoz pages/sites. 2013-10-13 15:45:12 -07:00
1d133e87c9 just print dmoz pages verbatim for now.
later we can show the dmoz entries as
search results.
2013-10-10 23:18:57 -07:00
f6e560c1f4 Initial file population. 2013-08-02 13:12:24 -07:00