207c268974
Removed unused State2::m_isLocal
2017-05-11 14:43:28 +02:00
7db9c4354e
Removed non-renetrant version of iptoa()
...
Mass-change. Many places it could have been done in a better way (eg. calculate nice name for UdpSlot peer once and not for every log line).
2017-05-10 17:54:00 +02:00
45ad44939a
Catch std::bad_alloc and not '...'
2017-05-07 20:51:33 +02:00
702f40f596
Removed default value of parameter useQueryStopWords in Query::set2()
2016-12-22 12:11:15 +01:00
f77c24db91
#include clean up HashTableT.h
2016-12-08 17:04:38 +01:00
fb24cba26b
Fix content type from test/xml to text/xml
2016-11-23 12:49:49 +01:00
4c5cef50cd
Move variable declaration closer to where it's use. Combine two identical if blocks
2016-11-23 12:49:10 +01:00
9170bba7cc
Remove commented out code
2016-11-23 12:48:32 +01:00
0e96613abf
Changed direct access to Host::m_*http/httpsPort to methods
...
Create getInternalHttpPort()/getInternalHttpsPort()/getExternalHttpPort()/getExternalHttpsPort().
Changed references to Host::m_httpPort/m_httpsPort/m_externalHttpPort/m_externalHttpsPort.
Note: multiple references look fishy. The whole "external port" should be verified.
2016-11-17 17:31:42 +01:00
aba937780d
Stop #including Conf.h from header files
2016-11-12 20:24:20 +01:00
d52dabc828
#include cleanup of Url.h
2016-11-12 20:01:44 +01:00
646014244d
Stop using 'shortcut' variables when they makes the code less clear and don't improve performance
2016-11-01 15:40:20 +01:00
7f0ad58826
simplified code flow a bit in PageGet
2016-10-22 20:06:20 +02:00
3ddd7029ac
more various char -> bool fixes. yep, bored today..
2016-10-19 16:23:11 +02:00
ceea3e37ce
removed duplicate functions getLength and getBufUsed in SafeBuf
2016-10-18 21:31:58 +02:00
54349265d4
Moved SafeBuf::cdataEncode() to a standalone function
2016-10-07 14:30:52 +02:00
ab6a835f83
Remove unused parameter hostname, hostnameLen from Conf::getDefaultColl
2016-09-23 23:38:56 +02:00
9078df3d18
Remove niceness from Words
2016-09-23 01:38:58 +02:00
d6c0ee0ace
Remove niceness and quickpoll from Xml
2016-09-23 00:54:04 +02:00
a0e6af7ba6
Fixed (harmless) use of false instead of 0/default
2016-09-04 23:48:53 +02:00
5c73e9e611
More thread safety: gmtime() -> gmtime_r(), asctime() -> asctime_r()
2016-08-09 16:44:39 +02:00
3c2773a928
Removed gbstrlen()
...
gbstrlen() just checked for NULL and called gbshutdownAbort(). Dereferncing NULL on mordern platforms cases a SIGSEGV which is cought by our signal handler and .... gbshutdownAbort() is called. So gbstrlen() was superfluous and complicated static analysis.
2016-07-28 17:04:35 +02:00
f3f5eefcb6
First batch of changes streamlining emergency shutdown code
2016-06-20 12:30:26 +02:00
3227b67ff0
More constness in Page*.cpp (mostly const char* for string literals)
2016-05-22 15:47:17 +02:00
d40ecb2f8e
Replace INT32/INT64 and likes with PRId32 and likes. Add space before definition.
2016-05-20 09:18:32 +02:00
f6fab65a6d
Removed unused members of local structs
2016-04-08 11:20:50 +02:00
7e21e73603
Make url member private. Remove unused functions
2016-03-03 14:34:31 +01:00
c46a4c5841
Remove unused variable/functions from XmlDoc
2016-03-02 22:22:49 +01:00
b69c90df10
Remove m_boolFlag variable
2016-02-28 13:03:02 +01:00
7b45665e17
Added const qualifier to some APIs
...
A few casts back to non-const were necessary in order to keep the patch size
manageble.
2016-02-26 10:29:13 +01:00
79978dabad
Remove commented out codes. Encode HTML entities when viewing in HTML format to prevent breaking UI.
2016-02-16 12:35:45 +01:00
5d8aea28bc
Remove unnecessary input variables from Xml::set
2016-01-27 11:22:49 +01:00
bed3182988
Use meta tags (og:title & title) & title tag when available for generating title
2016-01-15 15:53:14 +01:00
55c6854da7
Remove unused variable
2016-01-14 13:52:33 +01:00
2c14f659e4
Remove similar/unused Words::set methods
2016-01-12 11:46:28 +01:00
3cc7a032e5
Remove unused/'constant' variable in Matches::addMatches. Modify int16_tcuts & similar to shortcuts & similar.
2016-01-04 16:00:39 +01:00
5a697bee7b
Remove BGCOLOR define
2015-12-22 10:23:19 +01:00
f8e9dac6de
Removed AutoBan, dmoz & related code (Categories and related Msg/Db), scraping code.
2015-12-11 21:56:05 +01:00
4286fe3bc3
More cleanup & formating changes
2015-12-10 12:12:50 +01:00
0b98f2c337
Remove some unused methods/class. Minor restructuring of test files.
2015-12-10 12:12:50 +01:00
80f7c4017f
Remove Words::m_version
...
Removed m_version memeber which was write-only. Removed version parameter to
set() methods.
2015-11-30 16:24:58 +01:00
29f4afa20d
Fix use of uninitialized data
...
If the query was missing when getting a cached page then code would highlight
using random words from an uninitialized buffer. When searching for a title to
put at the top of the table-embedding of cached pages it would search for <title>
in the allocaced buffer size and not the used buffer size.
2015-11-30 15:33:48 +01:00
eaeb641680
Remove uncompiled/unused files
2015-11-05 12:01:47 +01:00
34ec49e804
get mike's super long query working
2015-07-13 14:59:44 -06:00
90456222b6
now we add the spider status docs as json documents.
...
so you can facet/sortby the various fields, etc.
2015-03-19 16:17:36 -06:00
87285ba3cd
use gbmemcpy not memcpy so we can get profiler working again
...
since memcpy can't be interrupted and backtrace() called.
2015-01-13 12:25:42 -07:00
adcef39376
Merge branch 'diffbot-testing' into diffbot-matt
...
Conflicts:
Collectiondb.cpp
Collectiondb.h
Conf.cpp
Conf.h
Msg39.cpp
PageEvents.cpp
PageResults.cpp
PageTurk.cpp
Pages.cpp
Parms.cpp
Posdb.cpp
Proxy.cpp
Query.cpp
Query.h
RdbBase.cpp
RdbMap.cpp
Repair.cpp
Repair.h
SafeBuf.cpp
Spider.cpp
Tagdb.cpp
TopTree.cpp
XmlDoc.cpp
main.cpp
2014-11-20 16:53:07 -08:00
931a1c4bc6
good checkpoint. quite a few fixes.
2014-11-17 18:13:36 -08:00
69ef3c14ef
fixes for repair/rebuild functionality.
...
more to come.
2014-11-13 13:04:28 -08:00
96b8197ad3
now it compiles with -m32
2014-11-10 14:45:11 -08:00
