Commit Graph

14 Commits

Author SHA1 Message Date
fc2bf1a205 Add Url validity check (currently disabled) 2017-09-26 22:25:19 +02:00
72a58f1b2b Keep statistics on crawl bans 2017-09-08 13:18:45 +02:00
31136a6346 Block urls ending with %00 to %1F 2017-09-08 12:01:21 +02:00
548f964fbb Enable block of IP based urls 2017-09-06 16:52:18 +02:00
19b09f12e7 Count detailed staistics for isUrlBlocked() 2017-08-24 16:52:17 +02:00
d2643169de Add encoding statistics so we can keep track of what we detect as encoding, and what language we detect it as 2017-05-05 12:44:03 +02:00
1dc77e8ec3 Removed PingInfo::m_socketsClosedFromHittingLimit
Also removed Stats::m_closedSockets, and moved dumping to Statistics.cpp
2017-05-01 12:08:24 +02:00
ad833cae73 Add BigFile statistics to Statistics 2017-03-28 11:06:16 +02:00
5cf4e51002 Add error code & qlang to query statistics 2017-03-27 12:47:44 +02:00
483f3eb719 Rename Statistics header guard to prevent warning from clang 2016-07-22 13:59:55 +02:00
4c9048236f Add gb spider statistics 2016-07-04 11:31:02 +02:00
be208fefaa spidering statistics: changed/unchanged documents 2016-06-20 17:38:48 +02:00
8670d6c318 statistics for spidering (incomplete) and RdbCache 2016-06-14 12:51:33 +02:00
a1dacc4070 histogram statistis on queries 2016-06-13 16:54:56 +02:00