Commit Graph

2 Commits

Author SHA1 Message Date
Ai Lin Chia
3bf9f64109 Fix valgrind invalid read error on Robots parsing 2016-05-24 12:06:43 +02:00
Ai Lin Chia
0ae20dbfee Add more unit test for RobotRule & unit test for real robots.txt found in the wild 2016-04-05 23:21:50 +02:00