Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-12-13 04:14:35 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
master
yacy_search_server/htroot/QuickCrawlLink_p.html
Michael Peter Christen 57ffdfad4c added a crawl option to obey html-meta-robots-noindex. This is on by 
default.
2013-07-03 14:50:06 +02:00

1.7 KiB
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink