Files
Michael Peter Christen acb77bd68a implemented (most of)
https://github.com/yacy/yacy_search_server/issues/727
some refactorings done as well to support multiple user agents instead
of only one; per request then is one of those user agents selected, not
one random per session.
Also: made sure that no robots.txt is loaded any more in case that the
user agent is not a robot user agent.
2025-08-16 13:33:39 -06:00
..
2024-07-21 18:02:58 +02:00
2025-08-16 13:33:39 -06:00