Michael Peter Christen acb77bd68a implemented (most of) ...

https://github.com/yacy/yacy_search_server/issues/727
some refactorings done as well to support multiple user agents instead
of only one; per request then is one of those user agents selected, not
one random per session.
Also: made sure that no robots.txt is loaded any more in case that the
user agent is not a robot user agent.

2025-08-16 13:33:39 -06:00

..

Blacklist.java

Add option to add host to default blacklist from search result

2022-02-09 19:42:04 +01:00

BlacklistFile.java

applying precompiled CommonPattern.COMMA.split to all places where

2015-01-29 01:46:22 +01:00

BlacklistHelper.java

Enhance notability of current blacklist by diff color in header

2022-02-06 09:43:59 +01:00

BlacklistHostAndPath.java

Blacklist import and update performance improvements.

2017-01-06 12:24:31 +01:00

FilterEngine.java

Do locale independant case conversion on hosts, schemes, and file exts.

2017-12-19 13:52:05 +01:00

LoaderDispatcher.java

implemented (most of)

2025-08-16 13:33:39 -06:00

RegexHelper.java

avoid NPE in regex checker

2013-04-20 10:53:49 +02:00