Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-06-19 03:46:08 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 18c7563dbe Extend DCEntry.getLanguage convert to ISO639-1 codes for more languages by using icu.ULocale for languages not already covered (ICU normalizes to ISO639-1 2 char codes). Add test class Use DublinCore vocabulary declarations in DCEntry and SurrogateReader for easier usage debugging, Init SurrogateReader.inputSource on first use. reger 2017-03-05 02:26:10 +01:00
  • ce87025462 further avoid to set connect info properties as header value following comment "use of properties as header values is discouraged" in case where (proxy)HTTPClient overwrites values with supplied url. Use defined request.referer procedure in response class. reger 2017-03-04 22:45:17 +01:00
  • cd4d891ea4 use pre-defined "Connection" header key, replace depreceated reger 2017-03-04 19:41:31 +01:00
  • 5b03feb776 Fixed unresolved pattern case on /yacysearchlatestinfo.json api luccioman 2017-03-03 13:46:44 +01:00
  • 0173b0bc32 Added an advanced settings page for referrer policy settings. luccioman 2017-03-03 12:05:30 +01:00
  • 81963a89fe fix proxyservlet response url to respect http scheme if a relative Location header is returned. reger 2017-03-03 00:21:56 +01:00
  • 9d9f86dcdd Updated Archive-It heuristics URL. luccioman 2017-03-01 09:43:00 +01:00
  • cdcd923375 Privacy enhancement : added settings to control referrer policy. luccioman 2017-02-28 18:11:54 +01:00
  • 86534a56f7 fixed ReindexSolrBusyThread new and unexpected repeat of same query with low number of found documents - by adding additional end condition to remove processed query with number of found docs <= process-chunck-size. reger 2017-02-27 23:00:46 +01:00
  • 0aa0dd0b5b fix delta time calculation in PerformanceSearch_p for the 1. entry (INITIALIZATION displayed absolute date, set delta to 0 for 1. entry) reger 2017-02-27 01:04:31 +01:00
  • 13c5c09518 Fixed datacite.org heuristics base url. luccioman 2017-02-26 11:03:15 +01:00
  • 275c0cddd1 Adjust DefaultServlet test case to recent change, depreciate unused CONNECTION_PROP_PROTOCOL (also as it might be misleading with getProtocol vs getScheme) reger 2017-02-26 02:39:52 +01:00
  • 41e2ee0eca Fix call parameter for ConnectionInfo in MonitorHandler (expected scheme e.g. http, was protocol version). Depreceate obsolete custom X-...-Scheme header constant. Use existing FORMAT_ANSIC Dateformatter in HeaderFramework. Correct htmlParserTest (del one not intended println) reger 2017-02-25 23:55:17 +01:00
  • 9e626f6b00 Added a hint title for required fields in the Solr Schema editor luccioman 2017-02-24 11:09:42 +01:00
  • ac766327d3 Switched a few more Solr fields from strictly mandatory to optional luccioman 2017-02-24 11:08:18 +01:00
  • f254fcfc67 fix htmlParser <script> text extraction on code containing expression recognized as tag like 1<a reported in https://github.com/yacy/yacy_search_server/issues/109 reger 2017-02-24 01:25:32 +01:00
  • 2f191e0e1c Improved MultiprocotolURL non ASCII characters support. luccioman 2017-02-23 11:09:43 +01:00
  • 18e8b3a220 Merge branch 'escape' of https://github.com/sinkuu/yacy_search_server luccioman 2017-02-23 11:03:05 +01:00
  • 562fc14eb9 Merge pull request #110 from goofy-bz/patch-1 luccioman 2017-02-23 07:52:55 +01:00
  • 72a1bc0af1 Fixing some typos goofy-bz 2017-02-23 01:13:31 +01:00
  • 7419989de3 Correct dublincore title property text to lowercase in htmlresponsewriter, remove unused (carry over) local variable Do the same for other responsewriter. reger 2017-02-23 00:27:56 +01:00
  • 4fdc11cae8 Update SearchEvent.java Burkhard 2017-02-22 02:01:48 +01:00
  • cdc7f3e431 Switched some Solr fields from mandatory to optional luccioman 2017-02-21 22:59:11 +01:00
  • 7c188ad092 Add extract of queries.log in form of top search word cloud (last 7 days) to AccessTracker_p.html (Network Access -> Local Search Log page). It displays top 20 words of search queries. reger 2017-02-20 23:27:33 +01:00
  • 3475d8c1a9 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2017-02-20 10:48:44 +01:00
  • c68a8be2d9 Refactored and enforced Solr mandatory fields for proper operation luccioman 2017-02-20 10:48:07 +01:00
  • 334c70c37a correct fromDate init value on missing param in api/timeline_p servlet revert test modification from last commit in AccessTracker.main reger 2017-02-20 00:14:14 +01:00
  • cc770512d5 add hint of query syntax in AccessTracker log (qs=normal querystring, sq=solr-querystring) to allow to filter simple text queries for processing, remove toString for counter parameter use more predefined constants in solrservlet reger 2017-02-19 05:23:17 +01:00
  • e5858bc8c8 Fixed a NullPointerException case possible on Index Export luccioman 2017-02-17 11:09:30 +01:00
  • 7e53860fc7 fix NPE in HTMLResponseWriter on missing document title reger 2017-02-16 02:36:24 +01:00
  • 5e8879beb7 Reduce self generated content for text_t (visible text index field) to avoid repeat of tokenized url as description, continuation of 7e09bff4a1 1409cabe8b Add some javadoc, and not needed remove of omitted fields in postprocessing. reger 2017-02-16 01:43:14 +01:00
  • 6ec6ab55ba removed faroo news from default opensearch config As @luccioman informed, it's only useable with a free api key http://www.faroo.com/hp/api/api.html http://blog.faroo.com/2013/06/30/faroo-introduces-an-api-key/ reger 2017-02-15 23:26:54 +01:00
  • 6e89d125f2 Added robots.txt support for heuristics federated search. luccioman 2017-02-15 15:04:40 +01:00
  • a46b232bf1 Use java.net.URLDecoder sinkuu 2017-02-11 16:10:14 +09:00
  • 7e6e14a406 adjust translation to renamed configparser_p.html reger 2017-02-14 02:30:26 +01:00
  • a011a97de9 make ConfigParser a protected page, for consistent behavior of locked menu items. reger 2017-02-14 02:04:42 +01:00
  • f85aaa7c76 update opensearch conf - remove suche.sueddeutsche.de apparently they've revoked the participation in opensearch initiative. reger 2017-02-14 00:31:32 +01:00
  • bf16de29c1 Added support for HTML OpenSearch results. luccioman 2017-02-13 19:11:17 +01:00
  • a79194a102 upd to Jetty-9.2.21.v20170120 reger 2017-02-11 19:53:27 +01:00
  • 4306f4d9a3 Upgraded Apache Ant to 1.10.1 in the Docker alpine flavor image luccioman 2017-02-10 09:40:42 +01:00
  • 54405577aa Replaced absolute redirection locations by relative ones when possible. luccioman 2017-02-09 16:42:21 +01:00
  • 1857651988 Added a new Debug/Analysis advanced settings subsection. luccioman 2017-02-09 11:05:06 +01:00
  • 526f2d6a8b Fixed NPE case occurring when local solr index is disabled in search. luccioman 2017-02-09 10:59:41 +01:00
  • def55ec166 Improved termination of timed out remote solr requests to peers. luccioman 2017-02-06 12:41:24 +01:00
  • 94af489f14 Removed deprecated "localMissCount" prop from yacysearchlatestinfo.json. luccioman 2017-02-03 10:32:31 +01:00
  • 08de58b6d3 Named a Thread without name for easier monitoring luccioman 2017-02-03 09:55:08 +01:00
  • 9a5a124bf2 Distinguished solr connectors thread names for easier monitoring. luccioman 2017-02-03 09:54:29 +01:00
  • f6ad927a14 Refactored the DHT-Trigger section in Performance_p.html page. luccioman 2017-02-01 18:44:42 +01:00
  • 85d8173b1e Updated French translation for the /Performance_p.html page. luccioman 2017-01-31 16:33:17 +01:00
  • b51fd9467c Fixed unresolved pattern on directory entries in HostBrowser.xml api. luccioman 2017-01-31 09:20:19 +01:00
  • f6b08443f0 adjust column layout in Settings_Proxy.inc reger 2017-01-30 22:44:28 +01:00
  • 21ab41d8d6 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2017-01-28 10:20:25 +01:00
  • 95b63f5126 Added a CSS class for infobox block. luccioman 2017-01-28 10:19:39 +01:00
  • 8ce8e23e7d Update language file de & master, remove obsolete "Augmented Browsing" reger 2017-01-28 01:13:57 +01:00
  • 1f497ccad5 Add consistency check for related index fields upon load and save of index schema. To assemble the original link url for out-/inboundlinks, icons and pictures the *_protocol_sxt and *_urlstub_sxt is needed (due to the used data-reduced storage methode). Auto-enable *_protocol_sxt if *_urlstub_sxt is enabled. to be able to correctly assemble the original link url. reger 2017-01-28 00:36:03 +01:00
  • 68afe900d0 Added user-friendly controls over disk usage configuration settings. luccioman 2017-01-27 15:47:15 +01:00
  • 95d2a28599 adjust the Field-Reindex Thread to verify and update the document id in case hash (ID) doesn't match document url (sku field). reger 2017-01-26 23:49:15 +01:00
  • e6e4ccaa00 Merge pull request #98 from Velociraptor85/patch-2 Michael Christen 2017-01-26 06:37:29 +01:00
  • a7fd47b3aa Merge pull request #105 from ivar/patch-1 Michael Christen 2017-01-26 06:29:42 +01:00
  • cfd21aaa10 Update README.md - removes deprecated URL Ivar Vasara 2017-01-25 20:36:48 -08:00
  • d0182e4797 Improved Index Browser accessibility with semantically richer html tags. luccioman 2017-01-26 01:13:32 +01:00
  • fc01b69eca Fixed local image search pagination regression. luccioman 2017-01-25 09:54:39 +01:00
  • 54ffd925dc Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2017-01-24 17:14:49 +01:00
  • 4c65321aae Updated master xliff file with missing entries for HostBrowser.html. luccioman 2017-01-24 17:14:14 +01:00
  • 02d0b3172c Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2017-01-24 15:56:37 +01:00
  • d4f45cf05e added dc.date.modified and dc.date.created to date parser Michael Peter Christen 2017-01-24 15:56:29 +01:00
  • 254060bda1 Index Browser : fixed display of "Count colors" for authorized users. luccioman 2017-01-24 11:49:15 +01:00
  • 96b7ddcef3 Updated French translation of HostBrowser.html luccioman 2017-01-24 11:38:56 +01:00
  • c82c8351dd Fixed Index Browser page HTML validation errors and switched to HTML5. luccioman 2017-01-24 09:40:43 +01:00
  • f9180fabc4 assure that RWI Index.Segment IODispatcher is not blocking on shudown waiting on a semaphore permit. see desc. http://mantis.tokeek.de/view.php?id=723 reger 2017-01-24 01:51:28 +01:00
  • 826e5bbadd Documented /HostBrowser.html related configuration settings luccioman 2017-01-23 16:05:51 +01:00
  • 9adba36754 Fixed "-UNRESOLVED_PATTERN-" admin parameter in "load & index" links. luccioman 2017-01-23 14:54:37 +01:00
  • 4e2bc644cb Display Index Browser links requiring auth only when authenticated. luccioman 2017-01-23 14:49:02 +01:00
  • e61ee180a7 Group all proxy settings on System Administration by adding settings of UrlProxyAccss page (moved from deleted AugmentedBrowsing_p), adjust submenu (remove Augmented Browsing) and translation files. reger 2017-01-22 23:58:46 +01:00
  • 39e081ef38 Fixed display of crawler pending URLs counts in HostBrowser.html page. luccioman 2017-01-22 12:31:14 +01:00
  • 870a5eae26 Removed temporary test main method commited by mistake. luccioman 2017-01-22 12:19:43 +01:00
  • df80c57842 add ukr and pol to DCEntry.getLanguage ISO639-2 3-char language code conversion to deliver uk, pl 2-char code and use if else to return on match reger 2017-01-22 00:01:18 +01:00
  • 8d790ab783 delete outdated and unmaintained Netbeans project Netbeans has good build-in maven support which is a supported and maintained build env, making special and additional NB setting obsolete. reger 2017-01-21 01:53:43 +01:00
  • 85cd19962f fix the missing solr-5.5.2.jar delete from prev. commit reger 2017-01-21 00:35:05 +01:00
  • 890c6dcdc6 upd to solr-5.5.3 minor bugfix version reger 2017-01-21 00:26:04 +01:00
  • c4017f2e87 upd to commons-compress-1.13.jar hide external icon on forge logo (was also out of position in IE) reger 2017-01-20 02:15:11 +01:00
  • e048e74072 Added an optional parameter to webstructure.xml api. luccioman 2017-01-19 12:30:44 +01:00
  • 581b00cc20 remove obsolete lastmodified calculation in WebgraphConfig reger 2017-01-17 23:45:56 +01:00
  • 5c8958bcea Updated Javadoc and Junit tests for the WebStructureGraph class. luccioman 2017-01-17 17:01:56 +01:00
  • 17b7c92009 Made sure webstructure.xml API produces valid XML. luccioman 2017-01-17 15:59:55 +01:00
  • d9766ca981 Fixed WatchWebStructure_p.html render to include https URLs. luccioman 2017-01-16 18:41:58 +01:00
  • ed3dd5e31a Fixed webstructure.xml API used with a domain name 'about' parameter. luccioman 2017-01-16 16:41:06 +01:00
  • 0da1e6ba16 Factored code re-implementing DigestURL.hosthash() method. luccioman 2017-01-16 10:18:42 +01:00
  • 86adfef30f Added automated unit tests and perfs test for WebStructureGraph class. luccioman 2017-01-13 16:10:59 +01:00
  • f793d97e56 Factored common code with DigestURL.hosthash() luccioman 2017-01-13 16:05:46 +01:00
  • 9cea7cbb10 Detailed some Javadoc related to /api/webstructure.xml usage. luccioman 2017-01-12 17:52:47 +01:00
  • 007e2afa6e Start to rename "Augmented Browsing" to "Web Proxy ..." / "View via Proxy" The augmented Browsing option was reduced to the web proxy functionallity. Augmented browsing is not available and no known plan exist to reimplement alteration of result pages with additional information. reger 2017-01-12 01:36:30 +01:00
  • c9889991b9 Fixed 2 failing JUNit tests. luccioman 2017-01-09 17:59:01 +01:00
  • bdaef80a55 Ignore generated Javadoc with git SCM. luccioman 2017-01-09 16:45:31 +01:00
  • 6a4d51d8f9 Cleaned up some Javadoc warnings. luccioman 2017-01-09 16:44:47 +01:00
  • 86dc198698 Fixed some JavaDocs broken links. luccioman 2017-01-09 09:57:53 +01:00
  • c78e2f3b4b Fixed maven assembly base directory to match last main YaCy binaries. luccioman 2017-01-09 09:54:14 +01:00
  • 16beb551ea fix DC.Elements namespace in DublinCore vocabulary class delete redundant (unused) DCElements. reger 2017-01-07 18:24:29 +01:00
  • 339f005ced Blacklist import and update performance improvements. luccioman 2017-01-06 12:24:31 +01:00
  • e3892b0957 Added some JavaDoc. luccioman 2017-01-06 11:23:40 +01:00