Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-06-19 03:46:08 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 7742579ca4 make a LanguageNavigator availabel, useable for the SearchEvent.naviator plugin (not activated yet). reger 2016-11-21 00:19:11 +01:00
  • 0d3bef659b implement RequestHeader.setCharacterEncoding for legacy header, make sure .getProtocol returns a http version move the patch for Set-Cookie to ResponseHeader (applies only here) reger 2016-11-20 19:30:38 +01:00
  • 5320209963 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2016-11-20 12:13:07 +01:00
  • 83f5e3d715 added+disabled a federate search experiment Michael Peter Christen 2016-11-20 12:13:00 +01:00
  • 4eeb448eb3 use DigestURL in UrlProxyServlet as parameter to pass requested url to handler. UrlProxyServlet splits url in parts to pass it on as parameter and HeaderFramework constructs a url from param parts. This is obsolete if already created url is used (makes HeaderFramework.getRequestURL obsolete = removed) reger 2016-11-20 05:27:33 +01:00
  • 3630fcc458 adjust messages_p servlet to standard header.getPathInfo, too (replacing non standard http header) reger 2016-11-20 04:02:28 +01:00
  • bad8f87998 remove old/obsolete clear text "adminAccount" credential entry from init and setConfig (.,empty) from servlets/code reger 2016-11-20 00:20:47 +01:00
  • 811cf637f8 fix Jetty9YaCySecurityHandler, length check of Basic credential, add comment to SwitchboardConstants.AdminAccount const reger 2016-11-20 00:15:21 +01:00
  • fdcf33f08f fix Domain.stripToHostName for some IPv6 cases add unit test for it reger 2016-11-19 16:37:16 +01:00
  • ac6e198bd1 add unit test for Domains.stripToPort, simplify ipv6 check reger 2016-11-19 06:22:55 +01:00
  • f27531f5ec fix Domains.stripToPort, make ipv6 save reger 2016-11-19 05:56:48 +01:00
  • 67744a8038 fix HeaderFramework.getRequestURL on host with port considering ipv6 host reger 2016-11-19 05:08:11 +01:00
  • 66cc0dd173 refactor: move GSA specific date formatter to GSAservlet adjust return type to String for HeaderFrameWork.getSingle reger 2016-11-19 03:29:23 +01:00
  • d525967999 refactor: move convertHeaderFromJetty to ProxHandler (only used with active proxy not needed for standard servlets) reger 2016-11-19 02:10:21 +01:00
  • 20c9b0138e let User servlet detect static admin with (newer) md5 encoded pwd (complete a old todo) reger 2016-11-19 01:02:05 +01:00
  • 60ba5c117c fix legacy getHeaderCookies to work with cookies from original HttpServletRequest, by moving to RequestHeader. reger 2016-11-18 21:44:16 +01:00
  • 30f8d1e2d7 let RequestHeader.logout succeed w/o throwing exception by default reger 2016-11-18 03:00:30 +01:00
  • b449b0b660 remove login request directly after logout, and add logout from servlet container make logout button red reger 2016-11-18 02:39:53 +01:00
  • 28afd3a2f8 fix UserDB.proxyAuth from header string (take care of prefix "Basic" in header entry) reger 2016-11-18 01:12:14 +01:00
  • fd22d8c08b Upgraded Bootstrap to 3.3.7 and upgraded its related js dependencies. luccioman 2016-11-17 14:17:08 +01:00
  • 0806de8fdc Ensure file input stream are closed in both normal and error cases. luccioman 2016-11-16 15:13:58 +01:00
  • a0dfbaca6a FileUtils : added some JavaDocs and unit test cases luccioman 2016-11-16 15:12:21 +01:00
  • 59448461d3 make use of userInRole for quick login verification reger 2016-11-16 01:42:53 +01:00
  • 2a4d826d9e adjust servlet RequestHeader.getLocale init jvm defaultLocale matching UI language reger 2016-11-15 02:37:03 +01:00
  • 200e7a7292 upd to jsoup-1.10.1 : fixed to Eclipse classpath and Ant configuration. luccioman 2016-11-15 01:13:31 +01:00
  • c55172f629 upd to jsoup-1.10.1.jar reger 2016-11-14 23:10:32 +01:00
  • 9db68acb4f remove obsolete X_YACY... header declarations not in use (no writes, only remove and try to read). Obsolete parameter setupHttpClient reger 2016-11-14 22:53:26 +01:00
  • f72c99474e Network Access servlet : render pure relative HTML links. luccioman 2016-11-14 20:17:35 +01:00
  • 8e9aece786 more use of RequestHeader constant referer, authorization in Jetty9YaCySecurityHandler reger 2016-11-14 04:49:30 +01:00
  • d631fbc019 make more use of the new ServletRequest interface methodes getScheme, getServerPort (in QuickCrawlLink_p & YaCyDefaultServlet) reger 2016-11-14 03:01:15 +01:00
  • 395f2e8946 Make ServletRequest implement the standardized HttpServletRequest interface, to make all readily available information from the original ServletRequest available to YaCy servlets (without converting data to internal structures). The implementation of the common interface allows easier integration of YaCy servlets with the servlet standard (e.g. shared login service with the servlet container etc.) reger 2016-11-14 01:37:16 +01:00
  • 62f75417ef Updated Pattern JavaDoc links to current minimum (1.7) JDK version. luccioman 2016-11-14 00:18:40 +01:00
  • ca4c38a5ba Updated links to external Java and Solr docs to currently used versions. luccioman 2016-11-13 23:34:27 +01:00
  • f45945cada increase use of header const for custom "EXT" header reger 2016-11-13 01:39:14 +01:00
  • 6a0b218ae5 Absolute URLs in yacysearch.* : ensure no downgrade from https to http luccioman 2016-11-12 23:29:25 +01:00
  • 17fc09036e fix cutoff text in button and adjust formatting reger 2016-11-12 21:58:06 +01:00
  • 812abfc868 Converted one more set of URLs to pure relative ones. luccioman 2016-11-12 15:54:35 +01:00
  • 74fec066f4 Converted more URLs to pure relative ones. luccioman 2016-11-12 10:51:54 +01:00
  • 95a60d177e bring back/fix: search results and logo without external icon reger 2016-11-10 22:22:37 +01:00
  • 0f0393e5e3 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2016-11-09 02:40:52 +01:00
  • 7296e3884f Switched even more URLs to pure relative ones. luccioman 2016-11-09 02:40:33 +01:00
  • 49eae79c01 fix Tables.hasIndex check for tablename = key apply same functionality to hasHeap (to not create new table on call hasHeap) reger 2016-11-09 02:33:42 +01:00
  • 042c2868df del abandoned indexcleaner.html, servlet deleted with commit 3bcd9d622b crawler servlet log warning line on failure in one of multiple urls (instead of exception msg) indexcontrolrwi skip not needed type conversion on ranking reger 2016-11-08 23:42:12 +01:00
  • 024b811a7b Switched openstreetmap favicon URL to HTTPS. luccioman 2016-11-08 03:12:43 +01:00
  • 84b81c1af0 Switched more URLs to relative ones when possible. luccioman 2016-11-08 03:05:51 +01:00
  • 731684105a Improved absolute URLs rendering in OpenSearch desc and RSS feeds. luccioman 2016-11-08 02:39:45 +01:00
  • 75802dcf00 Removed a use of the deprecated Seed.getIP() luccioman 2016-11-08 02:31:38 +01:00
  • 669f60223e upd Column.toString to output encoder "{bytes}" used for String and binary Column types reger 2016-11-06 21:02:58 +01:00
  • c9e81d2fa0 fix Column parsing from celldefinition string, without cellwidth def. (outofbound exception) reger 2016-11-06 03:34:24 +01:00
  • e0816ef2e5 use human readable date format in CrawlStacker error message "double in: local index, oldDate = " reger 2016-11-05 19:40:14 +01:00
  • 7cea57008b Use https URLs to load external js scripts in yacysearch_location.html. luccioman 2016-11-04 14:34:52 +01:00
  • 734340c128 Fixed errors for Search portal mode or when peer is not reachable. luccioman 2016-11-04 14:31:22 +01:00
  • 54d879a9b3 Generate HTML relative (to each peer) links from hosted WikiCode. luccioman 2016-11-04 11:21:20 +01:00
  • 3444d947ac Used relative URLs in ConfigPortal preview frames. luccioman 2016-11-04 09:35:03 +01:00
  • 2da5f339f8 Fixed /News.html and /Wiki.html pages in Search Portal mode (issue #87). luccioman 2016-11-03 02:33:36 +01:00
  • 8fe28a83f2 harmonize used lastmodified date for rwi and fulltext in storeDocument reger 2016-11-02 03:43:39 +01:00
  • da0f4ee599 include navigator-plugin output data in json and rss/xml output fix encoding of url for rss fix unresolved-pattern of url in json & xml for domain navigator reger 2016-11-01 22:33:20 +01:00
  • 3d1d297308 refactor namespace navigator as part of navigatorplugin map, this allows the navigator to include counts all matches (rwi+fulltext). Fixing also unresolved_pattern in navigators title (of the counter) The use of inurl: query modifier as filter has not been changed keeping it as soft (unsharp) filter facet. reger 2016-11-01 04:38:47 +01:00
  • c8983805f2 upd IndexControlRWIs servlet, url list table remove unused word distance column (table lists always refs for one word). upd master.lng with recent text changes reger 2016-11-01 02:19:26 +01:00
  • 67f660523b Make navigators underlaying indexfield name accessible in interface use interface in declaration and extend facet check to include navigator field. reger 2016-10-31 18:42:23 +01:00
  • 5eb3ee4e20 Add search navigator interface to allow for additional navigators (plugins) Prepared the first basic navigators (for authors and collections) for the list of SearchEvent.navigatorPlugins and adjusted servlet to use these. - this allows to configure display order of these navigators (by ordering config string) - eventually allows for additional and/or custom navigators using any available index field without need for changing servlets - the Collection navigation has been adjusted to exclude the internal, default robot_* and dht collections from displaying - rwi results are now also checked for navigatior by the refactored navi's reger 2016-10-31 02:17:43 +01:00
  • fd3f58fcaa improve query modifier parsing of "collection:" and possible collision with "on:" in case multiple collection modifier were entered (by mistake) http://mantis.tokeek.de/view.php?id=702 reger 2016-10-31 00:43:01 +01:00
  • 4c7e515769 correct Collection navigatior - search servlet modifier parameter (navigator entries are single collection names, spaces are removed by crawlstart) preparation: for abstraction of navi's reger 2016-10-30 05:19:06 +01:00
  • af39a76bf6 Reduce number of default max. search navigator lines (from 10000) to 100 + make it configurable reger 2016-10-29 04:19:46 +02:00
  • 065bcfba75 Merge pull request #88 from sudheesh001/Patch16 Sudheesh Singanamalla 2016-10-28 08:13:21 +03:00
  • d97da1ddb7 Fixes #16 Updates documentation about cloning and build from source sudheesh001 2016-10-12 17:22:15 +03:00
  • 20a1b29ed3 add simple test case for ReferenceContainer helpful for debugging calculated ranking parameter reger 2016-10-26 01:38:40 +02:00
  • 3cc2af8f92 reduce the mix of absolute and relative internal html page links (prefer relative for same pg or neighbors) to ease proxied access e.g. http://mantis.tokeek.de/view.php?id=701 reger 2016-10-25 03:02:31 +02:00
  • 3c7220bc7b Refacture rwi reference word position and word distance calculation used for rwi ranking. Main changes: - introduce a posintext() to access the stored value. This reduces also mem alloc of position array for WordReferenceRow (index access) - use the positions() array for joined references on multi-word queries if needed (otherwise allow positions() to be null - adjust assignments and the min() max() and distance() calculation accordingly reger 2016-10-23 19:40:02 +02:00
  • f0639d810c Customized name for Threads still using the default "Thread-n" pattern. luccioman 2016-10-22 17:17:21 +02:00
  • c0379c3cd3 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2016-10-22 09:11:50 +02:00
  • db3b9db9c2 Crawl from local file : faster task end when manually terminating crawl. luccioman 2016-10-22 08:23:48 +02:00
  • 78085fad8d Fixed NullPointerException case. luccioman 2016-10-22 08:23:48 +02:00
  • 4c67ed3f8d catch rwi ranking div by zero exception during rwi search result processing worddistance calculation is effected by concurrent update (normalization) of min/max ranking parameter for wordpositions. On update of min/max the exception is raised in distance calc and now catched. This concurrent update and change of ranking results is needed for speed but should be further checked for optimization reger 2016-10-22 00:53:47 +02:00
  • 47af33a04c Advanced Crawl from local file : better processing of large files. luccioman 2016-10-21 13:03:31 +02:00
  • ee92082a3b Updated javadocs : warning about closing stream responsibility. luccioman 2016-10-21 12:48:36 +02:00
  • 6f49ece22f Fixed redirected URLs processing as crawl start point. luccioman 2016-10-20 12:12:26 +02:00
  • 68217465fe div by null in word distance calculation (again, description in http://mantis.tokeek.de/view.php?id=698) as root cause was not seen, added just workaround reducing in favour over a try catch (for easier followup). reger 2016-10-19 22:55:36 +02:00
  • 7263d17436 Removed mentions of deprecated LURL-db. luccioman 2016-10-19 14:56:25 +02:00
  • c3c4a52408 Added more examples in Blacklist JUnit test. luccioman 2016-10-19 13:14:20 +02:00
  • 8b74a6bf57 fix min/max calculation of WordReferenceVars.distance() Issue was the calculation in AbstractReference with positions.clear() call, this made distance result always 0 (distance needs min 2 positions) and created concurrency issues. + unit test of changes reger 2016-10-17 23:58:28 +02:00
  • da362628fb Added fine log level for too long blacklist matching processing. luccioman 2016-10-17 22:32:19 +02:00
  • aaae7c6462 adjust ConcurrentScoreMap internal value map to interface and use parameter Long -> Integer (saves some bytes) reger 2016-10-16 06:31:48 +02:00
  • 31d2a5645e remove obsolete query variable leftover from 8fb370d9f8 (diff-1d4259005ebfddc11083387857a86175) harmonize ranking shift parameter to 0xFF correct addresult weight parameter to long reger 2016-10-15 19:29:19 +02:00
  • 93ea366778 Updated license header file name luccioman 2016-10-15 11:34:50 +02:00
  • 4c0be4d5d4 Fixed maven compilation error luccioman 2016-10-15 11:34:23 +02:00
  • ba77e8f8ec upd to Jetty 9.2.19 reger 2016-10-15 05:23:18 +02:00
  • a588ed7628 Applied image headers customization to the new ViewFavicon servlet. luccioman 2016-10-14 14:05:38 +02:00
  • d16e57b41e Merge pull request #39 from luccioman/master luccioman 2016-10-14 12:00:39 +02:00
  • 7717a3d43d Fixed license headers on files created to improve favicon management. luccioman 2016-10-14 11:55:49 +02:00
  • 6e1959f469 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2016-10-14 11:29:55 +02:00
  • 7136b1ad60 HTML validation : fixed URL encoding of Pictures link. luccioman 2016-10-14 09:42:43 +02:00
  • 407563b9f0 add lock symbol to messages UI Trans menu item reger 2016-10-14 02:36:35 +02:00
  • 685d8e86bf Avoid frequent data type casting (float/long) for rwi score refactor to using long in URIMetadataNode too (and related call parameters) As remote rwi score's are not used (since v1.83) skip reading float-score , but keep in toString() for communication with older versions. reger 2016-10-14 01:17:34 +02:00
  • 3ccd89e274 Fixed MultiProtocolURL.resolveBackpath to handle remaining '..' segments luccioman 2016-10-13 16:18:24 +02:00
  • f1f4459f88 Added some unit tests for Blacklist.isListed() luccioman 2016-10-13 15:39:47 +02:00
  • 4b699c469a Blacklist refactoring : extracted a function for easier unit testing luccioman 2016-10-13 15:33:31 +02:00
  • 54cfcc3f56 CrawlCheck_p.html : also display info about disallowed URLs. luccioman 2016-10-12 11:26:59 +02:00
  • 8b341e9818 Robots : properly handle URLs including non ASCII characters luccioman 2016-10-12 11:25:36 +02:00
  • 75bb77f0cb Refactoring : extracted a method to handle authorized action links. luccioman 2016-10-12 09:31:42 +02:00