Commit Graph

  • 52d05d14c6 Display result favicons only for http or https resources. luccioman 2017-01-06 09:00:28 +01:00
  • 4c9be29a55 fix concurrency issue with htmlParser using not current scraper data resulting in incorrect data for some html index metadata. Details see http://mantis.tokeek.de/view.php?id=717 reger 2017-01-06 03:01:52 +01:00
  • b154d3eb87 Added descriptive titles to Crawler_p.html speed settings. luccioman 2017-01-05 14:54:59 +01:00
  • eedee6eabb fix exception on URIMetadataNote instantiation with corrected id hash on host_id_s. Use Solr setField instead of addField to prevent java.lang.ClassCastException: java.util.ArrayList cannot be cast to java.lang.String at net.yacy.kelondro.data.meta.URIMetadataNode.hosthash(URIMetadataNode.java:247) at net.yacy.search.query.SearchEvent.addNodes(SearchEvent.java:966) at net.yacy.peers.Protocol.solrQuery(Protocol.java:1242) at net.yacy.peers.RemoteSearch$2.run(RemoteSearch.java:349) reger 2017-01-05 00:24:37 +01:00
  • b55cf16dad Upgraded jgit build library to version 4.5.0 luccioman 2017-01-04 17:09:37 +01:00
  • 9cfe8dd6d6 Upgraded Apache Ant to 1.10.0 for the Alpine flavor Docker image. luccioman 2017-01-02 14:23:25 +01:00
  • c1401d821e Adjusted crawl depth control for FTP crawl start URLs. luccioman 2017-01-02 10:24:17 +01:00
  • 68d4dc5cc5 Complete harmonization RequestHeader getCookie with std ServletRequest to use javax.servlet.http.Cookie parameters. Depreciate now obsolete getHeaderCookies. Adjust setting of MaxAge to spec if >= 0 otherwise keep default. reger 2017-01-02 03:04:21 +01:00
  • 396ed3c769 On negative result vote also delete document from fulltext index (not only from dht) reger 2017-01-01 23:58:38 +01:00
  • 50e211fd92 Merge origin/master reger 2017-01-01 23:54:18 +01:00
  • a1e5f7dbca fix of fulltext.remove() by id of webgraph document webgraph has document hash in source_id_s reger 2017-01-01 23:53:44 +01:00
  • 1eafa7bfaf Fixed docker stop behavior. luccioman 2016-12-31 09:51:07 +01:00
  • 1df558a6c6 Fixed YaCy proper shutdown triggered by SIGTERM signal. luccioman 2016-12-28 09:47:27 +01:00
  • fce701f5cc release 1.92 Release_1.92 Michael Peter Christen 2016-12-26 15:00:55 +01:00
  • c7af94a0c0 release 1.92 Michael Peter Christen 2016-12-26 14:13:45 +01:00
  • dbd34befc0 added luccioman development release builds as discussed in http://forum.yacy-websuche.de/viewtopic.php?f=8&t=5906 Michael Peter Christen 2016-12-26 13:50:35 +01:00
  • 204e507b2b updated seed-list bootstrap locations Michael Peter Christen 2016-12-26 13:32:36 +01:00
  • b522d540b9 Include itemprop latitude/longitude (see schema.org) in attribute parsing for lat/lon. Harmonize number parsing for lat/lon to parseDouble. Fix endDate_dts value assignment. reger 2016-12-25 23:39:55 +01:00
  • 4c94074e78 LSB Tag Velociraptor85 2016-12-24 15:20:02 +01:00
  • 083df255e4 fix html tag attribute parsing containing attribute w/o value e.g. itemscope or autofocus (in such case the next key was not properly recognized). reger 2016-12-24 06:57:11 +01:00
  • cb95b7339a include html5 <time> tag in content scraper, add "datetime" property of <time> tag to scrapers startdate list. Datetime is parsed as iso8601 (xml) date, html5 allows partial as well as duration (not handled by this) reger 2016-12-24 03:11:35 +01:00
  • f153cc4b5d add/allow to create a bookmark of result viewed via urlproxy. For this on the header of the viewed result a "add bookmark" button is available (for authenticated users). Currently the bookmark is added to a (virtual) bookmark folder "/proxy" w/o any additional tags etc. reger 2016-12-23 19:03:44 +01:00
  • 7bf2bcf504 fix and prevent exception on missing required cookie name skip cookie creation if name is empty. reger 2016-12-22 19:52:38 +01:00
  • 3ca695390c FTP crawl start URLs : applied crawl profile depth control luccioman 2016-12-22 16:25:09 +01:00
  • 128c8ef8d4 Fixed title rendering having non ASCII chars in QuickCrawlLink_p.html. luccioman 2016-12-21 08:19:09 +01:00
  • ee6933c004 Added a title on the previous and next page pagination buttons. luccioman 2016-12-21 07:22:41 +01:00
  • 8eb6fba59c activate filetype navigator plugin and restrict config (append) of navs to not already actives. Dht results are now included in count this might over shoot on redundant dht and solr, while the previous solr facet based was always low. reger 2016-12-21 02:04:13 +01:00
  • c25e48e969 Enabled displaying results after 14th page for local search queries. luccioman 2016-12-20 14:52:33 +01:00
  • a3886c6adb Merge branch 'master' of https://github.com/yacy/yacy_search_server.git luccioman 2016-12-20 13:41:13 +01:00
  • feaa87005e Improved indentation for easier debugging steps. luccioman 2016-12-20 08:27:17 +01:00
  • 6be9d62ab4 show earthsearch.png in ConfigSearchPage layout on activated location navigator (for more realistic impression) reger 2016-12-20 02:06:43 +01:00
  • bab4804d11 add FileTypeNavigator plugin reger 2016-12-19 23:56:03 +01:00
  • d35c47090c remove obsolete put of HttpServletRequest attributes to YaCy servlet parameters on SSI (server side includes). Query parameters are already merged by dispatcher.include, making copy of parameter (RequestDispatcher.INCLUDE_QUERY_STRING) obsolete. All other parameter are not used as YaCy servlet arguments. reger 2016-12-19 02:30:55 +01:00
  • 0959038624 correct DefaultServlet resource pathinContext calculation exclude servletPath option as resources are always relative to htroot or htdocs, the change reflects this. Theoretically it and the recent adjustments arcording relative urls allows to configure the instance to be configurable in a path other as root (/) reger 2016-12-18 21:11:00 +01:00
  • c50e23c495 reduce creation of empty legacy RequestHeader() in situation where null is acceptable (less for garbage collection). reger 2016-12-18 02:38:43 +01:00
  • 87f6631a2a adjust Cache getHeader to prev. changes/commit reger 2016-12-18 01:02:56 +01:00
  • 6be7339b1d remove the overhead of unused reverseMappingCache of HeaderFramewor / RequestHeader reger 2016-12-18 00:57:47 +01:00
  • 193b2ab1fc reduce redundant declaration for simple date formatter using predefined GenericFormatter.SIMPLE_FORMATTER reger 2016-12-17 23:29:57 +01:00
  • 38d676c7e4 use GenericFormatter SimpleDate for sortable column in table_API to allow correct chronological sorting (of the date string) fix for http://mantis.tokeek.de/view.php?id=585 reger 2016-12-17 21:44:09 +01:00
  • c702eb6786 del dead menu link to /repository (directory not created in current distribution -> old) reger 2016-12-17 02:38:52 +01:00
  • baa5d9b9e3 adjust DomainHandler working on resolved .yacy domain (remove obsolete check for path on hostname) reger 2016-12-17 01:33:00 +01:00
  • 1ba705c23d Use loaderDispatcher instead of HTTPClient to download releases. luccioman 2016-12-16 20:38:54 +01:00
  • 467650c042 Hardened system update checks. luccioman 2016-12-16 11:03:09 +01:00
  • b5711b8fe1 Added some Javadocs. luccioman 2016-12-16 10:43:00 +01:00
  • 0f9d9b95b5 upd to ImageIO 3.3.1 reger 2016-12-16 00:49:19 +01:00
  • 0d2964cf2b expanded error message on rejected crawl url due to faile dns lookup close of http://mantis.tokeek.de/view.php?id=678 reger 2016-12-15 23:59:50 +01:00
  • 00e81fcc15 Check HTTP status when downloading a release, and report eventual error. luccioman 2016-12-15 15:30:36 +01:00
  • 8e2cef5f07 allow protocol navigator to be unselected if only one button is shown after activating navi/facetfilter reger 2016-12-15 00:45:08 +01:00
  • 437e535e5c Fixed admin navbar rendering at various screen sizes. luccioman 2016-12-14 12:49:41 +01:00
  • 0758c868c9 add HostNavigator plugin reger 2016-12-13 22:14:16 +01:00
  • a3d38032cb translate languages in ConfigBasic.html reger 2016-12-13 22:12:11 +01:00
  • b90730f956 Fixed locations search navbar overlapping issues. luccioman 2016-12-13 16:50:24 +01:00
  • 0714b06038 Fixed resource switch button overlapping at various screen sizes. luccioman 2016-12-13 15:33:18 +01:00
  • 848bfc240c Fixed YaCy logo (no external mark) for the refactored navbar search. luccioman 2016-12-12 12:55:20 +01:00
  • 8acdc5443b prepare ConfigSearchPage servlet to append and remove navigator plugins, keeping order of added nav's. The search page preview template displays active navs. Therefore a select and add button has been added below the preview (to keep it close to actual). This should in future likely be done by drag&drop (html5 feature). reger 2016-12-12 02:29:15 +01:00
  • 60160877f5 bundle initialization of search navigation plugins in separate handler class to allow to use navigator map in config servlets (without need to create a search event) reger 2016-12-11 21:46:29 +01:00
  • 3151cda3a5 catch ip-format exception on wrong server access setting ip filter as reported in http://mantis.tokeek.de/view.php?id=713 to prevent abort of initialization. This jetty/whitelist ipaccesshandler accepts currently only ipv4 reger 2016-12-11 04:43:36 +01:00
  • b32bcdf344 list entries in outgoing cookie monitor one per line for easier readability. For this adjust outgoingCookies entry to use Cookie[] instead of String[] reger 2016-12-10 22:08:09 +01:00
  • f37a86e1c6 Fixed yacy search navabar header overlapping at various screen sizes. luccioman 2016-12-09 11:25:09 +01:00
  • 3f32262654 enable getCookies for HeaderFramework reusing Jetty CookieCutter reger 2016-12-09 00:33:20 +01:00
  • 4186ee6fc0 add other custom response header entries set by servlets to the response to the client (not cookies only). This is used by some servlets to mainly set "Access-Control-Allow-Origin" header. Added a contains check to be sure no header set by Defaultservlet is overwritten. reger 2016-12-07 00:51:07 +01:00
  • 77e65016c0 use more availabe SwitchboardConstans in ProxyIndexingMonitor_p (to easily find usage) reger 2016-12-07 00:39:53 +01:00
  • d27adc2b92 Fixed language detector initialization and NullPointerException cases. luccioman 2016-12-05 18:12:21 +01:00
  • 8146b97e9b Added a unit after the vocabulary size value for easier understanding. luccioman 2016-12-05 10:58:23 +01:00
  • a1f922b34a Reduced locations vocabulary memory footprint. luccioman 2016-12-05 10:57:37 +01:00
  • 9c06e752e4 allow request.setAttribute w/o "not implemented" exception by default skip unused CONNECTION_PROP_ARGS check in getQueryString reger 2016-12-05 03:15:24 +01:00
  • de33c7e765 replace one more arbitrary CONNECTION_PROP_CLIENTIP header with std. getRemoteAddr() reger 2016-12-05 00:11:03 +01:00
  • 14e73f5b9b use bootstrap button style in MessageSend_p.html and align buttons with form reger 2016-12-04 22:26:02 +01:00
  • 65871d28b2 skip comparing "xxxxx" on missing authorization header in Blog servlet reger 2016-12-04 22:11:22 +01:00
  • 59ab42e7d6 add UserDB lastaccess update calls on login reger 2016-12-04 00:58:45 +01:00
  • bf8a6d9848 Reduced GeoNames locations memory footprint. luccioman 2016-12-03 09:05:19 +01:00
  • 82512613f5 fix unresolved pattern in ConfiLanguage drop down list reger 2016-12-03 01:13:47 +01:00
  • 3f561c1635 Fixed a NullPointerException case. luccioman 2016-12-02 13:45:45 +01:00
  • 6bc2bf1aa4 Small memory footprint reduction for GeonamesLocation. luccioman 2016-12-02 13:12:47 +01:00
  • 7f846ef674 Small complementary memory footprint improvement for synonyms. luccioman 2016-11-30 17:49:51 +01:00
  • 568e3dde6a Improved synonyms memory footprint. luccioman 2016-11-30 16:50:25 +01:00
  • 60b3adfb43 fix ext2mime to return given default on input=null reger 2016-11-29 23:32:20 +01:00
  • f7e9f9be5f move Digest auth checks from DefaultServlet to adminAuthenticated, eliminating the need to modify http header on Servlet container handled Digest authentication, to simulate Basic auth for YaCy servlets. reger 2016-11-29 03:20:33 +01:00
  • 0b4e7795df Fixed JavaScript error "hs.htmlExpand is not a function". luccioman 2016-11-29 02:56:43 +01:00
  • 1f4f0eacc2 Fixed a JS undefined error case, occurring when search field is empty. luccioman 2016-11-29 02:11:44 +01:00
  • ceb7588880 Converted "clone" URL links in Table_API_p.html to purely relative ones. luccioman 2016-11-29 01:34:33 +01:00
  • cca3417b87 Fixed image and favicon viewing for unauthenticated local requests. luccioman 2016-11-28 22:10:05 +01:00
  • 02092de3d8 remove login cookie generation for static admin ind User servlet cookieAuth is never successful for static admin, leaving the creation and handling for login cookies for static admin obsolete. reger 2016-11-26 23:28:30 +01:00
  • 49f19aff75 exclude external link icon in Collage servlet (icons display not close to image in IE) reger 2016-11-26 19:53:00 +01:00
  • a0705c049d include check to prevent adding username identical with static admin in ConfigAccounts_p reger 2016-11-26 18:26:14 +01:00
  • 89017e17e4 Converted ajax URL to relative and added a check on the response status. luccioman 2016-11-25 11:10:03 +01:00
  • fc575fc760 Fixed a NullPointerException case. luccioman 2016-11-25 11:07:50 +01:00
  • 9a8691129f fix typing error from commit 60ba5c117c reger 2016-11-25 04:18:36 +01:00
  • f9328f07e2 completing the usage of CONNECTION_PROP_CLIENT_HTTPSERVLETREQUEST in HTTPDProxyHandlers logging facility. reger 2016-11-25 03:05:53 +01:00
  • 8e3e3ed191 update the older ResponseHeader patch to handle cookies, to work directly with javax.servlet.http.Cookie (rename headerProps to cookieStore as is only used for this). (Re)implement set-cookie in DefaultServlet to make cookieAuthentication work as designed. reger 2016-11-25 02:00:20 +01:00
  • 866d3a1960 make RequestHeader login succeed (without throwing exception by default) correct getAuthType to return Auth Scheme only after authentication reger 2016-11-25 01:09:42 +01:00
  • 44a6a4e795 fix authentication by hit in userdb (wrong parameter) reger 2016-11-24 00:16:22 +01:00
  • aa9ddf3c23 Added control over Robots.txt active threads maximum number. luccioman 2016-11-23 18:13:05 +01:00
  • 3092a8ced5 Fixed thread name consistency for improved monitoring. luccioman 2016-11-23 17:59:52 +01:00
  • eec5779889 Added a name prefix to pooled threads for easier monitoring. luccioman 2016-11-23 11:21:14 +01:00
  • baf6d21cfe ConfigSearchPage, move protocol navi up to better simulate actual design. Because here btn-group-justified screws up table column width (Explorer and Firefox) bootstrap btn-group is used. reger 2016-11-23 01:33:01 +01:00
  • 176f7c2aab RWI Ranking Configuration page : fixed missing required dependencies. luccioman 2016-11-22 09:40:22 +01:00
  • 59130777a6 add high scored items first to YearNavigator (to make sure to be included in sorted view) reger 2016-11-22 01:17:33 +01:00
  • 0ba5a838f7 Added charset meta to Solr HTML writers. luccioman 2016-11-21 19:55:13 +01:00
  • 08a0acc35d make a YearNavigator availabel, useable as SearchEvent.naviator plugin. It can take any Date field of the index and displays a list of year strings in reverse order by the year (not the score/count). To allow to define the index field to use, the fieldname (and title can be appended to the navi's name "year" e.g. year:load_date_dt:LoadDate It works also with dates_in_content_dts field (from the graphical date navigator). Here the query parameter from: to: are used on selection as Query modifier (for other dates currently no query parameter available, so selection won't work to filter search results). Not included in the UI Searchpage layout config so far (for experiment with it manual change to conf needed). reger 2016-11-21 16:52:53 +01:00