Commit Graph

  • 3ba47823cb switched position of API steering and content semantic orbiter 2014-09-01 11:04:24 +02:00
  • a6891ff7f8 fix Querygoal.parse exception on +/-null-term covers http://mantis.tokeek.de/view.php?id=452 reger 2014-09-01 00:16:26 +02:00
  • 0ff66118bf exclude nav-header/footer in ServerScannerList.html?embedded fixes display of header in yacyinteractive.html reger 2014-08-31 05:04:19 +02:00
  • c7335318eb remove unused legacy procedure from httpserver (deleted generateSocketAddress(port) ) reger 2014-08-31 00:33:05 +02:00
  • b02cb18c84 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-28 16:28:35 +02:00
  • 301961c4c1 small fix to the welcome message orbiter 2014-08-28 16:28:06 +02:00
  • eab0d3e1a9 bugfix for wrong lock display, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=5321&p=30484#p30484 Michael Peter Christen 2014-08-28 12:50:45 +02:00
  • 2dd4b274d4 update to kaskelix orbiter 2014-08-28 12:15:11 +02:00
  • 46efeb6ea2 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-27 18:46:04 +02:00
  • 60f97faec6 added hint to the search api examples to remind the user that these interfaces are examples and not actual variants of the current search orbiter 2014-08-27 18:44:20 +02:00
  • f642cfbe30 added hint to the regular expression tester orbiter 2014-08-27 18:40:20 +02:00
  • c2521111ca another fix to de locale which fixes a html tag glitch orbiter 2014-08-27 18:32:44 +02:00
  • 73ebf69ca7 changed style of info-icon to be similar to bootstrap.css glyphicons orbiter 2014-08-27 18:29:40 +02:00
  • c66590e01a another translation typo orbiter 2014-08-27 18:14:45 +02:00
  • 96cd6d1979 fix for translation mistakes orbiter 2014-08-27 18:13:06 +02:00
  • 6654d314f1 add rss version to api/feed.rss IE11 reports error without reger 2014-08-27 02:31:21 +02:00
  • 0ad39d4811 fix for de locale translation mistake orbiter 2014-08-27 00:50:25 +02:00
  • cbb5f06630 do not remove the index deletion option from the IndexControlURLs_p.html servlet after a deletion happend, instead show but disable the option when the index is empty. orbiter 2014-08-27 00:45:39 +02:00
  • 73c2e47de3 added a confirmation dialog to complete index deletion orbiter 2014-08-27 00:31:03 +02:00
  • 71b686e503 fix html error occurred by missing symbol in de localization in IndexDeletion_p.html orbiter 2014-08-27 00:22:00 +02:00
  • 49d4f95faf bugfix to latest commit orbiter 2014-08-27 00:16:50 +02:00
  • 68211f8244 enable Crawler_p servlet if a rss feed or a wiki dump import was submitted. orbiter 2014-08-27 00:15:31 +02:00
  • a65df4ce7e do not push noindex errors into log if in intranet mode. noindex attributes are attached to artificial constructed index.html files which list directories. Such files are naturally rejected by the crawler and should not appear in the error log because these files are part of the construction of file crawlers and confuse users if they see them in the error log. orbiter 2014-08-27 00:10:51 +02:00
  • 688c6d8954 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-27 00:04:36 +02:00
  • 4ae7aead28 addon to latest fix orbiter 2014-08-27 00:03:49 +02:00
  • 500e0b9927 fix for browsing of file paths in Index Browser orbiter 2014-08-27 00:03:24 +02:00
  • 2af56fa37d Improved UPnP. (still not perfect) Marc Nause 2014-08-26 22:47:13 +02:00
  • b3ebd38079 removed the HTDOCS repository concept because the concept to host files on the YaCy http server is obsolete; YaCy can index file:// and smb:// paths orbiter 2014-08-26 19:02:53 +02:00
  • 5611d45b65 renamed Host Browser to Index Browser (gives a better hint what it actually does) orbiter 2014-08-26 18:52:49 +02:00
  • ec5b1d9e33 let NETWORK_WHITELIST take precedence over NETWORK_BLACKLIST this makes it easier to config exception (for private networks), like blacklist= .* whitelist= 10\..*,127\..* ..... allows only listed ip pattern reger 2014-08-26 01:02:38 +02:00
  • 8d1b66accc Fix for http://mantis.tokeek.de/view.php?id=432 Marc Nause 2014-08-25 22:47:33 +02:00
  • 1fdcc2d67b change seedfile upload ip check to allow intranet ip in intranet mode - this allows to setup a principal peer in intranet environment reger 2014-08-25 01:25:22 +02:00
  • 70bb3d1b38 update target url for yacy-portalsearch.html to search.yacy.net (peer yacportalsearch2014) (old www.yacy-suche.de not reacheable) reger 2014-08-24 23:05:22 +02:00
  • e31b0e6d67 - update javadoc Seed.getIP - default mySeed.ip to hostip in SeedDB.initMySeed() if Intranetmode this allows to become senior status in intranet hosted search network with view peers, otherwise peer would stay junior because of default init with loopback ip as public (dna) ip. reger 2014-08-24 21:13:36 +02:00
  • 350c6b8250 in IntranetMode allow intranet hosted seedlist with Network_Domain "any" - so far intranet seedlist hosts are always denied but need to be allowed in intranet mode reger 2014-08-24 05:20:06 +02:00
  • b4226ed10c germal locale correction sixcooler 2014-08-23 19:05:31 +02:00
  • d68438c3d9 make sure that the postprocessing background thread never dies by any exception orbiter 2014-08-23 10:35:38 +02:00
  • 29ccbf6491 seedUploadUrl config is lost on restart if no publish event occured -add a saveMySeed() on uploadurl changes (to keep url setting without retyping even if network down) reger 2014-08-21 01:26:42 +02:00
  • e033e79826 remove old description for proxy port settings (Settings_p.html?page=ProxyAccess) - The options were not current (only port number accepted, which is part of ConfigBasic.html) - Deleted options and the port number input field from the proxyaccess page. - joined both transparent proxy setup pages (Settings_Http.inc & Settings_ProxyAccess.inc) in one page - adjustments to the related/linked pages reger 2014-08-20 22:45:36 +02:00
  • e4e1bdeba0 added 0x40 to image of lockopen-gif image palette (light grey) orbiter 2014-08-20 00:55:31 +02:00
  • 7028a39abb changed lock/unlock image design orbiter 2014-08-20 00:48:48 +02:00
  • b4f2a1db6e added a unlock icon for all protected pages that are unlocked because the administrator is logged in. orbiter 2014-08-19 19:58:31 +02:00
  • aa3e5f2046 bump to httpclient-4.3.5 sixcooler 2014-08-19 14:51:07 +02:00
  • 7267c76881 set default "Search Interfaces"."Solr RSS/Opensearch" query to show latest 10 addition to index reger 2014-08-18 02:53:03 +02:00
  • d5077b94e4 update Netbeans IDE classpath reger 2014-08-18 00:05:52 +02:00
  • 516c8c02b1 update to commons-compress-1.8.1 (bugfix release) reger 2014-08-18 00:04:55 +02:00
  • ea6c9e9b07 reduce mem buffer overhead for gap files during r/w (they are typically small compared to idx allowing to use smaller buffersize -> set to 16k records) reger 2014-08-18 00:03:24 +02:00
  • 8d1b764458 update to Jetty 9.2.2 reger 2014-08-17 00:59:16 +02:00
  • e88537522d allow single quote " ' " in query see http://mantis.tokeek.de/view.php?id=379 -add QueryGoal test case for this reger 2014-08-16 14:29:52 +02:00
  • f76d81f5c9 fix: hanging text in input fields of WatchWebStructure_p.html in IE11 reger 2014-08-16 03:37:36 +02:00
  • 487021fb0a snippet computation update orbiter 2014-08-15 01:17:11 +02:00
  • cf9e7fdbb8 reverted template from latest cherry-picked commit orbiter 2014-08-15 00:06:22 +02:00
  • f6c7467a90 updated some french translations Alex 2014-08-13 16:03:40 +02:00
  • 1c2f1f233a Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-14 20:58:05 +02:00
  • 5a4995ded3 fill solr rss writer dc:subject tag with keyword content reger 2014-08-14 03:06:41 +02:00
  • 927aaa95a6 concurrency bugfix orbiter 2014-08-13 00:59:11 +02:00
  • 564f1cf6d3 updated fr traduction of ConfigBasic.html and header.template + fixed some accents in fr.lng Alexandre Vouilloz 2014-08-13 00:39:25 +02:00
  • c9e593cf78 removed warnings orbiter 2014-08-11 23:53:12 +02:00
  • 19e35a9126 add type attribute to atom feed <link> tag (for /yacysearch.atom) reger 2014-08-11 21:46:39 +02:00
  • 51bb21c6b4 reverted .classpath from cherry-picked ce1fd1e901 orbiter 2014-08-11 20:05:15 +02:00
  • 2dd8be3c66 updated the traduction of Status_p.inc in the french locale Alexandre Vouilloz 2014-08-11 00:44:52 +02:00
  • e50b2b4d04 fix test case MultiProtocolURL.toString() (only allowed on AnchorURL) reger 2014-08-11 04:29:43 +02:00
  • 0a2f4a0e2f eliminate lat/lon type conversion in osm (define as double) reger 2014-08-10 22:35:25 +02:00
  • 7584352e7b use more predefined Solr query parameter constants - use CommonParams and DisMaxParams constants - fix typo in get sort parameter - getDocumentCountByParams redundant implementation and risk of not optimized call (row parameter unspecified) -> as only used from getCountByQuery removed from interface reger 2014-08-10 22:33:10 +02:00
  • f9db5dd6c5 reduce doublecontent check document (prevent out of memory) see http://mantis.tokeek.de/view.php?id=437 reger 2014-08-10 03:18:15 +02:00
  • e9eae45b55 simplify rssreader and improve atom feed link extraction - type detection (rss/atom) - init type parameter overwritten during parse, parameter obsolete - detection by endtag changed to simpler first-tag evaluation - channel image not used, removed related extra parser handling - remove unused code (set/getImage) in rssfeed - atom link extraction to account for possible multipe link tags - spec limits link to one with rel="alternate" or one without rel attribute not accounting for the follwing type & hreflang exception yet: reger 2014-08-10 01:29:16 +02:00
  • a8508417d1 catch NPE during crawl (OAI import) - condenseDocument mime=null (allowed) - collectionconfiguration responseheader = null (allowed) reger 2014-08-08 00:02:59 +02:00
  • 3dde94422f center searchevent lines on network graph (PerformanceSearch_p.html) reger 2014-08-06 23:04:42 +02:00
  • 3860711aef fix for possible interruption of concurrent queries Michael Peter Christen 2014-08-06 12:55:18 +02:00
  • 01bbb20666 increased default logging line count to max Michael Peter Christen 2014-08-06 12:40:35 +02:00
  • 6344718f8b reducing the concurrent query stack size and reduced concurrency of postprocessing to avoid OOM situations Michael Peter Christen 2014-08-06 12:36:59 +02:00
  • eca9380e3d bugfix for crawler double-check: if an url is redirected, the redirect-target was not double-checked. This is now done by replacing the redirect-URL on the crawl queue again (where it is double-checked) Michael Peter Christen 2014-08-06 12:35:12 +02:00
  • 9ac0c93f17 fix for subpath crawl filter Michael Peter Christen 2014-08-06 01:33:24 +02:00
  • 9bc3e457dd fix for termination of all crawls Michael Peter Christen 2014-08-05 22:23:52 +02:00
  • 66106bdaf0 fix for crawler attribute maxdompages Michael Peter Christen 2014-08-05 21:32:25 +02:00
  • 49d91b94c3 npe fix in crawler Michael Peter Christen 2014-08-05 21:31:59 +02:00
  • 8d650ca225 added hint to port forwarding videos Michael Peter Christen 2014-08-05 21:31:28 +02:00
  • b7183a7321 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-08-05 09:54:18 +02:00
  • ea2e627662 fix ConfigAccounts del user with uppercase letter in name (usernames are case sensitive, userdb.delete used toLower) reger 2014-08-05 01:27:27 +02:00
  • c465b791af typo Michael Peter Christen 2014-08-04 16:13:39 +02:00
  • 191ec8c82a added concurrency to postprocess rewrite process Michael Peter Christen 2014-08-04 15:28:58 +02:00
  • a1e8bdd5e9 log ppm instead of docs/second Michael Peter Christen 2014-08-04 14:44:42 +02:00
  • cc0ded7abd set process type of web graph according to fields as defined in the schema Michael Peter Christen 2014-08-04 14:44:20 +02:00
  • 12fb9d7cd1 log postprocessing constraints in case that postprocessing is not performed Michael Peter Christen 2014-08-04 14:19:37 +02:00
  • 3c23b89823 less logging Michael Peter Christen 2014-08-04 13:37:34 +02:00
  • a0c53174c5 better solr query logging to detect unnecessary sort requests for more performance profiling Michael Peter Christen 2014-08-04 13:00:45 +02:00
  • 338f574bdc no sorting if http/www unique fields are not demanded (makes query faster) and some code restrucuring Michael Peter Christen 2014-08-04 12:59:38 +02:00
  • 1609763be5 toString fix Michael Peter Christen 2014-08-04 12:58:39 +02:00
  • b983e68254 more retries, less sleep Michael Peter Christen 2014-08-04 08:29:35 +02:00
  • 1503ba7794 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-08-04 08:24:31 +02:00
  • 8f77719091 fix "Ljava.lang.String" in crawl queue anchor name (e.g. IndexCreateQueues_p.html?stack=LOCAL with images in queue) reger 2014-08-04 02:38:58 +02:00
  • 0ceeceb35e more logic on Solr queries; usage of the query terms in posprocessing, saving one query for double document detection now per document Michael Peter Christen 2014-08-04 02:35:38 +02:00
  • 3963bca3b6 catch IndexControlRWIs_p error if RWI not connected reger 2014-08-04 00:03:42 +02:00
  • 38864ae004 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-03 22:44:49 +02:00
  • 4099296b45 added new classes which shall reduce call overhead to Solr (stub) orbiter 2014-08-03 22:44:22 +02:00
  • d0c02e1de7 adjust rss lat/lon to double (common format across other classes) reger 2014-08-03 20:09:23 +02:00
  • 3491ab4c38 removed unused images from webgraph edge computation orbiter 2014-08-01 13:21:16 +02:00
  • 2371d6b8db target linktexts must be string to enable search facets on these fields orbiter 2014-08-01 13:20:25 +02:00
  • 001e05bb80 do not store failure of loading of robots.txt into the index as a fail document Michael Peter Christen 2014-08-01 12:15:14 +02:00
  • 05d58e4df0 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-08-01 12:04:25 +02:00