Commit Graph

  • 1ec892c85b Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 Michael Peter Christen 2014-09-05 15:09:36 +02:00
  • 39615de3f9 adding the buffer size is not wrong but may cause confusing information when the buffer is cleaned after a buffer flush which is not then available in Solr since that is waiting for a commit. In such cases the counter would run backwards which is prevented by ignoring the buffer size. Michael Peter Christen 2014-09-05 14:57:40 +02:00
  • 395edec6f1 changed strategy to count the number of documents: get the max of solr+buffer and the hit cache. This shall help during first crawls to see a running document counter even if there was no commit meanwhile to solr. To support that strategy, the hit cache must be written earlier. Michael Peter Christen 2014-09-05 14:50:22 +02:00
  • e87dc08c0d set the correct fail time in error docs Michael Peter Christen 2014-09-05 14:46:11 +02:00
  • f510fb82dd css skin fix: visited was not set which caused bad colors on new-user menu design. Michael Peter Christen 2014-09-05 12:54:21 +02:00
  • caa0830ecc Update russian translation malykhin.dmitry 2014-09-05 14:50:56 +04:00
  • 1ba16c2377 Update russian translation malykhin.dmitry 2014-09-05 01:17:41 +04:00
  • cfb20bc0ce removing the [] for ipv6 addresses may be a bad idea.. Michael Peter Christen 2014-09-04 18:17:38 +02:00
  • b6d57f06eb enhanced the apk parser (up to beeing production-ready). The parser is not yet activated and will be after the next release step. orbiter 2014-09-04 09:41:42 +02:00
  • 2b1cf26828 removed solr warning during startup Michael Peter Christen 2014-09-02 13:25:30 +02:00
  • a7dd89c4de changed method to write the citation index: do not catch up references during document parsing; instead use the same references that would also be written into the webgraph. That should cause that the webgraph and the citation index express the exact same semantic. Michael Peter Christen 2014-09-02 13:22:12 +02:00
  • 57ce7eeff3 fixed localhost authorization and replaced the adminRealm with an info string which is visible in the browser. That makes it possible that the browser instructs the user how to change a forgotten admin password (during runtime). Michael Peter Christen 2014-09-02 13:15:19 +02:00
  • 62f48a28d6 moved index administration up ahead of system administration to put more importance on it. People should not feel that it is more important to tweak any settings (which may break things) than to look into the index. Michael Peter Christen 2014-09-02 12:06:56 +02:00
  • 77b4c6dc5b moved Table administration and Busy Queues Config out of mini-submenu of advanced settings to a top-menu entry. Moved the advanced setting to a less prominent place of the submenu. Removed the table administration from target analysis submenu because it appeared double, the table administration is now the default in the system administration. Sorry for inconvenience if i constantly move menues around, but this makes just more sense and YaCy is still not finished :) Michael Peter Christen 2014-09-02 12:04:44 +02:00
  • c90ae191ab moved cookie monitoring to the network monitoring submenu Michael Peter Christen 2014-09-02 11:53:22 +02:00
  • f318d7c285 enhanced date-ordered ranking orbiter 2014-09-01 13:01:30 +02:00
  • 0947bea882 fixed wrong submenu title orbiter 2014-09-01 11:08:35 +02:00
  • 3ba47823cb switched position of API steering and content semantic orbiter 2014-09-01 11:04:24 +02:00
  • a6891ff7f8 fix Querygoal.parse exception on +/-null-term covers http://mantis.tokeek.de/view.php?id=452 reger 2014-09-01 00:16:26 +02:00
  • 0ff66118bf exclude nav-header/footer in ServerScannerList.html?embedded fixes display of header in yacyinteractive.html reger 2014-08-31 05:04:19 +02:00
  • c7335318eb remove unused legacy procedure from httpserver (deleted generateSocketAddress(port) ) reger 2014-08-31 00:33:05 +02:00
  • b02cb18c84 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-28 16:28:35 +02:00
  • 301961c4c1 small fix to the welcome message orbiter 2014-08-28 16:28:06 +02:00
  • eab0d3e1a9 bugfix for wrong lock display, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=5321&p=30484#p30484 Michael Peter Christen 2014-08-28 12:50:45 +02:00
  • 2dd4b274d4 update to kaskelix orbiter 2014-08-28 12:15:11 +02:00
  • 46efeb6ea2 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-27 18:46:04 +02:00
  • 60f97faec6 added hint to the search api examples to remind the user that these interfaces are examples and not actual variants of the current search orbiter 2014-08-27 18:44:20 +02:00
  • f642cfbe30 added hint to the regular expression tester orbiter 2014-08-27 18:40:20 +02:00
  • c2521111ca another fix to de locale which fixes a html tag glitch orbiter 2014-08-27 18:32:44 +02:00
  • 73ebf69ca7 changed style of info-icon to be similar to bootstrap.css glyphicons orbiter 2014-08-27 18:29:40 +02:00
  • c66590e01a another translation typo orbiter 2014-08-27 18:14:45 +02:00
  • 96cd6d1979 fix for translation mistakes orbiter 2014-08-27 18:13:06 +02:00
  • 6654d314f1 add rss version to api/feed.rss IE11 reports error without reger 2014-08-27 02:31:21 +02:00
  • 0ad39d4811 fix for de locale translation mistake orbiter 2014-08-27 00:50:25 +02:00
  • cbb5f06630 do not remove the index deletion option from the IndexControlURLs_p.html servlet after a deletion happend, instead show but disable the option when the index is empty. orbiter 2014-08-27 00:45:39 +02:00
  • 73c2e47de3 added a confirmation dialog to complete index deletion orbiter 2014-08-27 00:31:03 +02:00
  • 71b686e503 fix html error occurred by missing symbol in de localization in IndexDeletion_p.html orbiter 2014-08-27 00:22:00 +02:00
  • 49d4f95faf bugfix to latest commit orbiter 2014-08-27 00:16:50 +02:00
  • 68211f8244 enable Crawler_p servlet if a rss feed or a wiki dump import was submitted. orbiter 2014-08-27 00:15:31 +02:00
  • a65df4ce7e do not push noindex errors into log if in intranet mode. noindex attributes are attached to artificial constructed index.html files which list directories. Such files are naturally rejected by the crawler and should not appear in the error log because these files are part of the construction of file crawlers and confuse users if they see them in the error log. orbiter 2014-08-27 00:10:51 +02:00
  • 688c6d8954 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-27 00:04:36 +02:00
  • 4ae7aead28 addon to latest fix orbiter 2014-08-27 00:03:49 +02:00
  • 500e0b9927 fix for browsing of file paths in Index Browser orbiter 2014-08-27 00:03:24 +02:00
  • 2af56fa37d Improved UPnP. (still not perfect) Marc Nause 2014-08-26 22:47:13 +02:00
  • b3ebd38079 removed the HTDOCS repository concept because the concept to host files on the YaCy http server is obsolete; YaCy can index file:// and smb:// paths orbiter 2014-08-26 19:02:53 +02:00
  • 5611d45b65 renamed Host Browser to Index Browser (gives a better hint what it actually does) orbiter 2014-08-26 18:52:49 +02:00
  • ec5b1d9e33 let NETWORK_WHITELIST take precedence over NETWORK_BLACKLIST this makes it easier to config exception (for private networks), like blacklist= .* whitelist= 10\..*,127\..* ..... allows only listed ip pattern reger 2014-08-26 01:02:38 +02:00
  • 8d1b66accc Fix for http://mantis.tokeek.de/view.php?id=432 Marc Nause 2014-08-25 22:47:33 +02:00
  • 1fdcc2d67b change seedfile upload ip check to allow intranet ip in intranet mode - this allows to setup a principal peer in intranet environment reger 2014-08-25 01:25:22 +02:00
  • 70bb3d1b38 update target url for yacy-portalsearch.html to search.yacy.net (peer yacportalsearch2014) (old www.yacy-suche.de not reacheable) reger 2014-08-24 23:05:22 +02:00
  • e31b0e6d67 - update javadoc Seed.getIP - default mySeed.ip to hostip in SeedDB.initMySeed() if Intranetmode this allows to become senior status in intranet hosted search network with view peers, otherwise peer would stay junior because of default init with loopback ip as public (dna) ip. reger 2014-08-24 21:13:36 +02:00
  • 350c6b8250 in IntranetMode allow intranet hosted seedlist with Network_Domain "any" - so far intranet seedlist hosts are always denied but need to be allowed in intranet mode reger 2014-08-24 05:20:06 +02:00
  • b4226ed10c germal locale correction sixcooler 2014-08-23 19:05:31 +02:00
  • d68438c3d9 make sure that the postprocessing background thread never dies by any exception orbiter 2014-08-23 10:35:38 +02:00
  • 29ccbf6491 seedUploadUrl config is lost on restart if no publish event occured -add a saveMySeed() on uploadurl changes (to keep url setting without retyping even if network down) reger 2014-08-21 01:26:42 +02:00
  • e033e79826 remove old description for proxy port settings (Settings_p.html?page=ProxyAccess) - The options were not current (only port number accepted, which is part of ConfigBasic.html) - Deleted options and the port number input field from the proxyaccess page. - joined both transparent proxy setup pages (Settings_Http.inc & Settings_ProxyAccess.inc) in one page - adjustments to the related/linked pages reger 2014-08-20 22:45:36 +02:00
  • e4e1bdeba0 added 0x40 to image of lockopen-gif image palette (light grey) orbiter 2014-08-20 00:55:31 +02:00
  • 7028a39abb changed lock/unlock image design orbiter 2014-08-20 00:48:48 +02:00
  • b4f2a1db6e added a unlock icon for all protected pages that are unlocked because the administrator is logged in. orbiter 2014-08-19 19:58:31 +02:00
  • aa3e5f2046 bump to httpclient-4.3.5 sixcooler 2014-08-19 14:51:07 +02:00
  • 7267c76881 set default "Search Interfaces"."Solr RSS/Opensearch" query to show latest 10 addition to index reger 2014-08-18 02:53:03 +02:00
  • d5077b94e4 update Netbeans IDE classpath reger 2014-08-18 00:05:52 +02:00
  • 516c8c02b1 update to commons-compress-1.8.1 (bugfix release) reger 2014-08-18 00:04:55 +02:00
  • ea6c9e9b07 reduce mem buffer overhead for gap files during r/w (they are typically small compared to idx allowing to use smaller buffersize -> set to 16k records) reger 2014-08-18 00:03:24 +02:00
  • 8d1b764458 update to Jetty 9.2.2 reger 2014-08-17 00:59:16 +02:00
  • e88537522d allow single quote " ' " in query see http://mantis.tokeek.de/view.php?id=379 -add QueryGoal test case for this reger 2014-08-16 14:29:52 +02:00
  • f76d81f5c9 fix: hanging text in input fields of WatchWebStructure_p.html in IE11 reger 2014-08-16 03:37:36 +02:00
  • 487021fb0a snippet computation update orbiter 2014-08-15 01:17:11 +02:00
  • cf9e7fdbb8 reverted template from latest cherry-picked commit orbiter 2014-08-15 00:06:22 +02:00
  • f6c7467a90 updated some french translations Alex 2014-08-13 16:03:40 +02:00
  • 1c2f1f233a Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-08-14 20:58:05 +02:00
  • 5a4995ded3 fill solr rss writer dc:subject tag with keyword content reger 2014-08-14 03:06:41 +02:00
  • 927aaa95a6 concurrency bugfix orbiter 2014-08-13 00:59:11 +02:00
  • 564f1cf6d3 updated fr traduction of ConfigBasic.html and header.template + fixed some accents in fr.lng Alexandre Vouilloz 2014-08-13 00:39:25 +02:00
  • c9e593cf78 removed warnings orbiter 2014-08-11 23:53:12 +02:00
  • 19e35a9126 add type attribute to atom feed <link> tag (for /yacysearch.atom) reger 2014-08-11 21:46:39 +02:00
  • 51bb21c6b4 reverted .classpath from cherry-picked ce1fd1e901 orbiter 2014-08-11 20:05:15 +02:00
  • 2dd8be3c66 updated the traduction of Status_p.inc in the french locale Alexandre Vouilloz 2014-08-11 00:44:52 +02:00
  • e50b2b4d04 fix test case MultiProtocolURL.toString() (only allowed on AnchorURL) reger 2014-08-11 04:29:43 +02:00
  • 0a2f4a0e2f eliminate lat/lon type conversion in osm (define as double) reger 2014-08-10 22:35:25 +02:00
  • 7584352e7b use more predefined Solr query parameter constants - use CommonParams and DisMaxParams constants - fix typo in get sort parameter - getDocumentCountByParams redundant implementation and risk of not optimized call (row parameter unspecified) -> as only used from getCountByQuery removed from interface reger 2014-08-10 22:33:10 +02:00
  • f9db5dd6c5 reduce doublecontent check document (prevent out of memory) see http://mantis.tokeek.de/view.php?id=437 reger 2014-08-10 03:18:15 +02:00
  • e9eae45b55 simplify rssreader and improve atom feed link extraction - type detection (rss/atom) - init type parameter overwritten during parse, parameter obsolete - detection by endtag changed to simpler first-tag evaluation - channel image not used, removed related extra parser handling - remove unused code (set/getImage) in rssfeed - atom link extraction to account for possible multipe link tags - spec limits link to one with rel="alternate" or one without rel attribute not accounting for the follwing type & hreflang exception yet: reger 2014-08-10 01:29:16 +02:00
  • a8508417d1 catch NPE during crawl (OAI import) - condenseDocument mime=null (allowed) - collectionconfiguration responseheader = null (allowed) reger 2014-08-08 00:02:59 +02:00
  • 3dde94422f center searchevent lines on network graph (PerformanceSearch_p.html) reger 2014-08-06 23:04:42 +02:00
  • 3860711aef fix for possible interruption of concurrent queries Michael Peter Christen 2014-08-06 12:55:18 +02:00
  • 01bbb20666 increased default logging line count to max Michael Peter Christen 2014-08-06 12:40:35 +02:00
  • 6344718f8b reducing the concurrent query stack size and reduced concurrency of postprocessing to avoid OOM situations Michael Peter Christen 2014-08-06 12:36:59 +02:00
  • eca9380e3d bugfix for crawler double-check: if an url is redirected, the redirect-target was not double-checked. This is now done by replacing the redirect-URL on the crawl queue again (where it is double-checked) Michael Peter Christen 2014-08-06 12:35:12 +02:00
  • 9ac0c93f17 fix for subpath crawl filter Michael Peter Christen 2014-08-06 01:33:24 +02:00
  • 9bc3e457dd fix for termination of all crawls Michael Peter Christen 2014-08-05 22:23:52 +02:00
  • 66106bdaf0 fix for crawler attribute maxdompages Michael Peter Christen 2014-08-05 21:32:25 +02:00
  • 49d91b94c3 npe fix in crawler Michael Peter Christen 2014-08-05 21:31:59 +02:00
  • 8d650ca225 added hint to port forwarding videos Michael Peter Christen 2014-08-05 21:31:28 +02:00
  • b7183a7321 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-08-05 09:54:18 +02:00
  • ea2e627662 fix ConfigAccounts del user with uppercase letter in name (usernames are case sensitive, userdb.delete used toLower) reger 2014-08-05 01:27:27 +02:00
  • c465b791af typo Michael Peter Christen 2014-08-04 16:13:39 +02:00
  • 191ec8c82a added concurrency to postprocess rewrite process Michael Peter Christen 2014-08-04 15:28:58 +02:00
  • a1e8bdd5e9 log ppm instead of docs/second Michael Peter Christen 2014-08-04 14:44:42 +02:00
  • cc0ded7abd set process type of web graph according to fields as defined in the schema Michael Peter Christen 2014-08-04 14:44:20 +02:00