Commit Graph

  • eb12e15738 moved all Double values to Float values because of http://www.exploringbinary.com/java-hangs-when-converting-2-2250738585072012e-308/ YaCy does not really need double-precision floating point computation anywhere, so this should not affect any feature orbiter 2011-02-01 23:49:11 +00:00
  • fe948abd84 added link on ViewProfile.html to EditProfile_p.html to make it easier to customize the peer the link appears only if the user has admin rights orbiter 2011-01-31 19:55:00 +00:00
  • 982aa689ef * fix StringIndexOutOfBoundException in WebStructureGraph * add better escaping to saveMap and loadMap f1ori 2011-01-31 14:25:09 +00:00
  • 77715c2b16 *) less HTML errors, but still several left low012 2011-01-28 17:26:47 +00:00
  • ae10ed5613 *) added a Set to which filter elements are written before mustmatch-filter is created to avoid huge lists of double elements in mustmatch-filter when starting a crawl from a "Link-List of URL" on CrawlStartSite_p.html low012 2011-01-28 16:24:33 +00:00
  • 9a1e0158fa better servlet naming in index administration orbiter 2011-01-28 11:32:31 +00:00
  • 88773e4daa changed the default port from 8080 to 8090 see also: http://forum.yacy-websuche.de/viewtopic.php?p=21683#p21683 orbiter 2011-01-28 10:54:13 +00:00
  • 6c35b68f17 - removed 'peerName' property from the yacy settings file because this information is stored in the yacy seed file - the own seed file gets the lead for storage of the peer name - exchanged default peer name generation method with one that does not use the local ip - default peer names are now strings starting with '_anon' - added another switch to suppress forwarding to ConfigBasic if the name was already changed - replaced all usages of the yacy.conf peerName with access to the local seed - changes to the peer name are now applied directly and not after the next peer ping orbiter 2011-01-28 10:12:17 +00:00
  • 8bc66b9e84 de.lng: Updated German translation and cleaned removed lines - no unused strings log entries mikeworks 2011-01-28 04:46:42 +00:00
  • 786166041a - added recording of all accessed and submitted servlets - this recording is then used to redirect from the Status.html page to BasicConfig in case that servlet was never submitted - this acts as an addition to the new default pop-up page 'index.html' which offers an administration link to Status.html. For a first-time user this then redirects directly to the former start page BasicConfig.html orbiter 2011-01-27 11:17:11 +00:00
  • 28f669bf0b - fixed/enhanced move to SD/16:9 images (network, web structure) - added logging in peer ping to analyse time-consuming elements which could be cause for disappearing peers orbiter 2011-01-27 10:16:14 +00:00
  • 0376f73fdb extended seed list uploader: do not only upload all active peers but also some more peers that are passive but had been active in the last 24 hours orbiter 2011-01-26 23:21:33 +00:00
  • 3fe03f153d - search page becomes default start page (new users are not forced to do configuration since this is not necessary) - adjusted top menu on search page (shows less stuff and now also the network graphics) - adjusted the network page (looks better in when showing no other navigation on top) orbiter 2011-01-26 14:58:28 +00:00
  • 1bda9e7ed9 option in network servlet to show the servlet with simple or embed menus orbiter 2011-01-26 13:59:55 +00:00
  • 991b92f4ae enhanced network graphic orbiter 2011-01-26 13:52:46 +00:00
  • 30df013c2b de.lng: Added German translation to Network Scanner menu CrawlStartScanner_p.html: Modified HTML code to validate HTML 4.01 Strict, switched selectAll Javasript, added end tags to input, etc ... mikeworks 2011-01-23 18:36:44 +00:00
  • 0887a1c86f better table layout in Network and API Administration orbiter 2011-01-22 10:53:36 +00:00
  • 59d9fe1bd7 added more php mime types orbiter 2011-01-22 09:52:36 +00:00
  • 3ae8f40fc8 removed yacy.network.group - this feature was never used orbiter 2011-01-22 09:50:36 +00:00
  • efb4ca8fa8 modified auto-delete of search failure-words: - words are now not deleted from the search index automatically if index receive is switched off - a flag in the network definition defines if this feature is switched on at all - the search filter for not-found word references is switched off for server-side remote searches orbiter 2011-01-22 09:46:00 +00:00
  • 58346b9a76 *) added lock symbol to "API Action Steering" link in menu since the page is protected low012 2011-01-22 02:11:18 +00:00
  • 79c5b35a6a fix bug in installer in case there was a 32 bit jre installed on a 64 bit windows. now the necessary 64 bit jre gets installed. danke PCA42! http://forum.yacy-websuche.de/viewtopic.php?p=21631#p21631 lotus 2011-01-21 18:09:24 +00:00
  • f1f03d8c90 more logging for strange network loading bug orbiter 2011-01-19 09:31:56 +00:00
  • 4e29e9712a * create cleanupjob for cached failed urls f1ori 2011-01-17 15:04:00 +00:00
  • a321c7673d * adminAccountForLocalhost only for localhost * yacy crawls local domains also, if no password is set (the interface is already protected) * it's not required anymore, to set a password in intranet mode f1ori 2011-01-17 11:37:30 +00:00
  • c9cd03b532 adding convenient option for contacting peer on network page 4. can be used on creating new network. this page is hidden from the interface (not linked). lotus 2011-01-15 18:49:51 +00:00
  • 930cb412dd Let SHORT_MILSEC_FORMATTER make a new formatted String every millisecond see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3103 hermens 2011-01-15 13:16:40 +00:00
  • 090c73e32e catch a OOM in HeapReader iteration orbiter 2011-01-12 12:04:18 +00:00
  • 48463c4507 *) General private License? ;-) *) minor code changes low012 2011-01-12 00:28:08 +00:00
  • c93f4dda72 - cleaned up yacy news - removed unused methods - avoid news generation in case that the peer runs in robinson mode orbiter 2011-01-12 00:00:14 +00:00
  • 6c1b14c8e1 - more control in access tracker: count number of returned search results (not only info how much is in the index) - extended query params for this - enhanced cora orbiter 2011-01-11 22:58:14 +00:00
  • fafab7a8fe * provide option to delete cached snippet fetching failures f1ori 2011-01-10 21:40:56 +00:00
  • 9f38c0023d *) Minor changes, mainly cleaning up a little bit, no functional changes. low012 2011-01-10 20:24:52 +00:00
  • 809e643ab7 *) Fixed bug where a number followed by characters was allowed as a valid value for the amount of memory which YaCy is allowed to consume. low012 2011-01-10 17:47:23 +00:00
  • 54e77e6255 refactoring orbiter 2011-01-10 08:40:41 +00:00
  • f5baf53391 fix for oob in snippet generation orbiter 2011-01-05 17:35:36 +00:00
  • feefe17568 npe assert fix orbiter 2011-01-04 12:24:41 +00:00
  • 19711ff6d6 added target that compiles only the cora package orbiter 2011-01-04 00:44:03 +00:00
  • 733903f2c9 fix for http://forum.yacy-websuche.de/viewtopic.php?p=21489#p21489 orbiter 2011-01-03 23:06:33 +00:00
  • 24e4126eee added JSON parser code from json.org (added generics to it) orbiter 2011-01-03 22:53:15 +00:00
  • 10ae8d961b - cora package has now no dependencies to other yacy packages and becomes a 'base' package (refactoring) - cleaned up (removed special code and documentation for 27c3) - added remote search functions to be used within cora orbiter 2011-01-03 20:52:54 +00:00
  • 0e54233408 UPnP: map port again if we are not reachable (e.g. when router rebooted) lotus 2011-01-02 21:17:21 +00:00
  • b1484299b2 same units for memory observer configuration (MiB) old setting for DHT (RAM) will be lost after update can be set on /Performance_p.html lotus 2011-01-02 20:38:01 +00:00
  • 621e176071 enhancement in table display of path names orbiter 2010-12-30 01:46:37 +00:00
  • bbd3d64cc2 * fix layout of yacyinteractive f1ori 2010-12-30 01:04:08 +00:00
  • 2751c52617 layout orbiter 2010-12-30 00:49:51 +00:00
  • 387db84087 maybe found bug in non-working index dumper orbiter 2010-12-30 00:02:42 +00:00
  • 4bce2f9c20 added a (temporary) description for 27c3 search set-up that everyone can see if they use YaCy here. orbiter 2010-12-29 18:56:42 +00:00
  • 89ae6101b9 fix for NPE and added comment in search result orbiter 2010-12-29 14:51:07 +00:00
  • 0769f4caa6 added search suggestions for interactive search: is only shown if there are no search results orbiter 2010-12-29 14:30:25 +00:00
  • a4c9d27287 - moved some variables from Stwitchboard to new class AccessTracker - added a limitation in access tracking to delete queries which are older than 10 minutes orbiter 2010-12-29 01:54:27 +00:00
  • 0c79789517 * labels for index delete checkboxes f1ori 2010-12-28 17:59:14 +00:00
  • e4aabaa1c3 * fix negative filelength for files >2G f1ori 2010-12-28 17:25:39 +00:00
  • cdfe8afe3f fix for really bad table iteration implementation: reduction of IO orbiter 2010-12-28 16:44:55 +00:00
  • 9eae33f886 *) Ooops... low012 2010-12-28 13:04:48 +00:00
  • a001e8075c *) minor enhancements low012 2010-12-28 13:03:49 +00:00
  • ecfacabad0 no db lookup during search / avoid IO orbiter 2010-12-28 12:10:48 +00:00
  • 11ea966f9e *) added SID file (Commodore 64) sound file parser *) minor changes low012 2010-12-28 12:06:04 +00:00
  • ee3cef91e8 * fix filesize in ftp crawls f1ori 2010-12-28 02:15:22 +00:00
  • b2ed4cfaf8 more small bugfixes and light refactoring orbiter 2010-12-28 01:57:05 +00:00
  • 1b6702146f remove '*' from query string (people believe that this is a wild card) orbiter 2010-12-28 01:27:36 +00:00
  • 3ca06d6290 patch for http://forum.yacy-websuche.de/viewtopic.php?p=21460#p21460 orbiter 2010-12-27 23:57:29 +00:00
  • 903c824c2c - allow only scanned resourced with granted status - increased time-out when scanning an ip range orbiter 2010-12-27 23:11:56 +00:00
  • 936e976c23 *) added FreeMind (http://freemind.sourceforge.net/) mindmap parser *) minor changes low012 2010-12-27 20:13:31 +00:00
  • 3d95981f7d *) cleaning up the code a little bit *) minor changes low012 2010-12-27 17:07:21 +00:00
  • 2a6499364d *) minor changes low012 2010-12-27 15:53:41 +00:00
  • c0274bd123 *) minor changes low012 2010-12-27 15:37:11 +00:00
  • e38217fe88 small changes to scanner orbiter 2010-12-26 23:21:34 +00:00
  • fe46536f6e enhanced network scanner (less name resolving during scanning and no name resolving during search) orbiter 2010-12-26 16:25:17 +00:00
  • a083cf531e added skin for 27c3 orbiter 2010-12-22 00:07:46 +00:00
  • e753027c43 fix for http://forum.yacy-websuche.de/viewtopic.php?p=21439#p21439 orbiter 2010-12-22 00:04:30 +00:00
  • bf4ef1513e - fix for map view - remove some UNRESOLVED PATTERN - maybe a fix for non-flushing cache orbiter 2010-12-21 23:48:05 +00:00
  • 6b70393d1d - new java version 1.6 - replaced old gif animator by java 1.6 gif animator orbiter 2010-12-20 22:51:50 +00:00
  • e88c428008 fix to ftp loader orbiter 2010-12-18 10:22:54 +00:00
  • 59b70a5a92 another fix to the ftp crawler: now correct directory listings according to rfc2640 (path with spaces) and better title names for such files orbiter 2010-12-18 00:44:19 +00:00
  • 9b25a33fd9 - fixed numerous bugs - better document names - fixed problem with ftp crawling - added automatic removal of search results from services that are not online according to the latest network scan: this does not delete the index but just does not show them. after the next network scan when the server is available again, the results are again showed. orbiter 2010-12-17 17:30:09 +00:00
  • 7bdb13bf7f more fixes to smb crawling: better file names orbiter 2010-12-17 00:52:24 +00:00
  • 94c48500cc several fixes orbiter 2010-12-17 00:11:42 +00:00
  • 0ac7311a62 fix for token parser orbiter 2010-12-16 23:47:36 +00:00
  • 58b59f9bc8 - a collection of bug fixes and some redesign of the Scanner class - fixed smb crawling - added smbget to download script generation orbiter 2010-12-16 23:37:21 +00:00
  • 4d5bb4c4ca *) Urks... low012 2010-12-16 18:51:20 +00:00
  • c54170421a fix for npe orbiter 2010-12-16 11:19:22 +00:00
  • c288fcf634 redesigned CrawlStartScanner user interface and added more features: - multiple hosts for environment scans can be given (comma-separated) - each service (ftp, smb, http, https) for the scan can be selected - the scan result can be accumulated or refreshed each time a network scan is made - a scheduler was added to repeat a scan and add all found urls to the indexer automatically orbiter 2010-12-16 02:15:20 +00:00
  • 6f4f957e50 *) cleaning up the code a little bit low012 2010-12-16 00:18:05 +00:00
  • 2521677a45 * deny adminForLocalhost and intranet network setup also on bootup and not only on network switch * require authentication for yacybot what ever adminForLocalhost is set to (after this patch, is the rule from above really nesseccary, the crawler also checks the robots.txt) f1ori 2010-12-15 21:39:02 +00:00
  • 9d2159582f * fix system update if urls are in blacklist (for example for very general blacklists like *.de) f1ori 2010-12-15 19:20:00 +00:00
  • 56264dcc17 - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls - integrated new parser into loader processes: enrich document parser - fixed a concurrent modification exception in kelondro iterator - hand-over of document size from crawler to indexer orbiter 2010-12-15 00:03:19 +00:00
  • 358feeeb39 enhanced speed and usability of network scanner servlet orbiter 2010-12-14 12:12:13 +00:00
  • 99a7fe87f9 - removed old intranet scanner (the generic scanner now completely subsumes the old one) - added information about granted access - enhanced servlet design - added submit-feedback (because it is a long-running task) orbiter 2010-12-14 01:14:15 +00:00
  • acab6801d9 added new network scanner - you can scan any ip or host in the internet for services - this replaces the intranet scanner orbiter 2010-12-13 18:19:37 +00:00
  • 586cbee2bb *) Fixed links to CrawlStart-page low012 2010-12-11 15:23:35 +00:00
  • 14e4fae8e9 fixes to ftp client orbiter 2010-12-11 09:21:37 +00:00
  • a563b05b60 enhanced crawler: - added a new queue 'noload' which can be filled with urls where it is already known that the content cannot be loaded. This may be because there is no parser available or the file is too big - the noload queue is emptied with the parser process which indexes the file names only - the 'start from file' functionality now also reads from ftp crawler orbiter 2010-12-11 00:31:57 +00:00
  • c36da90261 added a very fast ftp file list generator to site crawler: - when a site-crawl for ftp sites is now started, then a special directory-tree harvester gets the complete directory structure of a ftp server at once - the harvester runs concurrently and feeds into the normal crawl queue orbiter 2010-12-09 17:17:25 +00:00
  • 4565b2f2c0 removed the display option from index.html, yacysearch.html and yacyinteractive.html instead, a setting at ConfigPortal.html can be made to define if the topmenu shall be shown at these pages or if there is no naviagtion at all. orbiter 2010-12-08 10:50:23 +00:00
  • fc2e41e691 added a forwarder for the default page. The forwarder forwards a browser to a different page if the root file index.html is accessed. This can be done by setting the name of the forwarder page to the field "Default index.html Page (by forwarder)" in /ConfigPortal.html The purpose is to forward to /yacyinteractive.html for the 27C3 FTP search plattform orbiter 2010-12-07 15:46:04 +00:00
  • db99db4be9 some redesign of the search-fail-response mechanism: when a search fails for a single url because the snippet cannot be generated, then the url reference is deleted from the index. This mechanism was redesign and enhanced. The process now also writes into the work tables into the table searchfl to prepare a re-indexing mechanism. orbiter 2010-12-06 14:34:58 +00:00
  • 4915d1781a * use local backup-file, if remote network-definition is not availible * resolve single point of failure in networks, managed by central network-definitions f1ori 2010-12-06 11:09:16 +00:00
  • 18d33b5c6d fixed several search result navigation bugs fixed bad behaviours during search result collection orbiter 2010-12-05 23:54:00 +00:00
  • 49b5a206cd - better caclculation of search result size - predefined search recommendations orbiter 2010-12-02 12:19:59 +00:00