Commit Graph

  • 7b904e0077 integrated robots.txt crawlDelay into the crawl balancer orbiter 2007-06-06 07:53:56 +00:00
  • 52cb033f01 - slightly different painting of web structure picture: hosts that have many own connections are painted farer away (this is not yet cato's idea, this will be implemented in another step) orbiter 2007-06-05 15:32:43 +00:00
  • b955f29f70 more options and bugfix allo 2007-06-05 13:23:50 +00:00
  • ef2395c244 use form instead of javascript allo 2007-06-05 12:52:38 +00:00
  • 30c3d909b1 - fixed charset problem in ConfigProfil_p.html (use accept-charset="UTF-8" in forms) - fixed wrong XML output if no peers are known in Network.xml - simplified parsing of table properties in wikiCode and ZTableToken - reimplemented GC heuristics. They are needed to constantly ensure that an amount of free memory is available which is higher than Java's max. limit for performing a Full GC (please use serverMemory.request(long, boolean) rather than serverMemory.available(long, boolean) to provide data for averaging over the last GCs) karlchenofhell 2007-06-05 11:37:19 +00:00
  • 6c9df13552 more debugging allo 2007-06-04 20:30:40 +00:00
  • 089c2a7c39 firefox-like filter function. allo 2007-06-04 17:33:29 +00:00
  • 4392ee0c51 BugFix for typo and wrong include allo 2007-06-04 16:06:58 +00:00
  • d1e1580223 Surftips Blacklist Blacklists List Hardcoded instead of only updated on firststart / migration.java allo 2007-06-04 15:36:10 +00:00
  • 051a65f7af *) Snippet fetching: Snippet are now fetched synchronous if the query parameter "fetchSnippet=" is appended to the query string on the yacy search page. This is required for the RSS feed. See: http://www.yacy-forum.de/viewtopic.php?t=4051 *) Small changes in the XSLT-stylesheet that is used to generate a html page from the RSS feed. theli 2007-06-04 05:27:46 +00:00
  • e1a5babff1 *) Logging GUI handler: line-size is now set to max-size if max-size was exceeded See: http://www.yacy-forum.de/viewtopic.php?p=36355 theli 2007-06-02 21:23:32 +00:00
  • 94cc9f05f5 *) Improvements for restart via update wrapper (no author) 2007-06-02 15:25:13 +00:00
  • 54ddb3262c enter on webstrucutre allo 2007-06-02 14:50:36 +00:00
  • edec6049c3 - fix for UPNP error, TODO: via ajax - removed unused "type" argument in yacysearch.html karlchenofhell 2007-06-02 08:53:08 +00:00
  • 5fc00871a9 getpageinfo/sitemap bugfix allo 2007-06-01 16:03:08 +00:00
  • e7da3d2340 fixed sitemap url in getpageinfo added suggested tags/keywords in getpageinfo allo 2007-06-01 14:44:46 +00:00
  • d0f8254f95 better refresh ui allo 2007-06-01 13:58:48 +00:00
  • 44bac7dea1 *) blog-comments can now be moderated hydrox 2007-06-01 06:02:55 +00:00
  • 2ab020445a bugfix, i think - http://www.yacy-forum.de/viewtopic.php?t=4059 borg-0300 2007-05-31 17:03:02 +00:00
  • f89517203d *) SOAP: new function to get the Performance Settings of Queues and Processes No items left in the yadmin SOAP-TODO :-) (no author) 2007-05-31 15:47:58 +00:00
  • 92351c4dcb *) SOAP: bookmarks list now indicates if a bookmark is private (requested by KoH) (no author) 2007-05-31 14:54:56 +00:00
  • 957a25afff getRight(rightName) instead of get...Right() allo 2007-05-31 14:48:20 +00:00
  • e0e46d3aec *) SOAP: new function doGarbageCollection (requested by KoH) (no author) 2007-05-31 14:32:41 +00:00
  • 5f80b72cac *) adding peer-hash, seed-url and location to network.xml (no author) 2007-05-31 14:22:27 +00:00
  • 1efe607c34 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3771 6c8d7289-2bf4-0310-a012-ef5d649a1542 (no author) 2007-05-31 11:24:59 +00:00
  • 0610285c4f *) totalResults and itemsPerPage gets set again low012 2007-05-29 21:15:42 +00:00
  • 5cc8bb075b Syntaxfehler beseitigt (no author) 2007-05-26 19:51:05 +00:00
  • a97a3756fe *) got rid of HTML in Java classes that led to HTML tags being displayed on monitor pages low012 2007-05-25 19:54:54 +00:00
  • a0149317ac *) fixed bug where headlines were added to directory of a wiki page multiple times (http://www.yacy-forum.de/viewtopic.php?t=4034) low012 2007-05-25 16:36:09 +00:00
  • ef24bed406 Sorry... (no author) 2007-05-24 16:25:07 +00:00
  • a29cb2e1af blupp (no author) 2007-05-24 16:14:46 +00:00
  • 651b05ba43 *) wsdl file updated (requested by KoH) theli 2007-05-24 16:07:58 +00:00
  • 0ae6664ad8 enhanced web structure picture - hand-over of get properties from web front-end to graphics generation - added depth-control buttons - added marking of anchor-points to highlight relation order - enhanced ymage graphics library orbiter 2007-05-24 15:28:03 +00:00
  • 2f34f32ce3 added .classpath orbiter 2007-05-24 07:30:43 +00:00
  • 54ca71535e added search protection also to detailed search orbiter 2007-05-23 19:17:36 +00:00
  • b3d2fafcfb added option to block the search function against unauthorized users orbiter 2007-05-23 19:09:19 +00:00
  • dee29faf15 *) System independent restart is now possible if using the updater/wrapper. - Part 1/2 (YaCy side) The old Windows-only method has not been removed, so Windows-users without updater are still able to restart without updater rramthun 2007-05-23 18:42:31 +00:00
  • 3562fe1706 should not be there orbiter 2007-05-23 18:14:07 +00:00
  • c321ddff7a redesigned access control to surftips: - access is now granted to authorized admin, even if it is blocked to the public - generalized naming - changed links to buttons orbiter 2007-05-23 17:49:16 +00:00
  • 8b393744f1 #first version of french language file by gDupont daburna 2007-05-23 10:43:54 +00:00
  • b4b56a5475 *) Preparations for system-independent restart using the wrapper. Not functional yet. (no author) 2007-05-22 20:41:15 +00:00
  • a585b4d41b added web structure image see http://localhost:8080/WatchWebStructure_p.html orbiter 2007-05-22 15:20:50 +00:00
  • 33ad0c8246 added a web structure computation and logging: - all web page parsing operations will now increase a web structure file - the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database) - the file can be used externally to analyse the link structure of the crawled pages - the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml - the short-term purpose is the computation of a link-graph image (before linuxtag!) - a long-term purpose could be a decentralized computation of the citation rank orbiter 2007-05-22 08:13:48 +00:00
  • cd3494a04c *) hint for idle indexer only appears if indexer is idle now auron_x 2007-05-21 11:57:57 +00:00
  • 7904175338 - sorry for typos karlchenofhell 2007-05-20 16:22:46 +00:00
  • baa9402b97 - wiki-parser is now configurable via the config setting wikiParser.class which holds the class-name for the parser to use karlchenofhell 2007-05-20 16:19:25 +00:00
  • 601fc7d1c5 - added source to J7Zip-modifed.jar and it's license (changelog is still to come) - moved HTML-*replace-methods from wikiCode to de.anomic.data.htmlTools - prepared use of different wiki parsers as suggested here: http://www.yacy-forum.de/viewtopic.php?p=34444#34444 karlchenofhell 2007-05-20 13:29:12 +00:00
  • 0a64047081 - plasmaParserDocument can process subdocuments now (other archive-parsers may want to use this method) - added 7zip parser - added 'text/sgml' to realtime parseable mimetypes (sometimes returned by the mime type parser) - added new cached output stream class, very suitable for parsers because of limited memory karlchenofhell 2007-05-18 23:13:44 +00:00
  • b1680ab71f *) bugfix for ArrayIndexOutOfBoundsException in robots-parser (thanks to low012) theli 2007-05-18 13:39:08 +00:00
  • b30e64daab *) passing homepath to serverLog.configureLogging theli 2007-05-18 13:04:26 +00:00
  • 9a4375b115 *) robots.txt: adding support for crawl-delay theli 2007-05-18 13:00:42 +00:00
  • 11ac7688d5 reverted a part of last commit orbiter 2007-05-16 17:52:11 +00:00
  • b3f97b5c38 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542 orbiter 2007-05-16 17:45:39 +00:00
  • 3c5ff7f735 adopted kelondroBytesIntMap to kelondroIntBytesMap orbiter 2007-05-16 15:20:15 +00:00
  • 5551ff5306 enhanced index storage data structure kelondroBytesIntMap this stores now two index structures, one for data that is aquired during start-up and one for data that is aquired during run-time. This reduces the grow factor, and should reduce the memory amount in case that a index-reorganisation happens. orbiter 2007-05-16 14:36:56 +00:00
  • 872eb46cb9 some redesign of the handling of the index for kelondroFlexTable orbiter 2007-05-16 10:48:26 +00:00
  • 086239da36 - added servlet: remote crawler queue overview - added servlet: crawl profile editor karlchenofhell 2007-05-16 10:11:25 +00:00
  • 4dc45d6e97 *) adding tags for skype theli 2007-05-15 16:18:51 +00:00
  • 8ba81e0995 - added some comments (will get more in the near future) - added missing <label> to the search field in Network.html karlchenofhell 2007-05-15 15:48:28 +00:00
  • eda8696e33 http://www.yacy-forum.de/viewtopic.php?p=35721 wrong startindex allo 2007-05-14 21:27:48 +00:00
  • 65a8a9fc58 fix for nullpointer allo 2007-05-14 16:56:13 +00:00
  • b05e2314cf another dht selection fix orbiter 2007-05-14 12:52:39 +00:00
  • 03c6551b0c - fix for http://www.yacy-forum.de/viewtopic.php?t=3747 karlchenofhell 2007-05-14 12:44:44 +00:00
  • b28e5d0ee9 protection against wrong word hash length see http://www.yacy-forum.de/viewtopic.php?p=35657#35657 orbiter 2007-05-14 10:00:23 +00:00
  • e897eb9b4a fix for DHT selection target orbiter 2007-05-14 08:17:36 +00:00
  • 4e68a10cd9 *) Updating News.rss theli 2007-05-13 23:40:57 +00:00
  • 419183c686 *) Updater now writes logfile *) Update-Thread now terminates correctly rramthun 2007-05-13 19:43:17 +00:00
  • 0384b8771b fix for http://www.yacy-forum.de/viewtopic.php?p=35700#35700 orbiter 2007-05-13 19:37:16 +00:00
  • 23f6150a5b *) Updater now checks for updates even while waiting for user to approve update *) Changed YaCy version back to dev scheme rramthun 2007-05-13 12:51:03 +00:00
  • 9f96eeee7f documentation update (download links and english forum) orbiter 2007-05-12 18:22:24 +00:00
  • c3589ecdc2 demo update orbiter 2007-05-12 09:32:10 +00:00
  • 578c2ef130 release 0.52 orbiter 2007-05-11 22:12:29 +00:00
  • 4abaa80b79 different memory settings orbiter 2007-05-11 21:06:24 +00:00
  • 00611a6f27 *) Language changes rramthun 2007-05-11 20:40:31 +00:00
  • 756a27049b last-minute-feature 'newbie-selection' for workshop purpose: for remote search, always select all peers that are less than a day old (should be removed someday in the future if load is too high, which could mean when pph > 100) orbiter 2007-05-11 19:55:19 +00:00
  • c73b7588ed documentation update / release info orbiter 2007-05-11 19:01:47 +00:00
  • 424146f027 more XHTML validation (no author) 2007-05-11 18:19:09 +00:00
  • 46367afaaa update of memory-protection values see http://www.yacy-forum.de/viewtopic.php?p=35539#35539 orbiter 2007-05-11 18:02:48 +00:00
  • ea87fe5d78 *) Updated German translation *) Changed "Lost Handle" error to warning (masses of it if deleting crawl-profile) *) Removed unnecessary code from Windows script rramthun 2007-05-11 17:48:22 +00:00
  • 841e51e15e *) addition to last commit (just commited html-changes) auron_x 2007-05-11 11:00:17 +00:00
  • 15ad9ff32e *) removed unneccessary debug-lines auron_x 2007-05-11 10:56:03 +00:00
  • d5e634d06b *) Updater r3 - Please test and report major problems (don't use this version for stable-release, r3 updates always to latest dev-version of YaCy) rramthun 2007-05-10 20:47:23 +00:00
  • d78f5785d2 added more dyndns addresses orbiter 2007-05-10 14:12:07 +00:00
  • 85035dc319 addition to svn 3699: check send/receive if p2p-mode is activated orbiter 2007-05-10 13:27:38 +00:00
  • 709b4c1905 added switches for the columns borg-0300 2007-05-10 11:36:04 +00:00
  • 1d1685c588 *) added some JS to give more direct feedback auron_x 2007-05-10 11:15:55 +00:00
  • 26f05d1fd0 avoid division by zero if search is done for no words this case is relevant if the bluewords (yacy.blue) are used orbiter 2007-05-09 22:10:12 +00:00
  • 2fa8b50e54 reverting svn 3691+3692 orbiter 2007-05-09 19:31:40 +00:00
  • ea591630cb *small update TO DO: - remove unused strings - update translation for Wikihelp daburna 2007-05-09 19:22:52 +00:00
  • 0132fb6ea7 Status.html now more XHTML valid (no author) 2007-05-09 18:11:03 +00:00
  • 139c59ebbd - fixed dht selction problem: the seed tables used a wrong ordering - cleaned some code orbiter 2007-05-09 17:59:36 +00:00
  • 22a0e9f117 more timeout-control orbiter 2007-05-09 14:53:17 +00:00
  • 24db55a541 added timeout for httpd-sockets during read orbiter 2007-05-09 14:30:01 +00:00
  • c671d70b2e *) added german translation for NetworkConfig auron_x 2007-05-08 13:33:06 +00:00
  • f3fee4d445 fix for http://www.yacy-forum.de/viewtopic.php?p=35322 orbiter 2007-05-08 09:19:36 +00:00
  • c209ef5137 changed the icons again - slightly different size of '!' - differen colours of idea-icon orbiter 2007-05-08 09:18:46 +00:00
  • 6e74adcb54 *) Bugfix for layout problem with hint boxes See: http://www.yacy-forum.de/viewtopic.php?p=35316 theli 2007-05-08 04:49:04 +00:00
  • a50256aba2 *) removed surplus replacements of HTML low012 2007-05-08 00:16:17 +00:00
  • 7f56c8d4aa fixed some seed selection details orbiter 2007-05-07 22:22:35 +00:00
  • e602436fda fixed problem with cluster routing orbiter 2007-05-07 20:48:24 +00:00