Commit Graph

  • 140c3e1db9 Some bugfixes: updated ids for labels in DetailedSearch.html, fixed a template-bug in Network.html and added a workaround for a bug in the template engine in IndexTransfer_p.html michitux 2006-09-12 14:16:36 +00:00
  • 75b198bc02 - updated references to indexContainer - more bugfixes and debugging for indexAbstract processing orbiter 2006-09-12 11:13:27 +00:00
  • 0bed3b9ac3 removed superfluous interface orbiter 2006-09-12 11:09:51 +00:00
  • b7e7808ea6 wordmigration now works also for new index database if the new database is switched on, no 'too big' messages appear, all the WORDS files can be completely migrated orbiter 2006-09-12 08:23:47 +00:00
  • a0ddf2ec11 *) AbstractCrawlWorker.java: delete already downloaded data on crawling error *) plasmaSwitchboard.java: log unexpected errors while parsing/indexing theli 2006-09-12 04:50:12 +00:00
  • 4f9e42d5ed more changes towards better join-search - fixed problems with index-abstract generation - added analysis output for index abstract receive orbiter 2006-09-12 00:42:42 +00:00
  • 8219ce6c67 bugfix inn DetailedSearch form names orbiter 2006-09-11 23:07:28 +00:00
  • 462c64a935 removed superfluous file orbiter 2006-09-11 22:13:41 +00:00
  • 1137605edf - small change to DetailedSearch layout - version 0.463 for new xhtml interface orbiter 2006-09-11 22:11:05 +00:00
  • 31393312d0 New XHTML-template for a large part of the frontend, for details see http://yacy-websuche.de/wiki/index.php/Dev:XHTML If you don't use the default skin, the style will be broken or at least not complete. YaCy now has two css-files: base.css in htroot/env and the skin. In base.css the layout and black/white text-formating-rules are defined. Colors are only defined in the skin. The skin is now very easy to read and to change. If you want to make more changes than the colors you see in the default-skin, feel free to use the full power of css, but you are warned: The code is still not ready and may change, but we try to avoid changes which affect anything in the default-style. Translation will be broken too because the language-files contain HTML-Code which has changed. michitux 2006-09-11 18:18:12 +00:00
  • 005400a137 *) reverted last commit auron_x 2006-09-11 14:41:06 +00:00
  • a7281a9b4d fix for last commit orbiter 2006-09-11 11:12:42 +00:00
  • 82a6054275 - fixed bug with new indexAbstract generation - added partly evaluation of indexAbstracts during remote searches orbiter 2006-09-11 10:39:25 +00:00
  • fded1f4a5d *) better handling of maximum file size limit in crawler theli 2006-09-11 08:26:39 +00:00
  • 416b4e5c6b ups orbiter 2006-09-11 08:17:55 +00:00
  • 309accb983 memory control for ymage generation: the ymageMatrix initializer throws an RuntimeException if there is not enough memory available to generate a new ymage of wanted size orbiter 2006-09-11 07:01:39 +00:00
  • 7b1881754d *) Corrections for FF search plugin theli 2006-09-11 06:30:34 +00:00
  • 74d1dea30b changes towards better join-search - added generation of a compressed index within remote peers during global search - added selection of specific urls within remote peers during secondary global search orbiter 2006-09-10 22:36:47 +00:00
  • 4a494464af *) splitted form to avoid unwanted remove of selected entries as suggested by KoH auron_x 2006-09-10 21:03:34 +00:00
  • 045ffebbd8 *) added debugline to versionstring-processing to find a possible bug in versiongeneration auron_x 2006-09-10 20:50:37 +00:00
  • ae4e8ce03e - cut for 'probably last html-interface version': version number update - small enhancement to ranking orbiter 2006-09-10 19:44:11 +00:00
  • 64bed59ee8 enhancements to ranking orbiter 2006-09-09 23:44:54 +00:00
  • 63893003be *) Adding settings page for the crawler which allows to specify a file size limit and the timeout to use. *) adding first version of maximum filesize check for the crawler theli 2006-09-09 15:06:49 +00:00
  • ecbce206b7 *) Bugfix for UNRESOLVED_PATTERN in threadpool configuration See: http://www.yacy-forum.de/viewtopic.php?p=25377#25377 theli 2006-09-09 13:07:40 +00:00
  • 92e986bb91 *) adding missing return prop (requested by allo) theli 2006-09-09 12:34:24 +00:00
  • f0529fe53e update for ftp urls allo 2006-09-09 12:28:28 +00:00
  • 06b1365066 *) fixed existing protection against divbyzero and removed the new one auron_x 2006-09-08 23:43:30 +00:00
  • 94d7ced900 fix for last ranking commit orbiter 2006-09-08 21:14:57 +00:00
  • cc97a3e9c6 fixed possibly bug with indexOutOfBoundsException orbiter 2006-09-08 20:27:45 +00:00
  • 03835c2ee8 enhanced search result computation orbiter 2006-09-08 20:26:44 +00:00
  • 809960ddc6 avoid division by zero orbiter 2006-09-08 20:00:19 +00:00
  • ac3419b65f better debugging for indexOutOfBoundException bug orbiter 2006-09-08 19:41:52 +00:00
  • 75b03a4580 fix for new ArrayIndexOutOfBoundException orbiter 2006-09-08 19:15:55 +00:00
  • a8bc768206 enhancements to ranking evaluation orbiter 2006-09-08 16:04:50 +00:00
  • a82e926c5d *) fix for wrong totalPPM-calculation auron_x 2006-09-08 15:19:16 +00:00
  • 33898ae7e9 *) ResourceInfoFactory.java: Bugfix for classNotFoundException See: http://www.yacy-forum.de/viewtopic.php?t=2797 theli 2006-09-08 13:43:23 +00:00
  • c543028dd4 fixed double/missing null check for LURLs orbiter 2006-09-08 11:54:28 +00:00
  • 406e170e25 *) more verbose error message theli 2006-09-08 11:48:49 +00:00
  • b298474e22 *) Bugfix needed because of changed plasmaCrawlLURL.load behavior theli 2006-09-08 11:33:27 +00:00
  • c2e6cc8c6b small part of Bosts patch orbiter 2006-09-08 01:40:23 +00:00
  • 96c6e4e322 - enhancements to detailed search page - enhancements to search ranking computation process - removed bugs in postranking orbiter 2006-09-08 01:26:06 +00:00
  • 76f9dc5d26 dark blue skin from frankenstein_1012 allo 2006-09-07 23:46:48 +00:00
  • e33eb528ba fixed DetailedSearch orbiter 2006-09-07 22:54:49 +00:00
  • 9340dbb501 fixed all possible problems with nullpointer exception for LURLs orbiter 2006-09-07 18:24:39 +00:00
  • a5ed86105b *) bugfix for handling of ResourceInfo object in proxy theli 2006-09-07 15:50:45 +00:00
  • ff4362b02d some more fixes for new plasmaCrawlLURL.load behavior hermens 2006-09-07 14:32:46 +00:00
  • 7aeadbe7cc another NullPointerException in http.ResourceInfo hermens 2006-09-07 13:13:19 +00:00
  • 141f9e5bb4 fix for new plasmaCrawlLURL.load behavior orbiter 2006-09-07 12:27:32 +00:00
  • 1e7fd48afd added size method to ftpc orbiter 2006-09-07 12:21:41 +00:00
  • 087f7511f8 prevent NullPointerException in http.ResourceInfo hermens 2006-09-07 11:46:22 +00:00
  • a2525072f2 bugfix for kelondroRow - property generation this bug affected ranking parameters :-( orbiter 2006-09-07 10:55:34 +00:00
  • 59a5511dbb *) added missing static Strings as requested by theli hydrox 2006-09-07 07:20:28 +00:00
  • 6578564c9a *) Ignore more hop by hop http headers theli 2006-09-07 05:38:35 +00:00
  • b44514242a *) crawler/ftp/CrawlWorker.java: better errorhandling theli 2006-09-07 05:22:35 +00:00
  • 7d7f30139c *) crawler/ftp/CrawlWorker.java: delete old cache file theli 2006-09-07 05:08:35 +00:00
  • 4ae0f122f8 *) ResourceInfo.java: License header added theli 2006-09-07 05:01:07 +00:00
  • 35b70f164c *) Status_p.inc: link to memory configuration added *) startYACY.bat: comment added See: http://www.yacy-forum.de/viewtopic.php?p=25311#25311 theli 2006-09-07 04:36:58 +00:00
  • 043edfa4d8 *) ftp/ResourceInfo.java ResourceInfo object for ftp resources added *) ftp/CrawlWorker.java better errorhandling for ftp crawler *) plasmaCrawlEURL.java: some errorcodes added theli 2006-09-07 04:12:52 +00:00
  • 4866868c0e added write cache for LURLs This was necessary to speed up the index receive process during global search orbiter 2006-09-07 01:13:03 +00:00
  • 8a0e35618b enhancements to search result preparation - added detailed count on remote search results - enhanced search sequence during remote searches (doing local search in sequence) - strict adherence to timout limits orbiter 2006-09-06 17:51:28 +00:00
  • 5c1bb53d2a Missing description for last commit *) next step of restructuring for new crawlers > HTCaching should now work protocol independent -- introduction of new ResourceInfo objects containing protocolspecific metadata of a resource. -- the ResourceInfo objects now implement old functions like shallIndexCacheForXXX, shallStoreCacheForXXX in a protocol dependent manner > Indexing should also work protocol independent now theli 2006-09-06 14:35:45 +00:00
  • dae763d8e3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2495 6c8d7289-2bf4-0310-a012-ef5d649a1542 theli 2006-09-06 14:31:17 +00:00
  • 4825bfaaf3 *) Bugfix for PrintWriter Problem See: http://www.yacy-forum.de/viewtopic.php?t=2792 theli 2006-09-05 18:55:45 +00:00
  • d4c5e2af01 html-dirlist can now also be generated from existing connections orbiter 2006-09-05 10:11:07 +00:00
  • 7930839594 *) URL.java: userinfo was not taken over when generating a new url from a base url and a rel. path *) CrawlWorker.java: using new dirhtml function of ftpc theli 2006-09-05 05:17:57 +00:00
  • 17ba468165 added html dirlisting generation in ftpc.java: ftpc.dirhtml() generates a StringBuffer with a complete web page orbiter 2006-09-05 00:11:59 +00:00
  • 2dacf63dd9 Spelling correction of the language list "Slovenky" -> "Slovensky" (no author) 2006-09-04 19:55:21 +00:00
  • 413e6b9855 *) direct access to responseheaders of sbQueue.Entry removed to make it more http independent theli 2006-09-04 15:56:49 +00:00
  • 2126c51906 *) bugfix for ViewFile.java. Wrong http header were used theli 2006-09-04 15:49:51 +00:00
  • 7a35b8e237 *) direct access to responseheaders of sbQueue.Entry removed to make it more http independent theli 2006-09-04 15:36:19 +00:00
  • ffbf416e76 *) direct access to requestheader of htCache.Entry removed to make it more http independent theli 2006-09-04 15:29:45 +00:00
  • 3870d615e3 *) setting htCache.Entry fields to private theli 2006-09-04 15:06:58 +00:00
  • 393a7d10be *) setting htCache.Entry fields to private theli 2006-09-04 15:03:54 +00:00
  • ab5a9bee66 *) adding some copyright headers theli 2006-09-04 14:38:29 +00:00
  • 5847492537 *) next step of restructuring for new crawlers - IndexCreate_p.java: correcting problems with ftp urls - URL.java does not cutout the userinfo anymore (needed to transport authentication info in ftp urls, e.g. ftp://username:pwd@ftp.irgendwas.de) - plasmaCrawlLoader.java: -- hack to re enable https urls -- adding function getSupportedProtocols theli 2006-09-04 13:17:11 +00:00
  • 6cce47e217 test of ftp-urls in URL class orbiter 2006-09-04 13:10:40 +00:00
  • fce9e7741b *) next step of restructuring for new crawlers - renaming of http specific crawler settings theli 2006-09-04 11:56:47 +00:00
  • e3f0136606 *) next step of restructuring for new crawlers - adding function isSupportedProcotol to plasmaCrawlLoader.java - disabling robots.txt check for protocols other than http(s) theli 2006-09-04 11:46:17 +00:00
  • 9ded4e8d5a *) Bugfix for name resolution in proxy mode See: http://www.yacy-forum.de/viewtopic.php?p=25241 theli 2006-09-04 11:26:53 +00:00
  • 1c8300fcec *) Bugfix for name resolution in proxy mode See: http://www.yacy-forum.de/viewtopic.php?p=25241 theli 2006-09-04 11:23:57 +00:00
  • 4e2a950ac9 *) next step of restructuring for new crawlers - avoid using the http crawler class directly. Using the interface class instead theli 2006-09-04 09:24:24 +00:00
  • f94131c13d *) Bugfix for Blacklist_p.java - avoid nullpointerexception theli 2006-09-04 09:02:23 +00:00
  • 09b106eb04 *) next step of restructuring for new crawlers - adding interface class (plasma/crawler/plasmaCrawlWorker.java) for protocol specific crawl-worker threads - moving reusable code into abstract crawl-worker class AbstractCrawlWorker.java - the load method of the worker threads should not be called directly anymore (e.g. by the snippet fetcher) to crawl a page and wait for the result use function plasmaCrawlLoader.loadSync([...]) theli 2006-09-04 09:00:18 +00:00
  • eb9b138986 *) next step of restructuring for new crawlers - conversion of the crawler pool into a keyed object pool - crawlers are now loaded based on the url protocol (of course works only for http now) theli 2006-09-04 06:52:55 +00:00
  • 1395aae742 *) starting restructuring which is needed to add crawlers for additional protocols theli 2006-09-04 06:09:20 +00:00
  • 857a2d76a2 *) better handling of server shutdown See: e.g. http://www.yacy-forum.de/viewtopic.php?p=25234 theli 2006-09-04 05:47:17 +00:00
  • b4acbdaa97 *) better handling of server shutdown See: e.g. http://www.yacy-forum.de/viewtopic.php?p=25234 theli 2006-09-04 05:17:37 +00:00
  • 7df572756a fist step+attempt so solve the snippet marking problem. See: http://www.yacy-forum.de/viewtopic.php?p=22855#22855 orbiter 2006-09-03 23:22:23 +00:00
  • f3ac4dbbb9 *) better handling of server shutdown See: e.g. http://www.yacy-forum.de/viewtopic.php?t=2584 theli 2006-09-03 14:59:00 +00:00
  • 959b779aba *) avoid performance loss if log level is greater than 'fine' See: http://www.yacy-forum.de/viewtopic.php?p=25180 theli 2006-09-03 08:42:46 +00:00
  • b515d49f87 *) fix for new combinedVersionString2PrettyString by bost auron_x 2006-09-02 07:29:12 +00:00
  • 24316ba937 *) improved implementation of combinedVersionString2PrettyString by bost auron_x 2006-08-30 16:04:40 +00:00
  • 57dda1a92c *)again fixing for wrong version display, now totally working with double instead of float auron_x 2006-08-28 17:54:07 +00:00
  • 479b74e1dd *) fix for stupid mistake in new ppm-calc which caused decimal digits beeing written to seedinfo auron_x 2006-08-28 04:43:28 +00:00
  • 5e558fbaae *) hopefully fixed the wrong display of yacy-version auron_x 2006-08-27 21:52:58 +00:00
  • 348258a557 *) changed PPM-calculation to be much more accurate auron_x 2006-08-27 17:18:34 +00:00
  • 18b6876860 new cache flush configuration settings orbiter 2006-08-25 22:31:21 +00:00
  • f0278b4092 Bugfix for / by zero when the AssortmentCluster is empty See: http://www.yacy-forum.de/viewtopic.php?t=2746 hermens 2006-08-25 20:23:04 +00:00
  • 14e0bb0dcf allow more references per word for new db orbiter 2006-08-25 12:06:23 +00:00
  • 985dcbde7f changed some parameters that may cause better memory usage and more indexing speed orbiter 2006-08-24 23:39:52 +00:00