Commit Graph

  • 85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug orbiter 2005-06-20 00:46:23 +00:00
  • e3c92818db avoiding OutOfMemoryError routines orbiter 2005-06-19 13:37:17 +00:00
  • 3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer orbiter 2005-06-19 05:27:42 +00:00
  • 3be98f194d tried to find the socket bug orbiter 2005-06-18 01:48:11 +00:00
  • 10781f36b7 changed performance menu to accept milliseconds; 200 milliseconds may be appropriate for all crawling jobs; indexing should be set to 0 orbiter 2005-06-17 11:52:21 +00:00
  • 3227a9eba5 *) Adding retry function for seed uploading theli 2005-06-17 08:45:44 +00:00
  • dff937a9a3 *) Adding some logging statements to detect problems with seed upload functionality theli 2005-06-17 08:38:22 +00:00
  • 98230a67f0 *) correcting version number for remote port forwarding feature check theli 2005-06-17 08:16:43 +00:00
  • 9f5d239051 *) correcting version number for remote port forwarding feature check theli 2005-06-17 08:06:23 +00:00
  • 0405de7635 *) Avoiding NullpointerException while testing exception test theli 2005-06-17 08:04:53 +00:00
  • db3ed75728 *) closing stream correctly theli 2005-06-17 07:58:02 +00:00
  • aea355c03c *) adding test for connection status of port forwarding feature theli 2005-06-17 07:57:00 +00:00
  • bf66c6d6ec *) Bugfix for java.lang.NoClassDefFoundError: de/anomic/yacy/seedUpload/sshc:de/anomic/yacy/seedUpload/sshc See: http://www.yacy-forum.de/viewtopic.php?p=4345 theli 2005-06-17 07:54:51 +00:00
  • 5d06ded005 enhanced html parser speed orbiter 2005-06-17 01:26:51 +00:00
  • 5a490aa065 fixed html parser orbiter 2005-06-16 21:49:56 +00:00
  • a25b5b4986 fixed possible memory leak in htmlScraper: be aware that now links can get lost; further work necessary orbiter 2005-06-16 18:31:28 +00:00
  • 38747857c2 correction of correction to port-forwarding orbiter 2005-06-16 11:49:54 +00:00
  • dbda6e1e85 corrections to port forwarding orbiter 2005-06-16 11:40:36 +00:00
  • d8cb3324a9 *) property "mytime" was not set correctly theli 2005-06-16 11:22:20 +00:00
  • 822c9fa276 *) forgotten to add new classes for server port forwarding under version control theli 2005-06-16 10:36:23 +00:00
  • b2c5305737 *) Bugfix: Uptime Uptime #minutes (kosmetisch) See: http://www.yacy-forum.de/viewtopic.php?p=4294 theli 2005-06-16 10:09:13 +00:00
  • 9e47ba5ad6 *) adding missing calls for function close() to avoid "too many open file" bug theli 2005-06-16 08:34:52 +00:00
  • 9a98988c3c *) Bugfix for SSL/NIO Bug See: http://www.yacy-forum.de/viewtopic.php?t=516 - removing NIO from server/serverCore.java because of massive problems with socket close issues *) Adding support for remote port forwarding via sch @Orbiter: Please take a look into - hello.java - server/serverCore.java.publicIP() - yacy/yacyClient.java.publishMySeed(...) *) Making startup loading of additional content parsers more failsafe theli 2005-06-16 07:28:07 +00:00
  • a1ffc27041 preparations for image/movie/music indexing orbiter 2005-06-16 00:31:13 +00:00
  • f45dc29f35 maintenance orbiter 2005-06-15 14:59:53 +00:00
  • a5b40923b6 added word migration to assortments (start with 'java -classpath classes yacy -migratewords') orbiter 2005-06-15 01:22:07 +00:00
  • 33e992cc8b *) unsing println instead of print theli 2005-06-13 13:53:15 +00:00
  • 890e3f4d4a *) adding missing calls for function close() to avoid "too many open file" bug*) adding *) bugfix in plasma/plasmaParser.java: - parsers with missing dependencies wehre not ignored correctly *) passing a logger instance to the parsers modules which can be used for logging purposes by the parsers (not done yet) theli 2005-06-13 13:49:17 +00:00
  • bd79c43b0b *) Correcting problems with run target theli 2005-06-13 13:32:30 +00:00
  • beb652847e added run-target for ant (needed for NetBeans4) orbiter 2005-06-13 12:01:58 +00:00
  • a2e5018427 *) adding missing calls for function close() to avoid "too many open file" bug theli 2005-06-13 09:56:41 +00:00
  • 3ee35b9ff9 *) Proxy-Error-Msg: align=center theli 2005-06-13 09:54:36 +00:00
  • c7d294d8d4 *) Bugfix for: - 302 redirection Problem on Amazon Server - Wrong References in proxymsg/error.html See: http://www.yacy-forum.de/viewtopic.php?t=515 theli 2005-06-13 07:50:35 +00:00
  • 6dd3ec0dc4 *) Adding debug="true" debuglevel="lines,vars,source" to ant build files See: http://www.yacy-forum.de/viewtopic.php?p=4099 theli 2005-06-12 05:22:06 +00:00
  • 4f9c30ef49 using mime-type instead of file extension for doctype orbiter 2005-06-10 12:34:18 +00:00
  • 8b89f433b1 *) Changing loglevel to debug theli 2005-06-10 09:39:52 +00:00
  • bbc46f037f *) avoid exception throwing on already catched exception theli 2005-06-10 09:38:38 +00:00
  • f0440911e8 *) removing unnecessary stacktrace printout theli 2005-06-10 09:34:50 +00:00
  • ee9e110366 *) removing old logging configuration properties from yacy.init *) serverLog.java logging functions now also accept exceptions als additional parameters. The Stacktrace of this ecceptions will then be appended to the logging message and can e.g. be viewed on the gui logging page theli 2005-06-10 09:19:24 +00:00
  • 9e4bcc828d *) solving problems with wrong classpath see: http://www.yacy-forum.de/viewtopic.php?p=4045 theli 2005-06-10 06:18:55 +00:00
  • e88951166b 0.381 nachgezogen (nach Rolands Veroeffentlichung). bitte nicht selbststaendig Nummern vergeben! orbiter 2005-06-09 18:44:48 +00:00
  • 878ff0ae7b corrections orbiter 2005-06-09 16:39:25 +00:00
  • 361ba50056 *) changing reference to logger theli 2005-06-09 11:15:36 +00:00
  • 7b4778b4b9 *) changing reference to logger theli 2005-06-09 11:02:54 +00:00
  • dedadd1067 *) remove old serverLog class (no author) 2005-06-09 10:59:48 +00:00
  • e5ee4198af *) changing reference to logger theli 2005-06-09 10:58:54 +00:00
  • 49a23bb89c *) adding reference to logger theli 2005-06-09 10:57:42 +00:00
  • 02d43a7bd4 *) adding additional methods that should be implemented by all serverHandler classes theli 2005-06-09 10:54:03 +00:00
  • 652a19cf13 *) adding a method to read and zip a file (needed by the filehandler) for doing gzip encoding theli 2005-06-09 10:52:59 +00:00
  • af9cd67334 *) migration to Java NIO - to avoid buzy waiting and - make socket blocking interruptable *) changing reference to logger *) introduce commandObjMethodCache to improve performance *) doing a stream shutdown before closing the connection to aviod problems when using persistent connections *) calling method UNKNOWN of the server-handler class when receiving an unknown command *) calling method EMPTY of the server-handler class when receiving an empty command theli 2005-06-09 10:51:56 +00:00
  • 1eff96f471 *) removing buzy waiting *) changing reference to logger theli 2005-06-09 10:47:50 +00:00
  • c1a4e0dc28 *) changing reference to logger theli 2005-06-09 10:44:55 +00:00
  • d0083f845f *) changing reference to logger theli 2005-06-09 10:39:09 +00:00
  • 1b5ae054f8 *) changing reference to logger *) parser will not be returned into pool if the parser was deactivated via gui theli 2005-06-09 10:38:00 +00:00
  • 68f30811fa *) changing reference to logger *) bugfix in function getCachePath theli 2005-06-09 10:36:39 +00:00
  • fbbea813c5 *) changing references to logger theli 2005-06-09 10:34:20 +00:00
  • 451ca6b818 *) changing reference to logger theli 2005-06-09 10:25:39 +00:00
  • 4d7540e679 *) adding new constants *) adding a list of default error messages which belong to each http status code theli 2005-06-09 10:23:03 +00:00
  • cb17ff4aa2 *) adding support of proxy access logging (much similar to squids access.log) file *) splitting doGet function in separate functions for fulfilling requests from cache and from web to make error handling easier *) using connection property and httpHeader constants instead of hardcoded strings whenever possible *) sending back a proxy error message as body of every respond containing a http error code *) correcting problems of messages received from other proxies containing 204, 304 status codes. *) using chunked transfer encoding if the server has not set the content length (e.g. because of gzip content encoding) but the client has established a persistent connection to yacy. This is only possible for http/1.1 clients. For http/1.0 clients the connection will simply be closed on the end of the message. *) removing unneeded functions (e.g. respondError) because of newly introduced functions of httpd.java *) removing hop by hop headers (according to rfc) theli 2005-06-09 10:22:05 +00:00
  • f157181086 *) starting implementation of Content-MD5 header which should help to detect transfer errors on yacy to yacy communication - not finished yet *) removing unneeded functions (e.g. respondHeader) because newly introduced functions in class httpd.java *) httpdFileHandler.java now always sends back a proxy error message as body of a response with an error code *) adding support of gzip content encoding theli 2005-06-09 10:12:07 +00:00
  • d2042ec8fa *) adding constants for all needed connection properties *) adding hashset for file-extensions that should not be transfered using gzip content encoding *) doing bugfixes on old keep-alive implementation *) doing some additional http header validation according to rfc *) doing all persistent connection detection in separate function now *) doing server authentication in separate function now *) doing proxy authentication in separate function now *) simplifying GET, POST, HEAD functions because of new introduced functions listed above *) adding new function to handle empty request lines (which could occure after post requests send via a persistent connection; this depends on the used browser) *) adding new function to handle unknown request methods by sending a correct error message back to the client *) setting correct content-length when sending back error messages to the client *) adding new functions that must be used by all http-Handler classes to send - a proxy error message - a http header back to the client *) adding new function: shallTransportZipped moved here from httpc theli 2005-06-09 10:07:02 +00:00
  • 06b0db2cac *) adding toString method to - httpc - response *) simplifying gzip encoding *) remembering http version of contacted server (neede for later support of keep alive by httpc) *) moving function shallTransportZipped to httpd.java because this function is used multiple times theli 2005-06-09 09:56:41 +00:00
  • 7b0b72dd23 *) adding new streams for - implementation of outgoing chunked transfer encoding (httpChunkedOutputStream.java) - byte counting for proxy access logging / global traffic count (httpdByteCount(In|Out)putStream.java theli 2005-06-09 09:47:56 +00:00
  • 318dfc4636 *) activating new logging framework theli 2005-06-09 09:46:43 +00:00
  • aae3e3b7ab *) reusing buffer instead of creating a new one theli 2005-06-09 09:45:58 +00:00
  • a566588e9b *) adding configuration section for new http keep-alive support *) moving transparent proxy configuration into new config section theli 2005-06-09 09:44:07 +00:00
  • 6bde37950f *) adding xsl stylesheet that can be used by browsers to format the rss search result in a user friendly format theli 2005-06-09 09:36:44 +00:00
  • e302c50390 *) Changes needed because of logging migration theli 2005-06-09 09:34:44 +00:00
  • f9a95b5cb8 *) Displaying more user friendly Memory Usage statistic *) Displaying traffic consumed by yacy - this is not finished yet - at the moment only outgoing proxy traffic is counted theli 2005-06-09 09:33:15 +00:00
  • f8de2556f8 *) Changes needed to allow a move verbose error message theli 2005-06-09 09:29:35 +00:00
  • 829b65c1c8 *) adding additional classes needed for new logging - ConsoleOutErrHandler.java used to log warnings/errors to stderr and all other messages to stdout - GuiHandler.java used to keep logging messages in memory that can then be viewed via the http gui - serverSimpleLogFormatter.java needed to format logging messages for FileHandler, ConsoleOutErrHandler and GuiHandler - serverMiniLogFormatter.java needed for proxy access logging theli 2005-06-09 09:25:08 +00:00
  • cef944eb33 *) Adding property for enabling/disabling connection keep-alive support theli 2005-06-09 09:21:00 +00:00
  • 84438bfa6b *) adding configuration file for new logging implementation theli 2005-06-09 09:17:21 +00:00
  • 8c2789b22a to catch is an irregular verb low012 2005-06-09 00:07:25 +00:00
  • 4574fa4ce7 bugfixes orbiter 2005-06-08 15:28:29 +00:00
  • 83b41ef2f7 *) Adding timeouts for shutdown theli 2005-06-08 13:44:25 +00:00
  • ef6851798b *) changing thread priority while parsing a pdf file to avoid 100% CPU usage. theli 2005-06-08 13:23:35 +00:00
  • 33f9315e58 implemented multithreading of indexing orbiter 2005-06-08 13:19:05 +00:00
  • 7c318f8886 Language files, not skins... allo 2005-06-08 11:05:04 +00:00
  • 52cf732fad *) correcting "seed-ftp-upload/Nothing changed" bug: See: http://www.yacy-forum.de/viewtopic.php?p=3986#3986 theli 2005-06-08 09:54:52 +00:00
  • ca3b4ccaf4 added snippet-routines (not yet finished) orbiter 2005-06-08 00:52:24 +00:00
  • 9244b6ad6f more typo/expression corrections (mailed to me from Sebastian Seifert) orbiter 2005-06-07 12:54:42 +00:00
  • a73e6de005 faq/doc - Fix orbiter 2005-06-07 09:28:45 +00:00
  • 9af1bf4b38 *) displaying memory usage of yacy in Status.html *) displaying more expressive uptime information on Status.html and Network.html theli 2005-06-07 09:05:21 +00:00
  • 167ddd5612 *) Displaying "SVN xxx" instead of "@REPL_VERSION@" if yacy is started directly from SVN theli 2005-06-07 08:31:49 +00:00
  • ee0758fe4d bugfixes/empty-dir-deletion/snippet-test-activation orbiter 2005-06-07 01:05:55 +00:00
  • 2d85bdb341 Installer for YaCy 0.38 allo 2005-06-03 13:38:07 +00:00
  • a12922536a latest changes for 0.38 orbiter 2005-06-03 09:22:50 +00:00
  • 594c591223 changes towards 0.38 orbiter 2005-06-03 02:43:35 +00:00
  • c8b24569e3 *) solving problem with duplicated class files in htroot (no author) 2005-06-02 06:58:20 +00:00
  • d8fdc2526e added experimental snipplet-generation (to be disabled for 0.38) orbiter 2005-06-02 01:33:10 +00:00
  • 3771b10b89 implemented automated migration indexCache 0.37 -> indexAssortmentCluster orbiter 2005-06-01 14:24:25 +00:00
  • e89ded9e41 bugfixes orbiter 2005-05-31 22:12:43 +00:00
  • 650ca3955a added flush-thread for index cache and added language-name mapping in Language_p orbiter 2005-05-31 17:39:14 +00:00
  • 3dd3431c58 Fixes a Problem with mySeed.txt. If this file is accessible but has no content it will be recreated: http://www.yacy-forum.de/viewtopic.php?p=3657#3657 mkossin 2005-05-31 13:58:30 +00:00
  • ec77e6faa6 updated german language file rramthun 2005-05-30 18:19:04 +00:00
  • 04b230f85d Startmenuentry for startYACY_noconsole.bat. allo 2005-05-29 20:12:56 +00:00
  • 4e63456dba some corrections/enhancements to the webinterface rramthun 2005-05-29 18:23:58 +00:00
  • 3d8a2ff937 enhanced parallelization of local/global/remote crawling orbiter 2005-05-29 11:56:40 +00:00
  • a05d738ea4 enhanced caching, removed bug causing outOfMemory orbiter 2005-05-29 00:34:01 +00:00