Commit Graph

  • 80b3e85356 *) yacyWiki: Images in a share on the same peer can be addressed by path and name only, no complete URL needed anymore. (As requested by theli in http://www.yacy-forum.de/viewtopic.php?t=809) low012 2005-12-15 21:58:13 +00:00
  • 8c594841a8 *) Bugfix for incorrectly indexing of URLs that were requested with Cookies in the Request header See: http://www.yacy-forum.de/viewtopic.php?p=14077 theli 2005-12-15 15:30:24 +00:00
  • b5d02d649a fixed bug caused strange search result behaviour (results from remote peers had not been saved propery after search) orbiter 2005-12-15 13:21:42 +00:00
  • 4500506735 fixed some bugs concerning url entry retrieval and intexControl interface orbiter 2005-12-15 10:31:00 +00:00
  • 83a34b838d * added Object allocation monitor on performanceMemory page * added some final statements * changed shutdown sequence order orbiter 2005-12-14 13:04:43 +00:00
  • 4ff3d219e8 increased delay for cacheScan start and slowed down scan process to provide more time to other tasks orbiter 2005-12-13 21:15:52 +00:00
  • 3031903d50 re-design of RAM cache flush into assortment cluster orbiter 2005-12-13 16:00:20 +00:00
  • 676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree orbiter 2005-12-13 11:58:55 +00:00
  • 5e2673e86c new version number to check performance enhancements orbiter 2005-12-13 01:02:23 +00:00
  • 3cc02fe749 enhanced buffered write by combination of several chunks into one chunk orbiter 2005-12-13 00:52:27 +00:00
  • 0c762daf4b better startup failure handling orbiter 2005-12-12 23:59:58 +00:00
  • f27f9ecf15 * activated write buffer for databases. This should increase IO performance and reduce HD activity * bugfixes for new exception-on-failure policy * bugfixes for new IOChunks * new Object pool for database write-buffer orbiter 2005-12-12 14:11:59 +00:00
  • c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active) - minor bugfixes orbiter 2005-12-12 00:19:28 +00:00
  • ad67b0a37a Added ant2svg task to build.xml and a graphical representation of the current Apache ANT tasks rramthun 2005-12-11 19:38:33 +00:00
  • ca7e60279d introduced IOChunks. This is an abstraction of chunked IO-processes. It will help to synchronize access to IO-ports. Furthermore this is a preparation for upcoming chunk-oriented write buffers. orbiter 2005-12-11 02:36:49 +00:00
  • bb79fb5d91 - changed handling of error cases retrieving urls from database (no more NULL values are returned, instead, an IOException is thrown) - removed ugly damagedURLS implementation from plasmaCrawlLURL.java (this inserted a static value into the Object which is not really a good style) - re-coded damagedURLS collection in yacy.java by catching an exception and evaluating the exception message to do: - the urldbcleanup feature must be re-tested orbiter 2005-12-11 00:25:02 +00:00
  • fed92d364b introduced USAGE object for counter synchronization in kelondroRecords orbiter 2005-12-10 02:11:24 +00:00
  • 35cf6712b2 *) fixes for httpd - don't send Body on HEAD requests - don't send a Last-modified: date, that is later then Date: - Use Cache-control instead of Pragma with HTTP/1.1 - don't send header with HTTP/0.9 hermens 2005-12-09 17:35:45 +00:00
  • 5a627a690f *) Extending hydrox urlDbCleanup function - now the function tries to correct the URL first - if the url can not be corrected it will be deleted See: http://www.yacy-forum.de/viewtopic.php?p=13898 theli 2005-12-09 15:41:06 +00:00
  • e7d16ef831 *) Corrections in jMimeMagic MagicRule-file to detect some special rss feeds theli 2005-12-08 23:25:43 +00:00
  • 3086e38bb1 added getRemoved method on demand from theli for migration purpose orbiter 2005-12-08 23:22:57 +00:00
  • 61bded057a *) Bugfix for Server Port configuration. Status-Info was not displayed correctly. theli 2005-12-08 22:22:41 +00:00
  • 386d9e45d8 *) Bugfix for code cleanup - Code must be in finally block, otherwise it does not work if an error occurs! theli 2005-12-08 22:16:49 +00:00
  • 356231b033 changed only for testing with new hastable implementation. Core funktions are unchanged. orbiter 2005-12-08 21:38:34 +00:00
  • 5a1d45715d *) Bugfix for parser configuration bug - it was not possible to disable all parsers See: http://www.yacy-forum.de/viewtopic.php?t=1579 theli 2005-12-08 21:35:40 +00:00
  • dee27a86c6 - added title="delete" and alt="delete" for minus-grafic in index.html - updated language file daburna 2005-12-08 12:58:40 +00:00
  • 1041f4946a experiments with locks to remove synchronization orbiter 2005-12-08 12:30:55 +00:00
  • 288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found orbiter 2005-12-08 02:18:44 +00:00
  • a1061495d4 Fixed some spelling mistakes and added some text which (should) make it easier to understand the options. rramthun 2005-12-07 19:47:21 +00:00
  • 0cdc58aaea fixed indexing of local domains. see http://www.yacy-forum.de/viewtopic.php?p=13680#13680 orbiter 2005-12-07 14:26:43 +00:00
  • 76b97e4d2a integrated geo-snap DBStressTest.java in dbtest this is still beta. It uses serverInstantThreads instead of Java 1.5 code for multiple threads orbiter 2005-12-07 13:33:39 +00:00
  • ec1202edbe *) Fixes for httpd - Fix for local timezone in http header See: http://www.yacy-forum.de/viewtopic.php?t=836 - Allow static content to be cached by browser See: http://www.yacy-forum.de/viewtopic.php?t=1311 hermens 2005-12-07 13:26:27 +00:00
  • e1c2d8ec5f *) Speedup "removed from queue" See: http://www.yacy-forum.de/viewtopic.php?p=13442#12188 theli 2005-12-07 11:27:44 +00:00
  • 96930f0d2b *)added function to removed malformed URLs from urlHash.db hydrox 2005-12-07 11:10:08 +00:00
  • 6b1a49ea23 fix for last commit orbiter 2005-12-07 10:46:14 +00:00
  • d007d14905 re-insert of migrateSwitchConfigSettings orbiter 2005-12-07 10:31:48 +00:00
  • 8862b6ba4b *) Corrections for code cleanup 1175 theli 2005-12-07 08:15:39 +00:00
  • 0e88ba997e * added option to generate url-lists as plain text file or in html * modified generation of dom-lists so that they can be also generated as html these options can be called as: java -classpath classes yacy -domlist -format html java -classpath classes yacy -domlist -format html . java -classpath classes yacy -domlist -format text . java -classpath classes yacy -urllist -format html . java -classpath classes yacy -urllist -format text . the -format <type> can be ommitted. The text is default a home path can be asserted or omitted at the end of the parameters orbiter 2005-12-07 01:40:52 +00:00
  • 13fdebc50d added authentication for link deletion in search result orbiter 2005-12-07 00:36:05 +00:00
  • 37f88b4017 code cleanup orbiter 2005-12-06 23:51:29 +00:00
  • ec2b39c1ce code cleanup orbiter 2005-12-06 22:30:15 +00:00
  • e078a50e0b - corrected spelling in IndexCreateWWWLocalQueue_p.html and simple_search.html - updated de.lng with translation for simple_search.html and update translation for IndexCreateWWWLocalQueue_p.html daburna 2005-12-06 21:31:52 +00:00
  • 76618442e0 code cleanup orbiter 2005-12-06 21:21:14 +00:00
  • 8f1f2daa5e implemented interactive link deletion of search results. next steps: attach voting and restrict to administrator to see the deletion button, move the mouse pointer to the left of a search result orbiter 2005-12-06 16:15:21 +00:00
  • 6d0f7e6988 *) Adding missing file theli 2005-12-06 11:20:06 +00:00
  • 44fa94ac52 *) Modifications for dbImport functionality - dbImporter threads are now shutdown by the switchboard on server shutdown - adding possibility to pause a importer thread via GUI - Bugfix for abort function See: http://www.yacy-forum.de/viewtopic.php?p=13363#13363 theli 2005-12-06 10:41:19 +00:00
  • 28ddba8813 added vote-button images orbiter 2005-12-06 00:16:41 +00:00
  • d5c36c8e2e *) now showing the total number of entries in the queue in addition to the number of entries in the list low012 2005-12-05 23:24:46 +00:00
  • dc778659fb fixed problem with time-out during result joint which caused OR behavior instead of AND beahvior orbiter 2005-12-05 15:48:45 +00:00
  • 3d8a5ae652 code cleanup orbiter 2005-12-05 14:24:13 +00:00
  • ae6a4650bc reenabling debugMode (60 Seconds timeout for *all* http connections) allo 2005-12-05 11:14:11 +00:00
  • bb1f73ec15 *) Bugfix for code cleanup theli 2005-12-05 09:48:11 +00:00
  • 7920e1547d code cleanup orbiter 2005-12-05 09:13:13 +00:00
  • 972b8ddd2a *) minor changes: using constants properly theli 2005-12-05 09:18:47 +00:00
  • 1c3750de57 *) Bugfix for code cleanup theli 2005-12-05 09:15:05 +00:00
  • 64478b1f02 *) Adding possibility to delete crawler queue entries using regular expressions theli 2005-12-05 09:11:28 +00:00
  • 1d6a6d1f85 code cleanup orbiter 2005-12-05 00:17:12 +00:00
  • a04930f025 code cleanup orbiter 2005-12-04 23:51:28 +00:00
  • 548f0c6aff first Try with Eclipse / cleaned sources orbiter 2005-12-04 23:14:30 +00:00
  • d35fb38c2b *) making the serach button work with Opera, Konqueror and Safari again. Roland's code is still in there, but in a comment to be reviewed later low012 2005-12-03 10:18:28 +00:00
  • 90b0eb144e just a typo... low012 2005-12-03 09:58:00 +00:00
  • 129b15f3e1 *) Correcting logging output of db importer thread See: http://www.yacy-forum.de/viewtopic.php?t=1555 theli 2005-12-02 11:56:12 +00:00
  • 7028412c54 *) Bugfix for NullpointerException in Java Finalizer theli 2005-12-02 10:57:31 +00:00
  • 420d56ce79 extended db-testing orbiter 2005-12-02 01:51:37 +00:00
  • ecf765ec33 temporary fix to make jrpm extension compilable with my netbeans environment orbiter 2005-12-01 23:03:54 +00:00
  • 8c0d982191 1.) Fix from Martin (he ist not at home...) rramthun 2005-12-01 18:26:39 +00:00
  • b604654c25 *) Adding possibility to do a settings migration on yacy startup theli 2005-12-01 13:39:38 +00:00
  • eb9daccfd2 *) Corrections in jMimeMagic MagicRule-file to detect rpm files properly theli 2005-12-01 12:13:50 +00:00
  • 8ed0aaae8d *) Adding content Parser for RPM Files - at the moment only the metadata is extracted theli 2005-12-01 10:47:00 +00:00
  • 0f769215b5 *) urlRedirector now uses http head requests to determine the mimetype of a resource before it checks if a URL has to be rejected or not. theli 2005-11-30 04:52:22 +00:00
  • b62c36d2ab *) Bugfix for urlRedirector - media extension was not parsed correctly theli 2005-11-29 23:45:17 +00:00
  • 8f4259f1e3 md5Auth allo 2005-11-29 21:31:06 +00:00
  • 818d37ce44 *) Removing getSimpleName theli 2005-11-29 12:50:13 +00:00
  • 25e5593d53 *) Removing compile statement for www directory theli 2005-11-29 12:47:19 +00:00
  • b35c5a48bf *) First version of urlRedirector.pl script - with this script it's possible to pass URLs from squid to yacy via the squid redirector interface - this URLs are then used by YaCy to feed the crawler theli 2005-11-29 12:27:03 +00:00
  • bdf30117c1 *) Redesign of parser configuration - restructuring of mimeTypes based on the parsers - displaying parser usage count - displaying human readably parser names - displaying parser version information theli 2005-11-29 07:27:58 +00:00
  • 3037c1e73b *) Removing compile statement for www directory theli 2005-11-29 07:14:55 +00:00
  • b86d1085e2 passwordAuth allo 2005-11-28 22:35:41 +00:00
  • edaa820bec resubmitting Allos patch after accidentally removing it low012 2005-11-28 21:42:01 +00:00
  • c45e47bf91 fixed vulnerability, see http://www.yacy-forum.de/viewtopic.php?t=1535 low012 2005-11-28 16:51:59 +00:00
  • 5bf70e6e14 *) Bugfix for serverClassLoader.java - Classloading didn't work properly if there are multiple classes with the same name - This could occure because the yacy servlets have no package name defined and therefore are all in the same (default) package. theli 2005-11-28 10:15:25 +00:00
  • d4ac3e25b1 *) Bugfix for file system link bug during detection of invalid URLs See: http://www.yacy-forum.de/viewtopic.php?p=13301 theli 2005-11-28 07:17:43 +00:00
  • adf75bc9fa better logging for invalid file path detection orbiter 2005-11-27 22:55:30 +00:00
  • 40621a5663 anhancements in ranking preparation and fixed problem with parser/mime recognition orbiter 2005-11-27 11:55:24 +00:00
  • 38d915e24c limiting the Number of Items displayed to 100 max. http://www.yacy-forum.de/viewtopic.php?p=13275 allo 2005-11-27 09:50:23 +00:00
  • c650b112ea *) Bugfix for relative URL Bug in Crawler See: http://www.yacy-forum.de/viewtopic.php?p=13266#13266 theli 2005-11-27 06:35:23 +00:00
  • 7e670894d9 *) Suppressing stackTraces in proxyError message for "connect timed out" errors See: http://www.yacy-forum.de/viewtopic.php?t=1504 *) Increasing default http client timeout theli 2005-11-25 00:40:35 +00:00
  • 4e73035aef *) Bugfix for "too many open files" during index distribution theli 2005-11-24 21:47:16 +00:00
  • cc940a769b Updated language file. daburna 2005-11-23 23:37:09 +00:00
  • d8afe60e07 Bugfix for last Bugfix ;-). host/port were set to originaladdress instead of the correct values for the new Url. allo 2005-11-23 14:05:25 +00:00
  • 1b656f6b31 correction of bug from svn 1123 orbiter 2005-11-23 12:07:07 +00:00
  • f57e2d67f5 shortened network overview (less columns fit easier on page) orbiter 2005-11-23 11:57:30 +00:00
  • 24d15eb0e8 moving the redirector code allo 2005-11-23 07:52:36 +00:00
  • 787c368696 synchronized redirectors and using the port. allo 2005-11-23 07:37:15 +00:00
  • 85282b1d98 enhanced YBR recognition and search result heuristics orbiter 2005-11-23 01:40:02 +00:00
  • 4776f3f815 squid like redirctors allo 2005-11-22 22:07:29 +00:00
  • b9cc9029e3 added ybr selection for remote search orbiter 2005-11-22 16:10:24 +00:00
  • 0e25020f51 added first generation and usage of YBR index-files. Enhanced overall ranking of search results. orbiter 2005-11-22 15:17:05 +00:00
  • 75c0d12ac5 small change borg-0300 2005-11-21 18:27:12 +00:00
  • 52a0237bf2 using Filetemplates for #[metas]# and other static includes allo 2005-11-21 08:33:54 +00:00