1
0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-23 09:24:39 -04:00

Commit Graph

  • efd5807a7c - some renaming of variables to support DC - initial 120mb RAM for fresh peers - release 0.57 orbiter 2008-02-04 22:58:40 +00:00
  • 40a0591942 Fixed numberbug in Blog, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=639. This wont fix existing Blogentrys (comes later). lulabad 2008-02-04 21:46:18 +00:00
  • 141db7ba48 there is less RAM needed for eco table (its just a security-plus for RAM check) orbiter 2008-02-04 15:51:51 +00:00
  • 249d61759a fix for false RAM table activation in EcoTables orbiter 2008-02-04 10:33:45 +00:00
  • df548f444f one more NPE patch for a search item case orbiter 2008-02-03 22:14:22 +00:00
  • ff6b69b37e fix for NPE in access tracker fix for NPE in word index orbiter 2008-02-03 21:47:27 +00:00
  • 3c7b94c119 - fix for online caution delay settings, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=738&p=4723#p4723 - removed remote search limitation for non-dht-peers according to discussion in http://forum.yacy-websuche.de/viewtopic.php?f=15&t=793&hilit=&p=5277#p5277 orbiter 2008-02-03 20:11:50 +00:00
  • f35a3794e0 auto-healing (deletion) of bad peer addresses during start-up orbiter 2008-02-03 18:42:25 +00:00
  • a981cd5ab7 ignore folder tags...on request of daburna apfelmaennchen 2008-02-03 18:36:44 +00:00
  • 42c1e11f2b added another link double-check orbiter 2008-02-03 12:40:40 +00:00
  • a5d388bfff fix for HTCache organisation that may have caused unlimited grow of the cache appeared only for tree-caches orbiter 2008-02-03 11:21:50 +00:00
  • 96c5e6acc7 added a double-check for search results orbiter 2008-02-03 02:55:21 +00:00
  • a1e9e6e2e6 fix for search result page navigation orbiter 2008-02-03 02:23:04 +00:00
  • 7404256997 - no more search time-out! - fixed a bug with last commit orbiter 2008-02-02 23:53:39 +00:00
  • cd3e0d6f03 tried to fix another eco bug orbiter 2008-02-02 21:36:19 +00:00
  • 08a12e9bb5 - removed dashed line from default skin (looks much better!) - better timing when displaying results orbiter 2008-02-02 11:30:47 +00:00
  • 89169d54fd fixed search result preparation orbiter 2008-02-02 00:16:00 +00:00
  • 7c29bc4a87 #updated German languagefile +set spacer between topwords daburna 2008-02-01 19:22:32 +00:00
  • acf771d5e1 - fixed bug with too much RAM in crawler queue - fixed dir bug - better calculation of TF for join - better waiting-on-result logic orbiter 2008-01-31 23:40:47 +00:00
  • a8a5df4a51 - more dublin core naming of page metadata - better presentation of result counters in search results orbiter 2008-01-30 21:58:30 +00:00
  • fa3b8f0ae1 fixed bug in remote search orbiter 2008-01-30 00:15:43 +00:00
  • 7d875290b2 more generics orbiter 2008-01-29 22:13:30 +00:00
  • 0856cabb37 *) fixed typo that caused log being written to console under Ubuntu and OpenSolaris, probably also fixes problem with FreeBSD low012 2008-01-29 21:27:06 +00:00
  • 9d693ee635 more generics orbiter 2008-01-29 16:41:09 +00:00
  • 0f5c4abaca more generics orbiter 2008-01-29 10:12:48 +00:00
  • 974fea7933 added term-frequency ranking orbiter 2008-01-28 23:41:39 +00:00
  • 1a296af6ff more generics orbiter 2008-01-28 20:08:32 +00:00
  • 4a80902081 - added ViewProfile as rdf in foaf syntax - added link to rdf and vCard version on html page - can be seen on http://localhost:8080/ViewProfile.html?hash=localhash - more generics orbiter 2008-01-28 18:21:08 +00:00
  • 1b930a6702 #small corrections daburna 2008-01-27 09:11:48 +00:00
  • f5ab90d964 added auto reload graph option by Lotus apfelmaennchen 2008-01-26 14:12:45 +00:00
  • d3ce9ebffe added tooltips to folder tree apfelmaennchen 2008-01-26 11:35:23 +00:00
  • da8c850a25 disabled IO path optimization (seems to block other methods) orbiter 2008-01-26 00:21:37 +00:00
  • d177ceb3b3 Fix for growing responseHeader[12].db when using proxyCacheLayout = hash hermens 2008-01-25 21:56:25 +00:00
  • eb6bdf49c1 fixed import Netscape Bookmarks apfelmaennchen 2008-01-25 19:23:43 +00:00
  • cb91cc5c7c fixed import Netscape Bookmarks apfelmaennchen 2008-01-25 19:23:15 +00:00
  • b1fae9b5af fixed import Netscape Bookmarks apfelmaennchen 2008-01-25 19:22:36 +00:00
  • 2485681002 added termination control for RotateIterator orbiter 2008-01-25 11:44:27 +00:00
  • e2e7f065e9 minor fixes, some generics orbiter 2008-01-24 23:58:18 +00:00
  • 15397298dc - refactoring of indexControlRWIs: moved statics to own class; better Dublin Core naming - fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=759&hilit=&p=4866#p4866 - some bugfixes in EcoTable according remove method - switched more tables to Eco: crawl Profiles, htcache, seeddb, newsdb orbiter 2008-01-24 22:49:00 +00:00
  • 2dc994515d fixed a typo apfelmaennchen 2008-01-24 21:37:06 +00:00
  • 98e0cd7b87 fixed export bookmark link apfelmaennchen 2008-01-24 21:33:04 +00:00
  • d59f9e0c17 UTF-8 apfelmaennchen 2008-01-24 21:03:00 +00:00
  • 7b400756c4 UTF-8 apfelmaennchen 2008-01-24 21:02:27 +00:00
  • 30bf4bdc48 UTF-8 apfelmaennchen 2008-01-24 21:01:37 +00:00
  • b32b025d4b UTF-8 apfelmaennchen 2008-01-24 21:01:24 +00:00
  • 29146ff855 UTF-8 apfelmaennchen 2008-01-24 21:00:35 +00:00
  • 6dc319fc32 UTF-8 apfelmaennchen 2008-01-24 21:00:03 +00:00
  • 3afdcd0d59 fixed problem with utf-8 apfelmaennchen 2008-01-24 20:53:26 +00:00
  • 13668830b7 fixed problems with utf-8 apfelmaennchen 2008-01-24 20:53:09 +00:00
  • 34e5422675 adjusted code for bookmarksDB.getFolderList() apfelmaennchen 2008-01-24 20:15:45 +00:00
  • aa53a46937 adjusted code for getFolderList() and cleanTagsString() added input for folders in add/edit bookmark apfelmaennchen 2008-01-24 20:14:31 +00:00
  • eebc688f37 moved Login link to submenu added Folders to add/edit bookmark form apfelmaennchen 2008-01-24 20:13:08 +00:00
  • f3a9e9c542 added getFolderList() to bookmarksDB added cleanTagsString() to bookmarksDB added getFoldersString() to Bookmark modified getTagsString() to exclude folderTags apfelmaennchen 2008-01-24 20:11:57 +00:00
  • db25425893 more generics orbiter 2008-01-23 23:08:32 +00:00
  • 6f9f821481 added XBEL Export for YaCy Bookmarks. Tags are strored as <metadata owner="Mozilla" ShortcutURL="tag1,tag2"/> apfelmaennchen 2008-01-23 22:19:23 +00:00
  • 9e7cd4fdbb more generics orbiter 2008-01-23 21:23:17 +00:00
  • 4e70dff8cf more generics orbiter 2008-01-23 21:09:56 +00:00
  • 6dc679785f - fixed bad sort behavior of kelondroRowSet, in this case: no sort at all! see http://forum.yacy-websuche.de/viewtopic.php?p=4841#p4841 - some memory calculation enhancements in kelondroFlex and a little bit more logging orbiter 2008-01-23 20:18:36 +00:00
  • 0b4205eb5a - fix double-deletion in eco tables - changed behaviour of sort moment (not during a get) - added some asserts in snippet cache for debugging orbiter 2008-01-23 11:13:39 +00:00
  • 41a3ff8ccc *) removed unused imports *) some generics low012 2008-01-23 00:10:15 +00:00
  • c0fbab9cca *) heading, trailing and double commas are removed since they are unnecessary *) trailing and double slashs in paths are removed, they are not only ugly, but also caused infinite loops low012 2008-01-22 23:59:15 +00:00
  • 089faf1a00 *) added login link at bottom of page *) empty tags will not be displayed any longer low012 2008-01-22 23:14:57 +00:00
  • 4ce6fab428 added special handling for doubles in eco tables after initialization orbiter 2008-01-22 21:40:25 +00:00
  • 002a109c4d patch for http://forum.yacy-websuche.de/viewtopic.php?p=4597#p4597 (urls that have no protocol but start with www will be treated as http://www... orbiter 2008-01-22 20:49:26 +00:00
  • 634430c48a - more logging orbiter 2008-01-22 20:44:12 +00:00
  • d288987a93 replaced isEmpty() with equals("") apfelmaennchen 2008-01-22 20:19:34 +00:00
  • d372a78aef some fixes to bring back lulabads peer.. see also: http://forum.yacy-websuche.de/viewtopic.php?p=4772#p4772 orbiter 2008-01-22 20:02:20 +00:00
  • f4799c2334 *) removed since I decided to turn this into a project of it's own using Perl to gather n-gram data which YaCy will be able to use low012 2008-01-22 19:59:21 +00:00
  • a870ac32b8 reorganized code and added folders; this update might have overwritten latest changes by orbiter - sorry! apfelmaennchen 2008-01-22 19:39:15 +00:00
  • 62a5df5bfc git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4363 6c8d7289-2bf4-0310-a012-ef5d649a1542 apfelmaennchen 2008-01-22 19:32:52 +00:00
  • 7aa94f17da git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4362 6c8d7289-2bf4-0310-a012-ef5d649a1542 apfelmaennchen 2008-01-22 19:32:42 +00:00
  • 373fface89 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4361 6c8d7289-2bf4-0310-a012-ef5d649a1542 apfelmaennchen 2008-01-22 19:32:30 +00:00
  • f319bbe4c8 adjustments for folder tree apfelmaennchen 2008-01-22 19:28:55 +00:00
  • 6eb8321cb0 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=752&p=4815#p4815 orbiter 2008-01-22 19:19:56 +00:00
  • 4ffbcd54a4 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=754 orbiter 2008-01-22 19:10:03 +00:00
  • e81bced2bd reorganized the code and adjusted getTagIterator() to suit folders apfelmaennchen 2008-01-22 19:08:32 +00:00
  • 4c631d912e added folder view; limited tag view to top25 apfelmaennchen 2008-01-22 19:06:21 +00:00
  • e68b133b35 added JavaScript for folder tree view apfelmaennchen 2008-01-22 19:05:36 +00:00
  • 85dc62c16f refactoring: more dublin core - compliant naming orbiter 2008-01-22 19:03:47 +00:00
  • efd0b8371a - added parsing of Dublin Core - compliant metadata (see RFC 5013 and ISO 15836) to html parser - refactoring of plasmaParserDocument to use Dublin Core - compatible property names - redesign of url handling in parser and condenser (less String-to-yacyURL conversion) - more generics orbiter 2008-01-22 11:51:43 +00:00
  • cfd4fecd12 *) blanks in paths for restart and update script are replaced by backslash+blank now (see http://forum.yacy-websuche.de/viewtopic.php?t=745) low012 2008-01-21 18:04:08 +00:00
  • f945ee21d2 some security additions, keep maximum byte[] size to 2^27 orbiter 2008-01-20 23:46:27 +00:00
  • 2f3b2f3481 - extended dbtest for comparisment tests - added initial space option for eco tables - used initial space value in initialization of collectionIndex, this should avoid OOM failures" /Volumes/Magneto/dev/workspace/trunk/source/dbtest.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroCollectionIndex.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroDyn.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroEcoTable.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroRow.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroSplitTable.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/plasma/plasmaCrawlBalancer.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/plasma/plasmaCrawlStacker.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/plasma/plasmaCrawlZURL.java - added index consistency check (checks for double-occurrences of primary keys in file) orbiter 2008-01-20 21:42:35 +00:00
  • 9eb746863d interface enhancements for eco records memory statistics orbiter 2008-01-20 01:51:02 +00:00
  • 9abc927645 to fix inconsistencies in collection index, a double reference reporting mechanism has been implemented orbiter 2008-01-20 01:22:46 +00:00
  • 58a1f518f8 fixed some problems with eco tables orbiter 2008-01-19 12:23:56 +00:00
  • d4d07802ac better RAM protection using eco tables orbiter 2008-01-19 01:50:24 +00:00
  • f6cfb97b7f added a test servlet (to be used to analyse the remote crawl xml bug) orbiter 2008-01-19 01:07:52 +00:00
  • f4e9ff6ce9 more generics orbiter 2008-01-19 00:40:19 +00:00
  • cbefc651ac more generics orbiter 2008-01-18 18:43:56 +00:00
  • 45339c3db5 more generics orbiter 2008-01-18 17:14:02 +00:00
  • 94f21d9403 activated new kelondroEcoTable file structure. This data structure replaces almost all files in the PLASMA directory also the collection.index and the LURL-db will be created as Eco-DB, if it does not exist before existing Flex-databases will be used as they are (the is no data lost) If you want to force the creation of a Eco-collection.index, simply delete the old index. The Eco file system will only be used if there is enough memory. The collection.index RAM limit is 200MB, if you have less, a flex-Table is createt. orbiter 2008-01-17 21:48:08 +00:00
  • 739f35d389 *) added previous/next links to blog (in case blog has more entries than get displayed on one page) low012 2008-01-17 21:01:30 +00:00
  • a0f7f2faad some more generics orbiter 2008-01-17 18:43:01 +00:00
  • dc26d6262b - removed write buffer from kelondroCache (was never used because buggy; will now be replaced by new EcoBuffer) - added new data structure 'eco' for an index file that should use only 50% of write-IO compared to kelondroFlex The new eco index is not used yet, but already successfully tested with the collectionIndex The main purpose is to replace the kelondroFlex at every point when enough RAM is available. Othervise, the kelondroFlex stays as option in case of low memory (which then can even use a file-index) orbiter 2008-01-17 12:12:52 +00:00
  • dbdec0f4d3 another fix for the "too many processes in loader queue, dismissed" - problem: this was probably caused by http-forward cases; which are cases when urls from the loader queue change and it was not possible to remove the old urls from the queue because they had been based on url hashes. The queue is now again stored using the entry.hashCode, which does not change ieven if the url changes. orbiter 2008-01-13 23:10:09 +00:00
  • b806a6af8b renamed kelondroEcoRecords to kelondroFullRecords (the "Eco"-name will be used for something else) orbiter 2008-01-13 00:41:22 +00:00
  • 065ba2d60f fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=719&hilit= orbiter 2008-01-13 00:21:47 +00:00
  • 71a67436ac *) fix for last commit low012 2008-01-13 00:21:33 +00:00
  • 352f733a86 *) added "previous" and "next" links that make it possible to navigate through lists of comments (needed if there are more than 10 comments to one postig) low012 2008-01-12 23:48:47 +00:00