Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-05 23:46:12 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 29146ff855 UTF-8 apfelmaennchen 2008-01-24 21:00:35 +00:00
  • 6dc319fc32 UTF-8 apfelmaennchen 2008-01-24 21:00:03 +00:00
  • 3afdcd0d59 fixed problem with utf-8 apfelmaennchen 2008-01-24 20:53:26 +00:00
  • 13668830b7 fixed problems with utf-8 apfelmaennchen 2008-01-24 20:53:09 +00:00
  • 34e5422675 adjusted code for bookmarksDB.getFolderList() apfelmaennchen 2008-01-24 20:15:45 +00:00
  • aa53a46937 adjusted code for getFolderList() and cleanTagsString() added input for folders in add/edit bookmark apfelmaennchen 2008-01-24 20:14:31 +00:00
  • eebc688f37 moved Login link to submenu added Folders to add/edit bookmark form apfelmaennchen 2008-01-24 20:13:08 +00:00
  • f3a9e9c542 added getFolderList() to bookmarksDB added cleanTagsString() to bookmarksDB added getFoldersString() to Bookmark modified getTagsString() to exclude folderTags apfelmaennchen 2008-01-24 20:11:57 +00:00
  • db25425893 more generics orbiter 2008-01-23 23:08:32 +00:00
  • 6f9f821481 added XBEL Export for YaCy Bookmarks. Tags are strored as <metadata owner="Mozilla" ShortcutURL="tag1,tag2"/> apfelmaennchen 2008-01-23 22:19:23 +00:00
  • 9e7cd4fdbb more generics orbiter 2008-01-23 21:23:17 +00:00
  • 4e70dff8cf more generics orbiter 2008-01-23 21:09:56 +00:00
  • 6dc679785f - fixed bad sort behavior of kelondroRowSet, in this case: no sort at all! see http://forum.yacy-websuche.de/viewtopic.php?p=4841#p4841 - some memory calculation enhancements in kelondroFlex and a little bit more logging orbiter 2008-01-23 20:18:36 +00:00
  • 0b4205eb5a - fix double-deletion in eco tables - changed behaviour of sort moment (not during a get) - added some asserts in snippet cache for debugging orbiter 2008-01-23 11:13:39 +00:00
  • 41a3ff8ccc *) removed unused imports *) some generics low012 2008-01-23 00:10:15 +00:00
  • c0fbab9cca *) heading, trailing and double commas are removed since they are unnecessary *) trailing and double slashs in paths are removed, they are not only ugly, but also caused infinite loops low012 2008-01-22 23:59:15 +00:00
  • 089faf1a00 *) added login link at bottom of page *) empty tags will not be displayed any longer low012 2008-01-22 23:14:57 +00:00
  • 4ce6fab428 added special handling for doubles in eco tables after initialization orbiter 2008-01-22 21:40:25 +00:00
  • 002a109c4d patch for http://forum.yacy-websuche.de/viewtopic.php?p=4597#p4597 (urls that have no protocol but start with www will be treated as http://www... orbiter 2008-01-22 20:49:26 +00:00
  • 634430c48a - more logging orbiter 2008-01-22 20:44:12 +00:00
  • d288987a93 replaced isEmpty() with equals("") apfelmaennchen 2008-01-22 20:19:34 +00:00
  • d372a78aef some fixes to bring back lulabads peer.. see also: http://forum.yacy-websuche.de/viewtopic.php?p=4772#p4772 orbiter 2008-01-22 20:02:20 +00:00
  • f4799c2334 *) removed since I decided to turn this into a project of it's own using Perl to gather n-gram data which YaCy will be able to use low012 2008-01-22 19:59:21 +00:00
  • a870ac32b8 reorganized code and added folders; this update might have overwritten latest changes by orbiter - sorry! apfelmaennchen 2008-01-22 19:39:15 +00:00
  • 62a5df5bfc git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4363 6c8d7289-2bf4-0310-a012-ef5d649a1542 apfelmaennchen 2008-01-22 19:32:52 +00:00
  • 7aa94f17da git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4362 6c8d7289-2bf4-0310-a012-ef5d649a1542 apfelmaennchen 2008-01-22 19:32:42 +00:00
  • 373fface89 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4361 6c8d7289-2bf4-0310-a012-ef5d649a1542 apfelmaennchen 2008-01-22 19:32:30 +00:00
  • f319bbe4c8 adjustments for folder tree apfelmaennchen 2008-01-22 19:28:55 +00:00
  • 6eb8321cb0 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=752&p=4815#p4815 orbiter 2008-01-22 19:19:56 +00:00
  • 4ffbcd54a4 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=754 orbiter 2008-01-22 19:10:03 +00:00
  • e81bced2bd reorganized the code and adjusted getTagIterator() to suit folders apfelmaennchen 2008-01-22 19:08:32 +00:00
  • 4c631d912e added folder view; limited tag view to top25 apfelmaennchen 2008-01-22 19:06:21 +00:00
  • e68b133b35 added JavaScript for folder tree view apfelmaennchen 2008-01-22 19:05:36 +00:00
  • 85dc62c16f refactoring: more dublin core - compliant naming orbiter 2008-01-22 19:03:47 +00:00
  • efd0b8371a - added parsing of Dublin Core - compliant metadata (see RFC 5013 and ISO 15836) to html parser - refactoring of plasmaParserDocument to use Dublin Core - compatible property names - redesign of url handling in parser and condenser (less String-to-yacyURL conversion) - more generics orbiter 2008-01-22 11:51:43 +00:00
  • cfd4fecd12 *) blanks in paths for restart and update script are replaced by backslash+blank now (see http://forum.yacy-websuche.de/viewtopic.php?t=745) low012 2008-01-21 18:04:08 +00:00
  • f945ee21d2 some security additions, keep maximum byte[] size to 2^27 orbiter 2008-01-20 23:46:27 +00:00
  • 2f3b2f3481 - extended dbtest for comparisment tests - added initial space option for eco tables - used initial space value in initialization of collectionIndex, this should avoid OOM failures" /Volumes/Magneto/dev/workspace/trunk/source/dbtest.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroCollectionIndex.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroDyn.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroEcoTable.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroRow.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/kelondro/kelondroSplitTable.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/plasma/plasmaCrawlBalancer.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/plasma/plasmaCrawlStacker.java /Volumes/Magneto/dev/workspace/trunk/source/de/anomic/plasma/plasmaCrawlZURL.java - added index consistency check (checks for double-occurrences of primary keys in file) orbiter 2008-01-20 21:42:35 +00:00
  • 9eb746863d interface enhancements for eco records memory statistics orbiter 2008-01-20 01:51:02 +00:00
  • 9abc927645 to fix inconsistencies in collection index, a double reference reporting mechanism has been implemented orbiter 2008-01-20 01:22:46 +00:00
  • 58a1f518f8 fixed some problems with eco tables orbiter 2008-01-19 12:23:56 +00:00
  • d4d07802ac better RAM protection using eco tables orbiter 2008-01-19 01:50:24 +00:00
  • f6cfb97b7f added a test servlet (to be used to analyse the remote crawl xml bug) orbiter 2008-01-19 01:07:52 +00:00
  • f4e9ff6ce9 more generics orbiter 2008-01-19 00:40:19 +00:00
  • cbefc651ac more generics orbiter 2008-01-18 18:43:56 +00:00
  • 45339c3db5 more generics orbiter 2008-01-18 17:14:02 +00:00
  • 94f21d9403 activated new kelondroEcoTable file structure. This data structure replaces almost all files in the PLASMA directory also the collection.index and the LURL-db will be created as Eco-DB, if it does not exist before existing Flex-databases will be used as they are (the is no data lost) If you want to force the creation of a Eco-collection.index, simply delete the old index. The Eco file system will only be used if there is enough memory. The collection.index RAM limit is 200MB, if you have less, a flex-Table is createt. orbiter 2008-01-17 21:48:08 +00:00
  • 739f35d389 *) added previous/next links to blog (in case blog has more entries than get displayed on one page) low012 2008-01-17 21:01:30 +00:00
  • a0f7f2faad some more generics orbiter 2008-01-17 18:43:01 +00:00
  • dc26d6262b - removed write buffer from kelondroCache (was never used because buggy; will now be replaced by new EcoBuffer) - added new data structure 'eco' for an index file that should use only 50% of write-IO compared to kelondroFlex The new eco index is not used yet, but already successfully tested with the collectionIndex The main purpose is to replace the kelondroFlex at every point when enough RAM is available. Othervise, the kelondroFlex stays as option in case of low memory (which then can even use a file-index) orbiter 2008-01-17 12:12:52 +00:00
  • dbdec0f4d3 another fix for the "too many processes in loader queue, dismissed" - problem: this was probably caused by http-forward cases; which are cases when urls from the loader queue change and it was not possible to remove the old urls from the queue because they had been based on url hashes. The queue is now again stored using the entry.hashCode, which does not change ieven if the url changes. orbiter 2008-01-13 23:10:09 +00:00
  • b806a6af8b renamed kelondroEcoRecords to kelondroFullRecords (the "Eco"-name will be used for something else) orbiter 2008-01-13 00:41:22 +00:00
  • 065ba2d60f fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=719&hilit= orbiter 2008-01-13 00:21:47 +00:00
  • 71a67436ac *) fix for last commit low012 2008-01-13 00:21:33 +00:00
  • 352f733a86 *) added "previous" and "next" links that make it possible to navigate through lists of comments (needed if there are more than 10 comments to one postig) low012 2008-01-12 23:48:47 +00:00
  • 2018f33e7b *) it was possible to post comments even if they were turned of if one knew the ID of a posting in the blog *) Login link was displayed even if user was already logged in low012 2008-01-12 21:33:33 +00:00
  • f3f02b08ec no distinction between standard and pro releases in auto-updater this did not work in 0.56 main (but should). Therefore it will be necessery to provide a hand-made 'virtual pro' (just renaming) release 0.57 orbiter 2008-01-12 00:43:33 +00:00
  • 3cab85158c update for last commit borg-0300 2008-01-12 00:41:45 +00:00
  • 53367d941a more information (BASE64) borg-0300 2008-01-12 00:24:24 +00:00
  • b3636f5ba8 re-implemented file index in kelondroFlex orbiter 2008-01-11 14:43:28 +00:00
  • a6ca3b51be more generics orbiter 2008-01-11 14:13:08 +00:00
  • 64261754f4 - remove now obsolete commons-...jars from build.xml, see r4310 - complete reformat of the build.xml as it contained an unreadable mixture of space and tab indentation + trailing chars (now using 2 spaces indent without tabs) fuchsi 2008-01-11 06:46:25 +00:00
  • a5054c038d - added large number of generics - redesign of ordering structures in kelondro (old did not work with strict generics) - 50% IO reduction during read access on kelondroFlex (ommiting of read on index table) orbiter 2008-01-11 00:12:01 +00:00
  • eff372e20c - Fixed alignment of heading 'YaCy -' - Changed identation of html-file for better readability, added some comments apfelmaennchen 2008-01-10 19:26:04 +00:00
  • 8bb21e98f4 div.bookmarkList angepasst - rechter Rand zur TagList apfelmaennchen 2008-01-10 19:01:35 +00:00
  • 71bcf02d3a - removed pro-version (is the same as standard version, use the standard instead) - changed yacy logo - removed crawlOrder protocol (unused) - removed file index in kelondroFlex (will not work, it takes too long to maintain) - fixed remoted crawl for clusters (now denies remote crawls from peers outside cluster) - 0.562 orbiter 2008-01-09 23:05:52 +00:00
  • 39566d598a classpath update orbiter 2008-01-09 20:51:25 +00:00
  • b9dd597e97 - einem Komma folgende Leerzeichen bei der Eingabe von Tags werden gelöscht - Anpassungen für die Auswahlbox-Option "selected" - Einschränkung der Tagwolke aus Tag-Selektion - Rundung von font-size auf zwei Nachkommastellen apfelmaennchen 2008-01-09 16:02:31 +00:00
  • ce7257483d fix for bad fix with random access files (no performace enhancement) orbiter 2008-01-09 16:00:05 +00:00
  • 704de4dee8 Neue Funktion angelegt - notwendig für Einschränkung der Tagwolke public Iterator getTagIterator(String tagName, boolean priv) apfelmaennchen 2008-01-09 15:58:47 +00:00
  • ff16a6efc8 - Auswahlbox um die Option "selected" ergänzt - in der Auswahlbox vale von #[tag]# auf #[name]# geändert (case sensitive) apfelmaennchen 2008-01-09 15:56:34 +00:00
  • 016fc594af more generics orbiter 2008-01-09 09:58:56 +00:00
  • ecd7f8ba4e - added NEAR operator (must be written in UPPERCASE in search query) - more generics - removed unused commons classes orbiter 2008-01-08 20:12:31 +00:00
  • 3e3d2e39a4 - some refactoring and redesign of kelondroBytesIntMap (created new class kelondroRAMIndex) - more generics - preparation to extend the balancer for flexible forced delay times - set different random-access type, should now omit update of metadata in file and could be a bit faster (lets see) orbiter 2008-01-07 22:36:48 +00:00
  • 89f48bae55 *) if new tag is chosen, bookmark list will be updated automaticly if JavaScript is enabled (no click on "..." needed) low012 2008-01-07 20:48:08 +00:00
  • 214e37b6e3 added changes made by apfelmaennchen daburna 2008-01-07 20:01:53 +00:00
  • 1f199d688b *) Christmas is over! low012 2008-01-07 19:47:20 +00:00
  • 03e7782269 more generics orbiter 2008-01-06 19:23:38 +00:00
  • e9ceae77df french translation file is now correct matched daburna 2008-01-06 16:22:12 +00:00
  • 29b2b71646 translated sharedBlacklist_p.html (Orbiter, there is something wrong. There are no blacklist items listed - just -UNRESOLVED_PATTERN-) daburna 2008-01-06 14:19:23 +00:00
  • f7c5ccedc7 more generics orbiter 2008-01-06 00:31:26 +00:00
  • 88b2779787 added PerformanceMemory_p.xml lulabad 2008-01-05 21:04:30 +00:00
  • 7af60fb24d *) fixed bug in update script low012 2008-01-03 20:22:21 +00:00
  • ae6d07bdb8 *) "Did you mean:" will only be displayed if the list of suggested URLs is not empty. *) Removed <hr /> to make the "404 Unknown Host" error pag look like the other 404 error pages. low012 2008-01-01 23:03:02 +00:00
  • 408cb7a29b *) added check if archive for update is OK, install if OK, else just restart (http://forum.yacy-websuche.de/viewtopic.php?t=663) low012 2007-12-31 14:52:17 +00:00
  • 21b92e8e64 small grammar update daburna 2007-12-29 19:54:51 +00:00
  • df2a7a8ac8 more generics orbiter 2007-12-28 18:47:45 +00:00
  • 9d8b17188a more generics, bugfixes for wrong cast orbiter 2007-12-28 03:39:36 +00:00
  • b08f877e97 *) tried to get rid of warnings when compiling parsers (http://forum.yacy-websuche.de/viewtopic.php?t=660) low012 2007-12-27 22:37:02 +00:00
  • 4dc438f7e7 moved to Java 1.5: - changed build script to use java 1.5 compiler - first stept to resolve missing generics definition (about 400 from over 4100 'missing'-warnings) - added key-iterator to kelondro databases (for rapid from-memory enumerations, will be used for domain name collection, not used yet) orbiter 2007-12-27 17:56:59 +00:00
  • d8d955a7ff start of next development cycle towards 0.57 happy xmas! orbiter 2007-12-22 03:29:00 +00:00
  • db0d3d5e54 release 0.56 (and some last fixes) - fixed bad peer hash computation in case no peer list is avaiable upon first startup - security minimum waiting time in search result preparation - removed dead superseed link orbiter 2007-12-22 02:58:38 +00:00
  • d517e96714 last cleanup bits to serverDate before the release. only safe refactoring (method renaming) changes outside of serverDate. fuchsi 2007-12-21 00:53:46 +00:00
  • 4748d5c1ab Some enhancements to time management: - remove unnecessary generation of Calendar and Date objects - synchronized SimpleDateFormat objects in blog-, message- and wikiBoard - correct use of TimeZones and SimpleDateFormats hermens 2007-12-20 17:11:35 +00:00
  • 52dd015218 new release strategy: the standard release is now built the same way as the pro release a new release type was added: 'embedded' which is the same as the current standard release was this will not have any effect to the next release 0.56, which will still a pro-release on public download the transition the the new release strategy must be done now to enable automatic update by the updated in future releases orbiter 2007-12-20 02:46:41 +00:00
  • 1cb6e431a6 Replace the ISO8601 aka W3C datetime parser by one that supports every representation allowed by this standard, see http://www.w3.org/TR/NOTE-datetime - useful expecially for sitemaps parsing, where this date format is used fuchsi 2007-12-19 22:45:58 +00:00
  • 33ee6745f6 more cleanup in serverDate - remove direct accesses to SimpleDateFormat fields in serverDate and use the static parse... methods instead - remove nowDate() as a Date doesn't store timezone information and a new Date() is always faster - default formatter methods use a GMT timezone by default now, this is important for interchangability as some date formats we use don't include a timezone offset. - continued renaming and rearanging (formatter) methods. all should follow the general naming scheme formatWHAT(...) fuchsi 2007-12-19 19:39:19 +00:00
  • 3c30c2da75 more cleanup and API consistency changes, more to come... fuchsi 2007-12-19 13:29:50 +00:00
  • f41172f850 Merge httpDate into serverDate as suggested. Removed some unnecessary code and fixed a possible synchronization problem. fuchsi 2007-12-18 22:35:02 +00:00
  • 5aa8d72502 *) cleaned up code for better readability in Netbeans (tabs -> spaces)\n*) no functional changes low012 2007-12-18 20:57:02 +00:00