Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-22 09:14:38 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • bd876eb4b7 moved io classes orbiter 2009-10-10 01:00:49 +00:00
  • c0e0e1f422 moved blob classes orbiter 2009-10-10 00:43:25 +00:00
  • 1e4f8b56ed accumulated classes from different packages into the new rwi package orbiter 2009-10-10 00:39:15 +00:00
  • 194da25a2f moved kelondro index orbiter 2009-10-09 23:32:08 +00:00
  • 4446acc8cd moved kelondro order orbiter 2009-10-09 23:22:22 +00:00
  • f677d534b1 start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root - moved here the logging classes as part of the new net.yacy.kelondro package orbiter 2009-10-09 23:13:30 +00:00
  • ea473e32b8 refactoring orbiter 2009-10-09 22:27:50 +00:00
  • 735e2737e3 * added index segments This is a major change in the organization of indexes. Please consider a back-up of your data before you run this update. All existing index files will be moved and renamed to a new position. With this change, it will be possible to maintain different indexes for different purposes and it will be possible to have a distinction between DHT-in and DHT-out specific indexes. Tenants may also have their own index, and it may be possible to have histories and back-ups of indexes. This is just the beginning, many servlets must be adopted after this change, but all functions that had been there should still work. orbiter 2009-10-09 14:44:20 +00:00
  • 09de5da74a once again a performance hack orbiter 2009-10-08 18:26:54 +00:00
  • 2f6d88403e uä orbiter 2009-10-08 18:10:56 +00:00
  • d2615ea5a8 increased memory for scraper buffer to enhance parsing speed orbiter 2009-10-08 15:27:13 +00:00
  • 4bbbb74ec4 removed not necessary synchronization orbiter 2009-10-08 15:26:28 +00:00
  • 67e5464cc2 Fix for SVN6380: x[] Arrays are unsuitable Keys for Maps without using a proper Comparator. hermens 2009-10-08 12:55:36 +00:00
  • 5f72d2b19f update to jre6u16 lotus 2009-10-08 10:48:33 +00:00
  • aeab8c7917 Prevent failed DHT attemps from overwriting newer peer info hermens 2009-10-08 00:17:29 +00:00
  • 9324b5b6c5 Enhancements to DHT - speed up deletion of containers when selscted from whole index - correctly eliminate all references to unavailable URLs, not just the first encountered hermens 2009-10-08 00:03:16 +00:00
  • e49e2d75fe Limit the time Transmission.Chunks stay in the transmissionCloud by using a Map that iterates entires in insertion order. hermens 2009-10-07 23:41:25 +00:00
  • 92db7c5d07 increased timeout for index retrieval orbiter 2009-10-07 13:03:13 +00:00
  • 386b9f35f6 activated resource observer for windows 7 lotus 2009-10-07 06:20:24 +00:00
  • 6e0dc39a7d - some fixes to prevent blocking situations - better logging for the crawler - better default values for the crawler orbiter 2009-10-06 21:52:55 +00:00
  • 51f2bbf04b possible fix for problem in http://forum.yacy-websuche.de/viewtopic.php?p=17655#p17655 orbiter 2009-10-06 09:56:14 +00:00
  • f8371707e5 - possibly better termination for SplitTable - better abstraction in DidYouMean orbiter 2009-10-05 22:09:58 +00:00
  • 87780f2562 produce did-you-mean also for queries with more than one word orbiter 2009-10-05 21:51:02 +00:00
  • 04a548a1e3 - temporary integrated the transferURL servlet as static class instead as a class that is called using reflection to investigate the OOM problems in that class - fixes for numerous other problems - removed dead code - resdesign of the strings-method, which produces now less memory overhead and may help to prevent OOMs - another fix for the deadlock problem in SplitTable orbiter 2009-10-05 20:11:41 +00:00
  • ea427df944 fixed a worst case situation of the condenser which may cause a temporary full CPU load because of a bad data structure usage orbiter 2009-10-05 08:26:55 +00:00
  • f1bde59c50 logger config cleanup lotus 2009-10-02 18:03:14 +00:00
  • 3e38035389 fix for interrupted thread during has() property check orbiter 2009-10-02 10:55:40 +00:00
  • 5bd1c1d205 just added some comments that had been produced to learn about OAI-PMH orbiter 2009-10-01 22:56:22 +00:00
  • d52cf19835 small changes to de.lng (parser settings) suessthomas 2009-10-01 20:27:05 +00:00
  • 6aa474f529 - better logging for web cache access and fail reasons - better Exception handling for web cache access - distinction between access of web cache for proxy and crawler orbiter 2009-10-01 13:08:19 +00:00
  • 3671c37989 added experimental oai-pmh reader and integrated it with the existing dublin core parser orbiter 2009-09-30 22:11:00 +00:00
  • 0c17b600c6 remote search by default off orbiter 2009-09-30 15:06:29 +00:00
  • 58a00205d5 re-activated the emergency close when too many server connections exist orbiter 2009-09-30 14:29:43 +00:00
  • c57d2070e6 more logging orbiter 2009-09-30 13:25:08 +00:00
  • a995b95367 tried a fix for the httpd access bug (too many unclosed sessions) orbiter 2009-09-30 13:18:02 +00:00
  • e1fba41cad better logging orbiter 2009-09-29 21:52:17 +00:00
  • 2275f885a8 possible fix for concurrency problem orbiter 2009-09-29 21:40:50 +00:00
  • a6a3090c3d *) blacklist cleaner supports usage of regular expressions now *) refacored BlacklistCleaner_p.java for better readability *) moved check of validity of patterns to the Balcklist implementation since patterns might be valid in one implementation, but not in another *) added method to check validity to Blacklist interface *) fixed some minor issues like typos or wrong whitespaces *) set subversion properties for a whole bunch of files low012 2009-09-29 21:28:49 +00:00
  • 5a93807781 improved web cache speed: - removed one computation out of a synchronization - removed one not necessary has() call orbiter 2009-09-29 08:41:05 +00:00
  • 2e8b2867ff double performance of store method because it avoids one 'has' orbiter 2009-09-29 08:23:44 +00:00
  • afda5b1adc new join method for indexes (not yet used) orbiter 2009-09-29 08:16:24 +00:00
  • 65b66c2c18 better handling of array files of length 0 orbiter 2009-09-29 08:13:44 +00:00
  • 1957b5797a fix for seed generation orbiter 2009-09-29 08:05:36 +00:00
  • 432154f725 new strategy for concurrent database index key retrieval orbiter 2009-09-29 08:04:00 +00:00
  • 09775daa60 slightly changed my skin (vega-aqua): - search result headline font is slightly larger and has an underline (like g**gle) suessthomas 2009-09-28 19:50:43 +00:00
  • a11cd9f80f - removed reverse name lookup for http access logging (grr..) - removed a synchronization in seed info string generation orbiter 2009-09-28 15:23:15 +00:00
  • 2e6bdce086 - added more logging to balancer - changed balancer logic slightly orbiter 2009-09-27 22:35:22 +00:00
  • 3c4064932c *) added width and hight to prevent the page from "jumping" when the image is reloaded automatically in Opera 10 low012 2009-09-26 22:32:52 +00:00
  • 5e4f267a36 *) added subversion properties and edited a few comments low012 2009-09-26 22:07:40 +00:00
  • 2d01411bbc *) tested string will appear in input box now (when testing a similar URL it does need to be copied anymore, it can be edited it right away) *) https:// and ftp:// can be used as start of the string to be tested now too *) better error handling (no text in Java anymore) low012 2009-09-26 21:33:33 +00:00
  • 3faa011e3d added another search integration help page orbiter 2009-09-25 14:03:41 +00:00
  • 26b81bd1f1 added another search integration help page orbiter 2009-09-25 14:03:07 +00:00
  • 69a091de17 added skin for geocaching search portal orbiter 2009-09-24 22:53:50 +00:00
  • 1171a72006 fix for deadlock as seen in http://forum.yacy-websuche.de/viewtopic.php?p=17521#p17521 orbiter 2009-09-24 19:14:35 +00:00
  • 031e6eefbd some updates to dublin core, metadata browsing, file indexing and parser stability orbiter 2009-09-24 12:54:45 +00:00
  • 62a7341c4d Fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2204 hermens 2009-09-24 11:38:15 +00:00
  • f65bfaa9af *) Removed base tag from errror page. This has been added by myself a long time ago as a workaround for some weird behavior of my router, but as it turns out, it does more bad than good in general: If HTTPS is used for communication with YaCy, entering a wrong passwort led to an errror page with a form which would send username and password unencrypted with the user possibly being unaware of this. *) changed some comments, added some annotations, added SVN properties here and there low012 2009-09-23 21:26:14 +00:00
  • e4797ebcde fix for http://forum.yacy-websuche.de/viewtopic.php?p=17509#p17509 corrupted files are ignored orbiter 2009-09-22 22:00:45 +00:00
  • efa7fb34f0 better oom-awareness of miss-cache in cache orbiter 2009-09-22 15:01:29 +00:00
  • 3e9dcfc204 fix for http://forum.yacy-websuche.de/viewtopic.php?p=17504#p17504 orbiter 2009-09-22 14:39:06 +00:00
  • c3a4aee255 some redesign with a possible fix for the ReferenceContainerCache. orbiter 2009-09-22 14:33:57 +00:00
  • e5d04f6b91 added vega's skin see http://forum.yacy-websuche.de/viewtopic.php?p=3530#p3530 orbiter 2009-09-21 22:06:15 +00:00
  • feece4bfcb slightly changed default skins: - search result headline font is slightly larger and has an underline (like g**gle) - no dashed line between results in grey style - no search results with menu on left side by default (but is still possible) orbiter 2009-09-21 21:30:24 +00:00
  • aca8a78eb8 fix for shutdown of DocumentIndex objects orbiter 2009-09-21 15:24:47 +00:00
  • 23ab6fbca4 - navigation appear at correct position when opengeodb-results are also presented after a search - show an about box if about.headline and about.body is set orbiter 2009-09-20 22:10:45 +00:00
  • 4db34eea73 fix for OOM problem in kelondro Cache orbiter 2009-09-19 07:50:46 +00:00
  • 8ea1d7ab59 fix for wrong assert condition in search abstract generation orbiter 2009-09-18 21:49:38 +00:00
  • 70bda620db another fix for/against bad debian packages orbiter 2009-09-18 21:43:23 +00:00
  • fbd77bd77c git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6328 6c8d7289-2bf4-0310-a012-ef5d649a1542 orbiter 2009-09-18 12:33:35 +00:00
  • 4652b4d299 fixed debian package orbiter 2009-09-18 12:30:22 +00:00
  • 54c7cbf1d9 - fast result for local search in case that less than 10 hits exists - small change in display of RAM in profiling orbiter 2009-09-18 09:19:52 +00:00
  • 28d4b921b6 different approach for file search orbiter 2009-09-18 07:54:16 +00:00
  • f99f86c5c5 added concurrency to file indexing class orbiter 2009-09-17 22:37:21 +00:00
  • 902d16cf6c fixes to parser orbiter 2009-09-17 22:00:19 +00:00
  • 4a1c852435 fix in usage of RAM copy for Table objects and some cosmetics in asserts. This bug affected Tables in case that a removeOne() was called and a RAM copy of the table was active. It may happen for peer owners with a lot of RAM assigned to YaCy. The bug appeared especially during crawling when the balancer tried to get new entries from the crawl queue. This bug may help to solve report at http://forum.yacy-websuche.de/viewtopic.php?p=17417#p17417 and will be tracked there orbiter 2009-09-17 20:41:50 +00:00
  • 11323bcb36 added debug flag to built to enable better debugging of yacycore.jar orbiter 2009-09-17 19:21:07 +00:00
  • dce450e2e0 possible fix for "hung" doc-documents lotus 2009-09-17 17:08:32 +00:00
  • a4888249f1 Small improvements in the German language. My first amendment, I hope it still works all ... suessthomas 2009-09-16 20:33:24 +00:00
  • db1b030276 fixed class path in startup scripts; omitting old classes path; all classes are now in lib/yacycore.jar orbiter 2009-09-15 17:29:18 +00:00
  • 033554dc12 more logging in tranferURL to find OOM bug. See also http://forum.yacy-websuche.de/viewtopic.php?p=17361#p17361 orbiter 2009-09-15 12:59:55 +00:00
  • e627f75415 one more fix to badwords and stopwords orbiter 2009-09-15 11:47:50 +00:00
  • 721b88efbd - fixed a problem loading blacklists with new yacycore.jar - fixed badwords and stopwords initialization orbiter 2009-09-15 11:46:02 +00:00
  • 80d5005044 fixed seed upload methods - replaced reflection with direct instantiation orbiter 2009-09-15 09:47:02 +00:00
  • 68465c37af added a convenience class to add files into a YaCy index to make this possible, the yacyURL must be able to process file:// urls, which has also been implemented testing of the new class resulted in some bugfixes in other classes orbiter 2009-09-14 21:17:42 +00:00
  • 2e41e10ffd - updates to yacyVersion parser (remove old targets) - added javadoc target to built script (does not work yet without errors) orbiter 2009-09-14 18:08:40 +00:00
  • 1ddaf16466 added generation of a yacycore.jar yacy library file: when a ant dist is envoked, the release is built using the new yacycore.jar without the class files in classes YaCy consists currently of two main parts: the YaCy core and the YaCy interface. This change will make it possible to use the YaCy core as part of other projects. orbiter 2009-09-14 17:06:09 +00:00
  • 5658044388 - when there are no topics, the topics window is not shown - othervise: close topics window by default There will be more navigation in the future (i.e. update-time selection) and the topics will be less important than the others, therefore it is now hidden by default orbiter 2009-09-11 14:54:53 +00:00
  • 27d00285aa - added a new file reader cache that may serve as full-file-copy of blob database files. This is not yet used - removed class FileWriter and replaced all usage of that class with CachedFileWriter orbiter 2009-09-09 21:28:23 +00:00
  • fd6b9cb7dc refactoring of IO access classes orbiter 2009-09-09 20:49:16 +00:00
  • d64569aa39 reuturn only recommendations of words that have a greater count than the original word orbiter 2009-09-08 13:57:52 +00:00
  • 604c37927f used comparator for did-you-mean that uses index sizes for comparisment, but: - limit comparisment to only the first 10 elements that had been sorted before without IO - added a size cache to index computation because the size is computed at least twice in set comparator orbiter 2009-09-08 13:48:17 +00:00
  • a58d9cae7d - show location name in geolocalization search result - added link from location icon to openstreetmap browser with coordinates orbiter 2009-09-08 10:18:03 +00:00
  • 573d03c7d7 added configuration to enable ram table copy orbiter 2009-09-07 20:30:57 +00:00
  • 8274251467 *) stopped page content from jumping in Opera 10 when loading an image took too long low012 2009-09-07 20:19:26 +00:00
  • 3be54e1891 fix to rule when to use a ram table copy orbiter 2009-09-07 19:22:12 +00:00
  • 700218846c disabled or removed sleep calls orbiter 2009-09-07 18:50:44 +00:00
  • 342c5d0fd4 fixed city name detection: finds now also substrings of city names orbiter 2009-09-06 20:44:02 +00:00
  • 18aa0609ca fix for caching of word hash computation orbiter 2009-09-05 22:05:18 +00:00
  • a10a6cce45 patch for http://forum.yacy-websuche.de/viewtopic.php?p=17289#p17289 orbiter 2009-09-05 21:52:50 +00:00
  • 53bbdfd19a *) setting SVN keywords *) minor changes low012 2009-09-05 20:41:21 +00:00