Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-22 09:14:38 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 1c69d9b8b6 more refactoring of the index classes orbiter 2009-05-29 14:16:41 +00:00
  • 3d5f2ff544 - added new servlets to support search portal administrators for the integration of yacy search fields in their web pages - moved some servlets from here to there.. - changed menu structure - removed yacyui-portaltest.html which contained an example for the live search which is now integrated on all pages in yacy. The code snippet example from that page is integrated into the ConfigLiveSearch.html servlet orbiter 2009-05-29 14:16:03 +00:00
  • 4d4315687f fix for problem with concurrency in host navigator, bug reported by wsb orbiter 2009-05-29 10:52:50 +00:00
  • 88426912ad more refactoring to make the segment object easier to use and to be prepared to integrate author navigation orbiter 2009-05-29 10:03:35 +00:00
  • d813fd26ed reset sent/received counters on index delete lotus 2009-05-28 15:49:42 +00:00
  • 99bf0b8e41 refactoring of plasmaWordIndex: divided that class into three parts: - the peers object is now hosted by the plasmaSwitchboard - the crawler elements are now in a new class, crawler.CrawlerSwitchboard - the index elements are core of the new segment data structure, which is a bundle of different indexes for the full text and (in the future) navigation indexes and the metadata store. The new class is now in kelondro.text.Segment orbiter 2009-05-28 14:26:05 +00:00
  • 876746602d catch problems of file hash computation, see also: http://forum.yacy-websuche.de/viewtopic.php?p=15245#p15245 orbiter 2009-05-28 10:08:36 +00:00
  • fec6f9054f some refactoring of search methods orbiter 2009-05-27 23:51:34 +00:00
  • d793bb0d76 the mysql lib was not in releases included; moved library from libx to lib orbiter 2009-05-27 20:23:28 +00:00
  • 3d4b826ca5 migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. This removes the last very IO-intensive data structures which were still used for Wiki, Blog and Bookmarks. Old database files will still remain in the DATA subdirectory but can be deleted manually if no major bugs appear during migration. There is no need for any user action, all migration is done automatically. orbiter 2009-05-27 15:04:04 +00:00
  • 4b4bddca00 added new submenu to crawler menu: import of phpbb3 forum postings from mysql - yacy can import phpbb3 posts without crawling - all data is written as surrogate - indexed surrogate files can be re-used orbiter 2009-05-27 14:53:23 +00:00
  • f1a9253baa see: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15198 apfelmaennchen 2009-05-27 08:56:55 +00:00
  • 369bb78a7a - added "visibility: hidden;" for yacysearch.html sidebar - this only works with javascript....sorry apfelmaennchen 2009-05-27 07:30:59 +00:00
  • 16a226b016 removed debug-alert() from last commit apfelmaennchen 2009-05-27 07:13:45 +00:00
  • 01334686bd small fixes for yacysearch.html sidebar (display=3) apfelmaennchen 2009-05-27 07:06:13 +00:00
  • d8284046b0 enhanced speed of site navigation computation orbiter 2009-05-26 22:30:20 +00:00
  • c72a5cf326 added stub for PHPBB3 extraction code using direct access to mySQL orbiter 2009-05-26 15:58:49 +00:00
  • e735d3a69f fix for http://forum.yacy-websuche.de/viewtopic.php?p=15175#p15175 orbiter 2009-05-26 15:03:50 +00:00
  • 63a0255166 - refactoring: added new content package, which will contain connector classes for different types of data sources to import texts into the YaCy index - refactoring: migrated data objects for the new connector classes - added a DAO interface class to specify an abstract interface for database retrieval connector methods orbiter 2009-05-26 07:44:22 +00:00
  • f246928c20 first attempt to add 'real' Navigation to yacy search results: host navigation - after a search is started, it is analysed how many hits are in each site - this can be done really efficient, because the navigation information is hidden in the url hash and can be computed very fast - the search result shows a column on the right with the hosts and the hits per host - after a click on a host the search is modified using the efficient site: - operator orbiter 2009-05-25 22:27:34 +00:00
  • 54b9e99c01 - more information about peer tags - peer tag is by default '*' orbiter 2009-05-25 21:43:33 +00:00
  • 26a46b5521 increased default maximum file size for database files to 2GB Other file sizes can now be configured with the attributes filesize.max.win and filesize.max.other the default maximum file size for non-windows OS is now 32GB orbiter 2009-05-25 06:59:21 +00:00
  • eb36c9a092 hint for Java in start script this can usually only be seen if it isn't installed lotus 2009-05-24 17:06:37 +00:00
  • addecdb18c simplified code, removed one unused method in all implementing classes orbiter 2009-05-21 23:53:01 +00:00
  • 47fce9020c small change (Orbiter's wish) borg-0300 2009-05-21 17:51:52 +00:00
  • e07b14e5d7 finally a working fix for 5960 borg-0300 2009-05-21 16:07:04 +00:00
  • 3ebb904d2c fix for 5960, http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2119 borg-0300 2009-05-21 11:47:57 +00:00
  • 734680dc70 initialize the ResourceObsever in own thread lotus 2009-05-21 08:30:34 +00:00
  • e005cfea37 fix for bug in -incell option of URLAnalysis orbiter 2009-05-21 06:57:03 +00:00
  • a7e392f31b The collection index will not be supported any more. Existing indexes based on the old index collections must be migrated with YaCy 0.8 - removed index collection classes and all migration tools - added a 'incell' reference collection feature in URL analysis orbiter 2009-05-20 14:51:26 +00:00
  • a2f48863fc - added prototype for navigation index - refactoring of word index prototype (no functional changes so far) orbiter 2009-05-20 09:00:24 +00:00
  • 47fd226bdb proper parsing of sentences does not affect tokens/words lotus 2009-05-19 16:41:27 +00:00
  • 27eb8d62cb - new development cycle - removed temporary configuration with safe setting for indexer threads (=1) and replaced it with best value computed during performance tests (1/2 of number of processors) orbiter 2009-05-18 21:20:06 +00:00
  • fdb87a0616 release 0.8 orbiter 2009-05-17 22:23:36 +00:00
  • 41dd31cad2 replaced new navigation icons with same images but smaller resolution (16x16 instead of 128x128) orbiter 2009-05-17 22:22:29 +00:00
  • b7457d3807 patch for http://forum.yacy-websuche.de/viewtopic.php?p=14720#p14720 orbiter 2009-05-17 21:44:02 +00:00
  • bffbe43e09 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14522#p14522 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14955#p14955 orbiter 2009-05-17 21:15:06 +00:00
  • f133d6065c fix for http://forum.yacy-websuche.de/viewtopic.php?p=14955#p14955 orbiter 2009-05-17 18:28:33 +00:00
  • 16d28496ac *) YaCy will load status page once it is up again after restart or update if Javascript is enabled. low012 2009-05-17 16:28:39 +00:00
  • 82af994041 added missing loglevel lotus 2009-05-16 08:21:51 +00:00
  • ad9762746d no exception in case of uniq() time-out, see also http://forum.yacy-websuche.de/viewtopic.php?p=13177#p13177 orbiter 2009-05-15 23:07:10 +00:00
  • 1efe686e3f fix for http://forum.yacy-websuche.de/viewtopic.php?p=13960#p13960 orbiter 2009-05-15 22:51:15 +00:00
  • 13fb84ab81 you can define your default number of search results displayed by search.items this applies only to requests through the classic-style page lotus 2009-05-15 14:48:34 +00:00
  • a642d6a7b5 - added navigation icons for search result pages - modified result page rendering to use new icons instead of numbers - set different default values in yacy.init for higher indexing performance; removed pro-values - modified WatchCrawler to accept 30000 PPM instead of only a maximum of 6000 PPM orbiter 2009-05-14 23:11:10 +00:00
  • 012157c87f *) fixed "select all" and "deselect all"-button low012 2009-05-12 22:32:30 +00:00
  • f2e4d156e8 removed debug messages orbiter 2009-05-12 22:03:33 +00:00
  • 709bfc2cd4 added a memory check in http post protocol orbiter 2009-05-12 20:23:55 +00:00
  • c01d6f43e1 - fixed problem with thread dump if no arguments are given - rejecting peers that are older than 6 hours (not-seen during 6 hours) - 0.78, targeting 0.8 at the end of the week orbiter 2009-05-11 22:26:21 +00:00
  • a49edd9415 fix for bug in search with site: constraint orbiter 2009-05-11 21:20:23 +00:00
  • d3ca038979 fixed domain graph applet (visible in Terminal) orbiter 2009-05-11 21:12:30 +00:00
  • 04ec42e1d0 removed index Transfer, because it does not make sense any more to do a complete index transfer using the DHT methods. It is far easier and faster to just copy the whole index files from the source to the target peer. To do this, copy all files from DATA/INDEX/<network>/TEXT/RICACHE and DATA/INDEX/<network>/TEXT/METADATA from the source to the destination peer. Future versions of YaCy will have different file structures than given here, because of the new index segment concept, where each peer may have several indexes (called segments) for each network definition. A copy from one peer to another will then create a new index segment. To track changes for this feature, see forum discussion at http://forum.yacy-websuche.de/viewtopic.php?p=14728#p14728 orbiter 2009-05-10 21:00:39 +00:00
  • c1e5fad9a7 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14767#p14767 orbiter 2009-05-10 20:50:46 +00:00
  • 29f93b2abf Kaskelix looks forward to see you again :-) lotus 2009-05-10 17:53:15 +00:00
  • 8ee3a94e82 fix for non-caching of sitehash, see http://forum.yacy-websuche.de/viewtopic.php?p=14440#p14440 orbiter 2009-05-10 11:44:17 +00:00
  • 21930d05ed fix for [B@... borg-0300 2009-05-10 10:54:06 +00:00
  • b6ba387e01 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14751#p14751 orbiter 2009-05-10 10:46:26 +00:00
  • 9d1eb99c29 jre update lotus 2009-05-09 19:36:28 +00:00
  • ea5729ce21 hint for search parameters lotus 2009-05-09 19:14:52 +00:00
  • 4338dcf936 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2093&hilit= orbiter 2009-05-09 19:07:34 +00:00
  • bad7ce9286 experimental option trayIcon.force for unsupported platforms. java 1.6 needed lotus 2009-05-09 18:35:02 +00:00
  • ea27853c59 *) some refactoring *) added one assertion *) no functional changes low012 2009-05-09 13:43:38 +00:00
  • d164b42604 *) cosmetics low012 2009-05-08 19:26:36 +00:00
  • 55d51e4b8c fixed bug in indexcleaner orbiter 2009-05-08 15:35:53 +00:00
  • 17150b2950 fixed bug in snippet computation orbiter 2009-05-08 15:26:32 +00:00
  • 89aeb318d3 enhanced the wikimedia dump import process enhanced the wiki parser and condenser speed orbiter 2009-05-08 10:36:13 +00:00
  • 5fb77116c6 added a submenu to index administration to import a wikimedia dump (i.e. a dump from wikipedia) into the YaCy index: see http://localhost:8080/IndexImportWikimedia_p.html orbiter 2009-05-08 07:54:10 +00:00
  • df733af4fa Try not to loose content from ram during IndexCell.delete by moving ram.delete after the dangerous operations on the array (array.get and array.delete) hermens 2009-05-06 12:53:17 +00:00
  • ac72005f2f Let IndexCell.remove remove entries from the ram portion of the DB as well. hermens 2009-05-06 12:32:34 +00:00
  • 8ba7ff5353 a fix and another speed enhancement for the RWI cache orbiter 2009-05-05 22:40:40 +00:00
  • 05f077e85f added stack trace output to solve problem in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2076&hilit=&p=14612#p14612 orbiter 2009-05-05 20:24:20 +00:00
  • 71a4cadf31 better and more performant synchronization in SimpleARC, the caching object for word hashes. Speeds up indexing. orbiter 2009-05-05 20:19:51 +00:00
  • e6773cbb33 better handling of RWI cache for concurrency and less overhead when writing new entries -> even more indexing speed orbiter 2009-05-05 20:08:23 +00:00
  • ae334c7b83 *) -l and -d enable asserts now low012 2009-05-05 18:49:51 +00:00
  • c097531e3d added a catch Exception to all thread to check if any of them silently dies without any other notification orbiter 2009-05-05 06:31:35 +00:00
  • 083533e5ec fix for bugs in IODispatcher orbiter 2009-05-04 21:37:59 +00:00
  • 21fbca0410 better scaling of HEAP dump writer for small memory configurations; should prevent OOMs during cache dumps orbiter 2009-05-04 08:29:44 +00:00
  • 6e0b57284d better care for states of the IODispatcher orbiter 2009-05-03 22:54:47 +00:00
  • 1db9cdd4e4 fixed bug in writing of robots.txt entries in case that host names exceeded 64 characters and some other problems orbiter 2009-05-03 19:35:10 +00:00
  • 492165338d small addition for last commit apfelmaennchen 2009-05-02 12:12:33 +00:00
  • bde88b684a * splitt off yacyRelease from yacyVersion * added some gui infos about signatures f1ori 2009-05-02 12:12:22 +00:00
  • ac3139a1fd fix for live-search positioning in header.template apfelmaennchen 2009-05-02 11:56:55 +00:00
  • 057ce14c8e more fixes (character encoding, parser exceptions, http client failure, blob writing) orbiter 2009-05-02 07:43:03 +00:00
  • c3cd70b461 better human readable date format lulabad 2009-05-02 06:56:08 +00:00
  • d2ac0aa682 - fixed possible bugs in Stack (may affect Crawler reset) and RandomAccess handling - increased default memory size to 180MB - fixed possible bug in http client reset (there was a deadlock) - bug in BOBHeap marked, but not solved, cause is still unknown. orbiter 2009-05-02 01:40:03 +00:00
  • acfd79ab4a yacyui-portalsearch: added keyboard controlls ESC: close window PageDown: next search result page PageUp: prev. page apfelmaennchen 2009-05-01 10:34:56 +00:00
  • f490eab6ba yacyui-portalsearch: clear input on window close apfelmaennchen 2009-05-01 10:06:24 +00:00
  • 1351d903a1 don't follow links like mailto: lotus 2009-05-01 08:53:50 +00:00
  • e88a66bcae temporary disabling computation of all sublinks (check needed) orbiter 2009-05-01 07:30:53 +00:00
  • ff5f82d780 *) removed description of removed commands from wikiHelp ([= =]) *) used format function of Netbeans for wikiCode to make it more readable, no functional changes low012 2009-05-01 07:28:59 +00:00
  • eacf95213a fix for crawling of mailto-links orbiter 2009-05-01 07:25:55 +00:00
  • 9c6ac43f66 fixes for wiki parser orbiter 2009-04-30 22:03:35 +00:00
  • 3a64c9d02f - fix for problem with concurrency when computing word hashes - fix for search in case that a urlfilter was used and zero results were returned orbiter 2009-04-29 22:14:12 +00:00
  • d3f8aa5a2a set of small fixes orbiter 2009-04-29 21:36:20 +00:00
  • 78ffb61297 *) got rid of unnecessary variable which might also fix IndexOutOfBoundsException low012 2009-04-29 21:08:44 +00:00
  • 84518710d0 small fix apfelmaennchen 2009-04-29 19:51:42 +00:00
  • 63097513ae maybe this smoothens the timing problems yacyui-portalsearch.js a little bit apfelmaennchen 2009-04-29 18:52:20 +00:00
  • d31e6f9c14 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14457#p14457 orbiter 2009-04-29 11:18:17 +00:00
  • 0e01e846ef small fix lotus 2009-04-28 18:59:56 +00:00
  • d8fca85c11 fixed search: allow dots in operators added new operator "tld:" which was the former "site:" "site:" uses fast site operator introduced in r5770 lotus 2009-04-28 17:12:31 +00:00
  • 8d6212233b fix for IODispatcher orbiter 2009-04-28 07:24:28 +00:00