Commit Graph

  • adf01c676e reduce lookup time when merging a large number of BLOBs orbiter 2009-06-29 16:07:10 +00:00
  • 9a674d8047 - After the removal of the Tree class some code simplifications are possible. This affects mostly the Records class, which can be refactored and the result of the refactoring results in a reduced number of classes. - The EcoTable was renamed to Table. orbiter 2009-06-28 21:37:37 +00:00
  • c5122d6836 completed migration of BLOBTree to BLOBHeaps: - removed migration code - removed BLOBTree after the removal of the BLOBTree, a lot of dead code appeared: - removed dead code that was needed for BLOBTree Some more classes may have not much use any more after the removal of BLOBTree, but still have some component that are needed elsewhere. Additional Refactoring steps are needed to clean up dependencies and then more code may appear that is unused and can be removed as well. orbiter 2009-06-28 21:02:56 +00:00
  • d1083a6913 maybe we have less problems with open connections to the server if we don't do BF forced sleeps (just a test) orbiter 2009-06-28 10:35:12 +00:00
  • 34be6f82d2 fixed build path for eclipse orbiter 2009-06-28 10:31:59 +00:00
  • ebe6c823ac *) changed svn properties agains (hopefully doing it right this time) low012 2009-06-27 09:56:01 +00:00
  • a80ac3a415 *) fixed wrong parser descriptions *) changed svn properties low012 2009-06-27 09:42:33 +00:00
  • 457b6c0d6d *) updated Apache POI library to be able to parse Visio files *) updated PPT and XLS parsers to use new Apache POI library *) added new Visio (VSD) parser low012 2009-06-27 09:33:09 +00:00
  • a10c8022d1 DidYouMean: - limit the number of consumer threads to available CPUs - added some javadoc apfelmaennchen 2009-06-27 07:23:34 +00:00
  • 7eb3bff5b3 * workaround for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2220&hilit=#p16128 f1ori 2009-06-26 14:05:39 +00:00
  • d69d89caed portalsearch: better navigator call href='javascript:... apfelmaennchen 2009-06-26 10:26:45 +00:00
  • 477a4e14f9 updated styles apfelmaennchen 2009-06-26 09:11:02 +00:00
  • 0a38dd41b3 replacing styles apfelmaennchen 2009-06-26 09:03:25 +00:00
  • 565230d2a0 another atempt to fix the widget on linuxtag.de apfelmaennchen 2009-06-25 15:12:55 +00:00
  • f92daf9cc5 fixed the "1 to 10 of 10" bug in portalsearch for less than 10 results apfelmaennchen 2009-06-25 15:03:16 +00:00
  • e51ba46b8a css fix for forum search apfelmaennchen 2009-06-25 09:31:25 +00:00
  • 0923f20993 font-size fix apfelmaennchen 2009-06-25 08:38:48 +00:00
  • edef81b41d again a css fix for portalsearch :-( apfelmaennchen 2009-06-25 08:21:55 +00:00
  • 32d0ee964f more css fixes ;-) apfelmaennchen 2009-06-25 08:17:40 +00:00
  • cfd3d672a7 portalsearch css fix apfelmaennchen 2009-06-25 08:10:37 +00:00
  • a71bb7178d small fix for portalsearch apfelmaennchen 2009-06-25 08:07:17 +00:00
  • 2e206e8b27 added up and down scripts (shows peers that are up or down, useful for remote administration of private yacy networks) orbiter 2009-06-25 05:57:58 +00:00
  • 69b573a8ac - next release cycle - doku update for phpBB3 - added more files for search test scripts orbiter 2009-06-25 05:53:57 +00:00
  • 121728643b - css fix for navigators - maybe this fixes the display problems on linuxtag.de apfelmaennchen 2009-06-24 22:41:35 +00:00
  • 2b3e3ef6df release for linuxtag orbiter 2009-06-23 21:38:39 +00:00
  • 1670729950 better noadmin dialogue lotus 2009-06-23 09:39:35 +00:00
  • 93c69fa1cb - added hints to integrate a yacy search in phpBB3 - added also a phpBB3 crawl start with optimized crawl attributes orbiter 2009-06-22 23:38:15 +00:00
  • 99fa265e1d fix for search bug caused by tenant patch orbiter 2009-06-22 22:31:29 +00:00
  • 3164d9a205 small fix for favicons apfelmaennchen 2009-06-22 21:20:32 +00:00
  • edcb78dcb6 updated documentation / removed faviconize apfelmaennchen 2009-06-22 18:38:42 +00:00
  • b6058a7db1 yacyui-portalsearch: - more bug fixes - moved from faviconize to YaCy's favicons apfelmaennchen 2009-06-22 18:20:12 +00:00
  • 96d4e9383a added new jquer version in wiki search widget snippet orbiter 2009-06-22 13:19:09 +00:00
  • 79875782af be a bit more lazy when removing domain navigation entries orbiter 2009-06-22 12:30:22 +00:00
  • 57af311627 fix for wrong urls in navigator when a tenant is used orbiter 2009-06-22 12:25:18 +00:00
  • 76b96337e2 just some chatty code lotus 2009-06-22 11:45:21 +00:00
  • 01853ce849 removed "illegal character" lotus 2009-06-22 11:40:55 +00:00
  • 187ee4d06e another IE fix (also same names in html and js) lotus 2009-06-22 11:24:01 +00:00
  • 48051fef4b another fix for IE http://forum.yacy-websuche.de/viewtopic.php?p=16030#p16030 lotus 2009-06-22 11:15:00 +00:00
  • 37c162053d fix for IE & WatchCrawler (were same names in js and html) lotus 2009-06-22 11:03:44 +00:00
  • f2db0d248b fix for multi-word search (makes a replace-all) orbiter 2009-06-22 06:37:11 +00:00
  • 7fcffdcb3c - yacyui-portalsearch: fix for multiple search terms - http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p16015 apfelmaennchen 2009-06-22 05:43:54 +00:00
  • b07e518bcc added faviconcode to json search output orbiter 2009-06-21 20:57:18 +00:00
  • f091ad3e23 - hopefully a fix for the 'koblenz'-bug - http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p16005 apfelmaennchen 2009-06-21 20:24:39 +00:00
  • 91785d895c *) minor changes in comments low012 2009-06-21 20:08:52 +00:00
  • f6d0aaa787 update to java 6u14 lotus 2009-06-21 19:27:08 +00:00
  • d268bb5108 yacyui-portalsearch: auto open navigator sidebar apfelmaennchen 2009-06-21 12:53:14 +00:00
  • a22103560c yacyui-portalsearch waits with execution until all svripts have been loaded. It checks the load status every 200ms! apfelmaennchen 2009-06-21 07:54:42 +00:00
  • bdda140c02 fix for json output (no doubleqotes any more, doublequote quoting did not work) orbiter 2009-06-20 23:33:29 +00:00
  • 49955cc7b9 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209&p=15984#p15984 apfelmaennchen 2009-06-20 22:40:27 +00:00
  • 2f84736120 ignore signature files that cannot be downloaded because of failed encoding orbiter 2009-06-20 20:46:58 +00:00
  • 041d9c253e some refactoring and more error-awareness in LogalizeHandler orbiter 2009-06-20 20:29:57 +00:00
  • 2bb020a7a5 yacyui-portalsearch: small improvement to navigators apfelmaennchen 2009-06-20 12:08:35 +00:00
  • fee88d5fa3 maybe this fixes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p15967 apfelmaennchen 2009-06-20 11:41:44 +00:00
  • 6b307d6d59 more tolerance for corrupted index entries in exported row sets orbiter 2009-06-19 21:35:44 +00:00
  • 33aafa9b4b better logging when writing merged dumps orbiter 2009-06-19 17:02:50 +00:00
  • db70badcf0 possibility to set remote host on upnp device lotus 2009-06-19 15:32:59 +00:00
  • 4d29e90708 uaeh orbiter 2009-06-19 14:54:39 +00:00
  • 3c3e6499ae added more logging for merge operation orbiter 2009-06-19 14:51:35 +00:00
  • a119860b82 moved IndexImportWikimedia into different menu position orbiter 2009-06-19 14:03:28 +00:00
  • 15180fc95e - patch for future computation in SplitTable - added same concurrent process for has() from SPlitTable in ArrayStack orbiter 2009-06-18 23:24:23 +00:00
  • 9a5ec20b3c avoid merge during startup orbiter 2009-06-18 21:18:56 +00:00
  • bf6b92343c try to avoid stuck pdf parser lotus 2009-06-18 06:31:55 +00:00
  • c695c7f512 try to remove hung swf parser from queue lotus 2009-06-17 17:48:02 +00:00
  • fc69a76197 update to web structure picture: - allow bigger size - better instructions for api usage orbiter 2009-06-17 12:37:31 +00:00
  • ae015e8e98 refactoring of blob package classes orbiter 2009-06-17 09:58:15 +00:00
  • 8b8877c233 moved image collector orbiter 2009-06-16 21:48:09 +00:00
  • be1c7ddc64 refactoring of search classes -- moved Ranking Profile to search package orbiter 2009-06-16 21:45:40 +00:00
  • 1457bfce16 added updateYACY.sh to release build orbiter 2009-06-16 21:02:41 +00:00
  • fd31a3616a - more logging in server process - fix for bas ascii in comment orbiter 2009-06-16 15:10:59 +00:00
  • b5bc399cea added necessary synchronization for logging statistics (causes deadlock) orbiter 2009-06-16 10:37:13 +00:00
  • e377a1e9a1 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1969 lulabad 2009-06-16 08:16:59 +00:00
  • 5a7fd6b4c8 just some comment lines orbiter 2009-06-16 06:38:26 +00:00
  • 31f60a3b3e when doing searches, also apply a online caution to DHT transmission and stop transmissions while heavy load caused by searching. This omits the many requests to the URL database that are needed for DHT transfer and it avoids collisions with URL retrieval needed for search results. orbiter 2009-06-15 22:03:27 +00:00
  • 17dc6d4be5 small fix for new Logger orbiter 2009-06-15 21:39:24 +00:00
  • ce1adf9955 serialized all logging using concurrency: high-performance search query situations as seen in yacy-metager integration showed deadlock situation caused by synchronization effects inside of sun.java code. It appears that the logger is not completely safe against deadlock situations in concurrent calls of the logger. One possible solution would be a outside-synchronization with 'synchronized' statements, but that would further apply blocking on all high-efficient methods that call the logger. It is much better to do a non-blocking hand-over of logging lines and work off log entries with a concurrent log writer. This also disconnects IO operations from logging, which can also cause IO operation when a log is written to a file. This commit not only moves the logger from kelondro to yacy.logging, it also inserts the concurrency methods to realize non-blocking logging. orbiter 2009-06-15 21:19:54 +00:00
  • aec3e7995a autoconfig.pac can be used to browse .yacy-domains only lotus 2009-06-15 19:48:11 +00:00
  • 4e825852d2 added stub for phpBB3 search integration guide orbiter 2009-06-15 11:52:57 +00:00
  • bc6dd8194b refactoring: moved search query class to new search package orbiter 2009-06-15 11:49:00 +00:00
  • a4805defdd added stub for new search process orbiter 2009-06-15 11:46:23 +00:00
  • b8e738a7be a collection of - small bug fixes - better/more comments - more asserts - fixed synchronization - test case enhancements - code cleanup - performance hacks orbiter 2009-06-14 22:09:08 +00:00
  • 39779e4796 DidYouMean: as I moved to only 8 consumer and 4 producer threads, I removed poison pills as it does not make sense anymore - threads are interrupted directly. Having a consumer thread per test case just didn't make sense either (see svn 6070) due to the massive overhead. apfelmaennchen 2009-06-14 16:31:31 +00:00
  • c3c4dd0933 DidYouMean - changed to much simpler LinkedBlockingQueue apfelmaennchen 2009-06-14 15:25:57 +00:00
  • 01ac1b5d7e - blocking queue implementation of DidYouMean - timeout ist set to 500ms apfelmaennchen 2009-06-14 11:53:09 +00:00
  • b8bb1bb364 join with a timeout does not cause that the corresponding thread is stopped after the time-out. It does only cause that the waiting is stopped. Here we need additionally a signal to the thread to stop after we finished waiting. orbiter 2009-06-13 23:54:52 +00:00
  • b69f22e9ca mistake in last commit: computation of loops in ReversingTwoConsecutiveLetters orbiter 2009-06-13 23:37:51 +00:00
  • 3130334932 - start first with threads that run more loops - join first with threads that run less loops orbiter 2009-06-13 23:34:16 +00:00
  • 6cde7ebf16 DidYouMean - without I/O intensive sorting by count - but with multiple threads apfelmaennchen 2009-06-13 23:16:14 +00:00
  • f348190566 tried to insert a database dump import method to the phpBB3 import function. Reason: imports or large database dumps are cannot be handled with phpMyAdmin and this should be an easy way to the database dumps into a mySQL database where it can be exported again with the phpBB3 content integration adapter. Completion or removal of this function stub will follow before next main release. orbiter 2009-06-13 23:03:40 +00:00
  • 945777aa80 replaced rwi term counting method by one that computes the maximum of the blobs that contibute to the RWI. An addition of the blob sizes is wrong/incorrect and does not reflect the real size. Truncation the size operation to the maximum of all blobs is also incorrect, but not as wrong as the sum of all blob sizes wich double-counts many rwi entries. orbiter 2009-06-13 22:59:54 +00:00
  • 303ccda69f small fix for "did you mean" apfelmaennchen 2009-06-13 11:11:30 +00:00
  • 7c4d1d471c hand-over of more specific object orbiter 2009-06-13 10:22:25 +00:00
  • 9150bc0f7d - don't show empty "did you mean" apfelmaennchen 2009-06-13 07:02:50 +00:00
  • 6c116be536 - set default &meanCount=5 apfelmaennchen 2009-06-13 06:49:17 +00:00
  • 09acfa66d1 - improved "did you mean" - added &meanCount= to query string - &meanCount=0 ==> no suggestion, no performance loss - sorting suggestions by sb.indexSegment.termIndex().count() apfelmaennchen 2009-06-13 06:20:05 +00:00
  • da6ce37f7b - fixed encoding problem - added limit to 10 suggestions apfelmaennchen 2009-06-12 21:36:26 +00:00
  • 54a48b4184 - added "did you mean" to search page - currently works for single word queries only! apfelmaennchen 2009-06-12 20:36:03 +00:00
  • 31360ba40c - Updated ConfigLiveSearch.html - added documentation for load_js and load_css apfelmaennchen 2009-06-12 05:57:08 +00:00
  • ab09d8ebb3 - small noscript fix - noscript is now functionall but ugly apfelmaennchen 2009-06-11 22:10:02 +00:00
  • 55ef9ae12a small fix for last post apfelmaennchen 2009-06-11 21:42:34 +00:00
  • 36dc9b09ac - partial update to jquery-1.3.2 - partial update to jquery-ui-1.7.2 - yacyportalsearch fixed sidebar for navigators apfelmaennchen 2009-06-11 21:34:39 +00:00