Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-06 23:56:13 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • fa07234d4e fix for clear method: now deletes files orbiter 2009-03-29 21:28:14 +00:00
  • eb65990f85 small fix for opera in yacyui-portalsearch apfelmaennchen 2009-03-29 12:49:42 +00:00
  • 695c420bcd small fix for yacyui-portalsearch apfelmaennchen 2009-03-29 10:31:15 +00:00
  • 95885a263a - added default properies to yacyui-portalsearch - see http://localhost.8080/yacy/ui/yacyui-portaltest.html apfelmaennchen 2009-03-29 09:29:08 +00:00
  • c001a020a9 - small modifications to yacyui-portalsearch - see http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&p=13459#p13459 apfelmaennchen 2009-03-28 23:06:15 +00:00
  • df87e4dbf6 missing count of send Index and URLs lulabad 2009-03-28 20:49:58 +00:00
  • 34a825f90d small fix for yacyui-portaltest.html apfelmaennchen 2009-03-27 06:41:39 +00:00
  • 9f9d7f875d small fix apfelmaennchen 2009-03-27 06:30:59 +00:00
  • 453f3aaa94 RichClient: further clean-up apfelmaennchen 2009-03-27 06:06:14 +00:00
  • e888c9a934 RichClient: - renamed base theme to start theme - reoved all but start theme - additional themes can be downloaded from http://jquery-ui.googlecode.com/files/jquery-ui-themes-1.7.zip - or a custom theme can be generated at http://jqueryui.com/themeroller/ - themes are installed into DATA/LOCALE/htroot/yacy/ui/css/themes - update for RichClient theme selection will follow soon apfelmaennchen 2009-03-27 06:04:39 +00:00
  • 42c5f930c8 reverted an accidental commit apfelmaennchen 2009-03-24 05:41:29 +00:00
  • b5e6232f8d small correction of font-size for portal search apfelmaennchen 2009-03-23 21:26:28 +00:00
  • 7425c6c3ca added an ajax loading graph to portal search apfelmaennchen 2009-03-23 20:22:53 +00:00
  • a975ae4a7e Added YaCy portal search: http://localhost:8080/yacy/ui/yacyui-portaltest.html apfelmaennchen 2009-03-23 20:16:07 +00:00
  • b57a1820bd small fix for jquery-faviconize-1.0.js to handle https properly apfelmaennchen 2009-03-21 19:35:20 +00:00
  • 075b58a0a9 minor fixes for RichClient search apfelmaennchen 2009-03-21 18:54:42 +00:00
  • c450e3746b svn attributes added borg-0300 2009-03-20 15:44:59 +00:00
  • 37f892b988 added new concurrent merger class for IndexCell RWI data orbiter 2009-03-20 14:54:37 +00:00
  • 8c494afcfe svn attributes added borg-0300 2009-03-20 11:21:32 +00:00
  • 67aaffc0a2 - added Latency control to the crawler: because of the strongly enhanced indexing speed when using the new IndexCell RWI data structures (> 2000PPM on my notebook), it is now necessary to control the crawling speed depending on the response time of the target server (which is also YaCy in case of some intranet indexing use cases). The latency factor in crawl delay times is derived from the time that a target hosts takes to answer on http requests. For internet domains, the crawl delay is a minimum of twice the response time, in intranet cases the delay time is now a halve of the response time. orbiter 2009-03-20 10:21:23 +00:00
  • 7426dde6a6 windows installer: * install 64 bit JRE in case of 64 bit OS (not testet yet) * less languages but localized hint boxes * some cosmetics lotus 2009-03-19 18:53:30 +00:00
  • 0926310461 another performance hack orbiter 2009-03-18 22:33:36 +00:00
  • ebe5d69d14 performance hacks orbiter 2009-03-18 22:19:08 +00:00
  • 61f9dbf0cc - fixed a display problem in watch crawler - another small enhancement in balancer orbiter 2009-03-18 21:25:52 +00:00
  • b3f75e48fa - enhanced balancer: auto-solving of waiting-deadlocks - removed deprecated cache-init size value - more debug lines for IndexCell cache dump merge orbiter 2009-03-18 20:21:19 +00:00
  • 9a90ea05e0 added a merge operation for IndexCell data structures orbiter 2009-03-18 16:14:31 +00:00
  • d99ff745aa fix for http://forum.yacy-websuche.de/viewtopic.php?p=13378#p13378 orbiter 2009-03-18 10:29:13 +00:00
  • 0c3ab291c4 fix for http://forum.yacy-websuche.de/viewtopic.php?p=13354#p13354 orbiter 2009-03-17 22:20:58 +00:00
  • a9cea419ef Integration of the new index data structure IndexCell This is the start of a testing phase for IndexCell data structure which will replace the collections and caching strategy. IndexCall creation and maintenance is fast, has no caching overhead, very low IO load and is the basis for the next data structure, index segments. orbiter 2009-03-17 13:03:27 +00:00
  • fd0976c0a7 refactoring borg-0300 2009-03-16 18:08:43 +00:00
  • 83792d9233 more refactoring orbiter 2009-03-16 16:24:53 +00:00
  • ce79239322 "typo" borg-0300 2009-03-16 16:22:33 +00:00
  • cdbdc731c5 small updates: unescape, isCGI borg-0300 2009-03-16 08:49:49 +00:00
  • 474aac65af more refactoring orbiter 2009-03-16 08:32:28 +00:00
  • 209f25f5f5 refactoring to integrate indexCell data structures orbiter 2009-03-16 00:18:37 +00:00
  • 359a238acf faster isCGI() borg-0300 2009-03-14 13:47:49 +00:00
  • f75628e53b some corrections borg-0300 2009-03-14 11:08:32 +00:00
  • b7138e5fcb even more efficient comparator calls (less System.arraycopy for primary keys) orbiter 2009-03-14 00:41:20 +00:00
  • 65784eb656 - more efficient comparator calls - fix for http://forum.yacy-websuche.de/viewtopic.php?p=13331#p13331 orbiter 2009-03-14 00:07:37 +00:00
  • 44874cb550 added a deleteOnExit for blob file deletion in case that a deletion is not successful. orbiter 2009-03-13 22:47:31 +00:00
  • 66f78d67e0 bad idea. Concurrency in index management will be done differently orbiter 2009-03-13 22:22:11 +00:00
  • 7dff1cba62 removed option to use different primary keys in kelondro tables this option was never used and there is also no use to set other columns but the first as the primary key. as a result, access methods to the key do not need to compute key positions, and they work faster. orbiter 2009-03-13 16:52:31 +00:00
  • 7f67238f8b refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection orbiter 2009-03-13 14:56:25 +00:00
  • 14a1c33823 refactoring of wordIndex class orbiter 2009-03-13 10:34:51 +00:00
  • d49238a637 more performance hacks: better default values for scaling, less memory usage orbiter 2009-03-13 10:07:04 +00:00
  • 39644dc14e performance hacks to compare methods in database core orbiter 2009-03-13 09:30:19 +00:00
  • e2e7949feb replaced old PPM computation with a better one that simply sums up events that had been stored in the profiling table. orbiter 2009-03-13 00:13:47 +00:00
  • f6d989aa04 added new class RowSetArray which arranges RowSet objects like Elements in a hashtable, but still provides the functionality of sorted enumeration. The new class is now integrated into the ObjectIndexCache, which is the core class to provide index functions to all database files. The new index access is about twice as fast as before. This has strong speed enhancement effects on all parts of YaCy. orbiter 2009-03-12 23:05:18 +00:00
  • 0a2fabeef3 static TMPDIR borg-0300 2009-03-12 16:23:12 +00:00
  • 9f7e62e900 refactoring lotus 2009-03-12 16:20:04 +00:00
  • f35dc11dc4 allow crawl start from pages with script tags http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1910 lotus 2009-03-12 16:12:50 +00:00
  • 6958eff196 removed unnecessary exceptions, extended testing in IntegerHandleIndex orbiter 2009-03-12 07:35:17 +00:00
  • 13c666adef performance hack to ObjectIndex put() method: Java standard classes provide a Map Interface, that has a put() method that returns the object that was replaced by the object that was the argument of the put call. The kelondro ObjectIndex defined a put method in the same way, that means it also returned the previous value of the Entry object before the put call. However, this value was not used by the calling code in the most cases. Omitting a return of the previous value would cause some performance benefit. This change implements a put method that does not return the previous value to reflect the common use. Omitting the return of previous values will cause some benefit in performance. The functionality to get the previous value is still maintained, and provided with a new 'replace' method. orbiter 2009-03-11 20:23:19 +00:00
  • 1f1be1518c added stub for another performance hack: concurrent indexes orbiter 2009-03-11 15:52:03 +00:00
  • 3e4c28e188 enhanced count feature for kelondroRowSet. This is about twice as fast as before. Should speed up the collection analysis (half time!) orbiter 2009-03-11 15:10:38 +00:00
  • 84e37387a2 fix for last commit and more testing stub orbiter 2009-03-11 09:16:46 +00:00
  • ca006c506d stub for performance enhancements for RowSet (no functional change yet) orbiter 2009-03-11 08:55:43 +00:00
  • d988204875 better shutdown of tools orbiter 2009-03-10 23:17:13 +00:00
  • 100247bdda added also an export and delete-feature to the URLAnalysis. This completes the clean-up feature for URLs. To do a complete clean-up of the url database, start the following: java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -incollection DATA/INDEX/freeworld/TEXT/RICOLLECTION used.dump java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -diffurlcol DATA/INDEX/freeworld/TEXT used.dump diffurlcol.dump java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -export DATA/INDEX/freeworld/TEXT xml urls.xml diffurlcol.dump java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -delete DATA/INDEX/freeworld/TEXT diffurlcol.dump orbiter 2009-03-10 20:52:10 +00:00
  • 8c60d6d117 In DHT selection delete only those references that were actually selected hermens 2009-03-10 13:56:30 +00:00
  • 60078cf322 added next tool for url analysis: check for references, that occur in the URL-DB but not in the RICOLLECTIONS to use this, you must user the -incollection command before (see SVN 5687) and you need a used.dump file that has been produced with that process. orbiter 2009-03-10 13:38:40 +00:00
  • b1ddc4a83f do not merge collections if ram == false orbiter 2009-03-09 23:38:29 +00:00
  • dbdd10da84 better logging and startup behaviour for referenceHash computation orbiter 2009-03-09 22:32:04 +00:00
  • d612430fce copy paste mistake borg-0300 2009-03-09 19:05:36 +00:00
  • acbdac1b67 corrected examples borg-0300 2009-03-09 18:37:50 +00:00
  • d64836c34f added statistical analysis of URL reference use that with the following command on a linux shell: java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -incollection DATA/INDEX/freeworld/TEXT/RICOLLECTION used.dump for freeworld indexes. For more details please see discussion below: http://forum.yacy-websuche.de/viewtopic.php?p=13204#p13204 orbiter 2009-03-09 10:43:28 +00:00
  • 3b28daab40 code-beautification (to be consistent with external documentation paper) orbiter 2009-03-09 10:24:15 +00:00
  • 396a4451be increased timeout in ViewFile orbiter 2009-03-09 10:16:37 +00:00
  • 485c9406e5 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1915&hilit=&p=13249#p13249 orbiter 2009-03-09 10:14:49 +00:00
  • 858f800a07 more logging in httpd to detect shutdown cause. See also: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1914&hilit=&p=13246#p13246 orbiter 2009-03-09 09:56:26 +00:00
  • b80db04667 - refactoring of IntegerHandleIndex and LongHandleIndex (better method names) - fix for problem in httpdFileHandler: mising close of open Files if tempate cache was disabled - more memory for DHT selection required - stub for URL reference hash statistics in index collections orbiter 2009-03-08 21:37:17 +00:00
  • 9b6fac4a82 RichClient: better handling for small screens/windows apfelmaennchen 2009-03-08 08:55:04 +00:00
  • 92375cfaa3 translation update lotus 2009-03-07 15:34:54 +00:00
  • 8ee946bf1d show upnp status lotus 2009-03-07 15:31:24 +00:00
  • f0947a20a8 - RichClient: increased ajax timeout to 10 sek. apfelmaennchen 2009-03-07 11:01:13 +00:00
  • e73ac67f7e - for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient apfelmaennchen 2009-03-07 10:51:24 +00:00
  • 16f5c6a85e fixed merge method initialization in ReferenceContainer orbiter 2009-03-07 10:45:14 +00:00
  • f7fd3d30c2 - various changes to RichClient - improved search stability apfelmaennchen 2009-03-07 10:20:34 +00:00
  • 4f3bdc64b5 - added ?callback= parameter for JsonP support - this is needed for json ajax cross domain calls - see: http://bob.pythonmac.org/archives/2005/12/05/remote-json-jsonp/ apfelmaennchen 2009-03-07 10:18:47 +00:00
  • d84264946b - Randspalte für Navigatoren in Suchergebnissen (display=3) - http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p13195 apfelmaennchen 2009-03-06 17:51:04 +00:00
  • d7a493b4f5 added experimental timeline api orbiter 2009-03-06 16:01:29 +00:00
  • efcd95dc37 simplification of (internal) query process / refactoring orbiter 2009-03-06 15:53:20 +00:00
  • f1b712c29a small corrections to image loading methods in result presentation especially loading of favicons in search results. This is a fix that affects only searches in intranet/repository configurations. orbiter 2009-03-06 15:39:02 +00:00
  • 98f36a801a - small update to search result layout - some more mime types orbiter 2009-03-06 10:16:14 +00:00
  • 4f6658b115 * non-sliding api icon * regex doc links update lotus 2009-03-05 20:41:30 +00:00
  • d4b56d5819 added more asserts to BLOBHeap.flushBuffer() to fix the problem described in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1679&hilit=&p=13109#p13109 orbiter 2009-03-03 23:24:19 +00:00
  • c545fcb9fa * add class to handle keys and signatures * fix bug in serverCharBuffer * add build-target to sign tar.gz (run ant dist sign) f1ori 2009-03-02 13:29:50 +00:00
  • aa44d9bad9 more refactoring of kelondro.text / deleted de.anomic.index orbiter 2009-03-02 11:04:13 +00:00
  • 6ffc6e3389 more refactoring of indexer and kelondro classes; - integrating the indexer into kelondro as package 'text' - renaming of classes in kelondro.index orbiter 2009-03-02 10:00:32 +00:00
  • 404bc21da9 simplification of (internal) query process / refactoring orbiter 2009-03-02 08:48:27 +00:00
  • 76ef5f0f14 refactoring of index package: better names for the classes (to be continued) orbiter 2009-03-01 23:58:14 +00:00
  • 2df57b1fd1 refactoring of index collection class orbiter 2009-03-01 23:07:45 +00:00
  • 39a177649b * added upnp listener for devices that do not respond to discovery but advertise themselves * moved package lotus 2009-02-28 14:36:23 +00:00
  • d1d9fbae5c enabling the URLAnalysis to operate on multime input files, just use a wild card when calling the class from the command line orbiter 2009-02-26 23:47:41 +00:00
  • c728879ab8 fixes to yacyURL - more exceptions in case that urls are strange orbiter 2009-02-26 22:33:47 +00:00
  • 7542336ae5 performance enhancement to yacyURL: omit second processing of resolveBackpath. This method is already applied during initialization of the object and was called a second time when the url was exportet. orbiter 2009-02-26 21:52:32 +00:00
  • 7ea53fe47b added another url list transformation option: - check the list and kick out entries with lines that contain not valid urls - normalize the urls - remove doubles - sort the list - split the list in smaller chunks This is all done in one process which can be called with a new -sort option orbiter 2009-02-26 21:51:23 +00:00
  • e521e81148 bugfix in yacyURL (for latest performance hack) orbiter 2009-02-26 07:46:47 +00:00
  • 54625360f7 performance update orbiter 2009-02-25 23:27:21 +00:00
  • d884c4718a added gzip support for URLAnalysis: url lists can also be compressed with gzip If such a file is handed over to URLAnalysis, the output will also be written as .gz-file orbiter 2009-02-25 13:40:51 +00:00