Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-25 09:44:36 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • b8ee04daf1 fix for http://www.yacy-forum.org/viewtopic.php?f=2&t=160 (wrong url in form) f1ori 2008-08-26 18:45:19 +00:00
  • 434104e4a0 - change Crawl profile name for autoreCrawl apfelmaennchen 2008-08-26 18:08:48 +00:00
  • 9ff4fc11da partial fix (images,audio,video) for proxy and content-type problem http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1374 danielr 2008-08-26 16:34:24 +00:00
  • 0df2e47012 changed auto recrawl to comply with new date format lotus 2008-08-26 13:36:10 +00:00
  • d9d9c522a1 addendum to last commit moved recrawl times for standard profiles to constants calculate new specific dates in cleanup job lotus 2008-08-26 13:20:18 +00:00
  • 480497f7c9 changed recrawl use a specific date to define old documents this solves an unwanted recrawl-loop during a running crawl lotus 2008-08-25 20:31:32 +00:00
  • da1b0b2fc6 added two new classes that will be used for the new htcache orbiter 2008-08-25 18:22:23 +00:00
  • 536e77e8b7 modifications towards a single database operation to read/write http header and cached file at once: - removed distinction between header file types for http and ftp; ftp is simulated by using http properties - removed all old resourceInfo classes that handled this distinction - introduced a new distinction between http request and http response objects - unified new response objects with two other object types that had been introduced elsewhere - changed all servlet call methods to use the new http request header object type - divided static object keys for http header properties into request and response types - refactoring here and there (a large number of type changes and many methods merged/moved) orbiter 2008-08-25 18:11:47 +00:00
  • 04310a7255 * added long options and help-option to linux startscript * redirect all error messages to /dev/null f1ori 2008-08-25 17:17:01 +00:00
  • 08cdf6db8a fix for wrong "VegaYacyB" peers borg-0300 2008-08-24 11:30:00 +00:00
  • 296fa2265b YaCy-UI: removed unused Servlet ymarks.java apfelmaennchen 2008-08-24 08:47:37 +00:00
  • a9cf3b42c4 YaCy-UI: removed unused JavaScript apfelmaennchen 2008-08-24 08:43:07 +00:00
  • 08bf3fd235 YaCy-UI: updated to jQuery-ui 1.6b apfelmaennchen 2008-08-24 08:41:52 +00:00
  • 4d937f6b21 fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1396 danielr 2008-08-22 23:46:32 +00:00
  • 5192081283 workaround for BindException at restart on Vista therefore IPv6 support is lost (Windows only) see http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6286189 and http://forum.yacy-websuche.de/viewtopic.php?t=1385 lotus 2008-08-22 18:46:14 +00:00
  • 58d7e6f1a6 - some small, rather optical changes to bookmarks apfelmaennchen 2008-08-22 18:19:21 +00:00
  • bd931a82f7 - added dynamic filters to autoReCrawl.conf - Restrict to sub-path: sub - Restrict to start-domain: dom apfelmaennchen 2008-08-22 18:05:05 +00:00
  • 8551e1d106 - added Info link (/xml/util/getpageinfo_p.xml) to bookmarks apfelmaennchen 2008-08-21 21:28:57 +00:00
  • 8d1bedfc3a - added bookmarkTitle to CrawlStart_p.html apfelmaennchen 2008-08-21 21:07:21 +00:00
  • b3fc5e96a3 - removed unused import from bookmarksDB apfelmaennchen 2008-08-20 21:26:06 +00:00
  • bc048db7b6 - bugfix for bookmarksDB's rebuildDates() - dates are now saved as String.valueOf(TimeStamp) - it might be a good idea to delete (backup) bookmarkDates.db and restart YaCy to rebuild it apfelmaennchen 2008-08-20 21:25:05 +00:00
  • 3c68905540 remove redundant null checks danielr 2008-08-20 08:37:39 +00:00
  • f9a715dc33 simplified Linux start-script danielr 2008-08-20 07:57:47 +00:00
  • 753a1ae430 - changed default browser from netscape to firefox - fixed "Inefficient use of keySet iterator instead of entrySet iterator" [WMI_WRONG_MAP_ITERATOR, FindBugs] - fixed some possible null pointer accesses danielr 2008-08-20 07:54:56 +00:00
  • 7989335ed6 Preparations to replace the HTCache with a new storage data structure: - refactoring of the HTCache (separation of cache entry) - added new storage class for BLOBs. (not used yet, this is half-way to a new structure) orbiter 2008-08-19 14:10:40 +00:00
  • c05edba6b8 * added text/html-URL to opensearchdescription, so one-click-installation in firefox is possible f1ori 2008-08-17 21:13:41 +00:00
  • be28af50f5 - fixed "yacy2yacy no proxy"-problem danielr 2008-08-17 10:16:32 +00:00
  • 6450a51473 * fixed quoting problem in initscript f1ori 2008-08-14 21:38:05 +00:00
  • f99c307eff * correct debian build dependencies * add huge mem page detection in general initscript * disable logging completely in jmimemagic-library f1ori 2008-08-14 21:01:21 +00:00
  • bdae051d9a - extended new performance graph (better timing) - added paths for new libraries in classpath for eclipse - refactoring to remove compiler warnings (static access to finals variables) - removed some unused import orbiter 2008-08-13 10:37:53 +00:00
  • d9cea5ff23 removed annotations which broke the build with java 1.5 danielr 2008-08-13 09:07:23 +00:00
  • 7d8f332bbd * build yacy for debianpackage only once * do not try to sign .changes file * add some java arguments from ./startYACY.sh to addon/yacyInit.m4 f1ori 2008-08-11 20:26:18 +00:00
  • 2547700de8 relaxed dependencies for use with debian 4.0 etch danielr 2008-08-11 15:12:49 +00:00
  • c2d49cc01e * add build target "deb" to create debian packages from svn still needs testing... f1ori 2008-08-10 15:26:13 +00:00
  • 6a550c64f1 * clean up svn ignorelist, added yacy.pid and logfiles f1ori 2008-08-10 14:56:02 +00:00
  • 59c4e35aaf corrected LargePages-detection danielr 2008-08-10 13:03:36 +00:00
  • f825e88a09 *) large memory pages will only be used if start script can confirm that Linux supports them or that the OS is Solaris, this should eliminate all sorts of weird behavior including not working shutdown low012 2008-08-10 12:02:11 +00:00
  • a087090bbb fixed starting crawl results in "No parser available to parse mimetype 'application/octet-stream'" danielr 2008-08-10 11:31:40 +00:00
  • 7e7e6a099a undo 5044 danielr 2008-08-10 10:54:13 +00:00
  • f2d0bd7790 fix for NPE in JakartaHttpClient.setProxy danielr 2008-08-10 09:37:32 +00:00
  • bb6a6fc233 fixed 'FileUploadException Stream ended unexpectedly' danielr 2008-08-09 22:44:17 +00:00
  • 8422ee5ec4 - fixed UnsupportedEncoding (in proxy) using defaultCharset if no characterEncoding can be determined - serverFileUtils.copy* use now Charset instead of String - added some warnings for ignored exceptions danielr 2008-08-09 12:00:31 +00:00
  • 3ac1988059 Add some sanity checks for invalid seeds hermens 2008-08-08 13:56:29 +00:00
  • cff4393f0c Fix HTCache so oldest Files get deleted first hermens 2008-08-08 08:06:06 +00:00
  • 31d97f2b9f replaced httpd.parseMultipart() by a 'right' implementation danielr 2008-08-08 01:40:28 +00:00
  • 621b473b18 * removed some warnings of findbugs (http://findbugs.sf.net) - removed unnecessary code (unused variables, String.toString) - corrected some calculations (cast int to double or long ;) - improved little performance (using Integer.valueOf() instead of new Integer) - log if some File-actions fail (mkdir(), delete(), ...) and some ignored exceptions - finalized some (more) fields - finally close some streams - made inner classes static if not using environment - generalized some equals (from specificClass to Object) - fixed some potential nullpointer accesses danielr 2008-08-06 19:43:12 +00:00
  • 5627ca1c60 * rename yacy.nsi to build.nsi lotus 2008-08-06 19:32:55 +00:00
  • d72846f898 * moved nsisant library in seperate libbuild-directory to keep root directory clean f1ori 2008-08-06 17:02:56 +00:00
  • 3f871b57de - again an error in defaults/autoReCrawl.conf - you have to delte or edit DATA/SETTINGS/autoReCrawl.conf to fix this problem, sorry! apfelmaennchen 2008-08-05 18:57:25 +00:00
  • 0500b1179e added a 2 min start up delay to serverBusyThread autoReCrawl to avoid a Null Pointer Exception... apfelmaennchen 2008-08-05 05:50:15 +00:00
  • 3b6229d2f3 small fix - parseBoolean doesn't recognize 1 and 0 as true and false in autoReCrawl.conf apfelmaennchen 2008-08-04 21:57:57 +00:00
  • e1574fe02e - added autoReCrawl folders to bookmarks (DATA/SETTINGS/autoReCrawl.conf) - the serverBusyThread checks folders every 60 min. (==> autoReCrawl_idlesleep in yacy.conf) - added option to create bookmarks from CrawlStart URL apfelmaennchen 2008-08-04 20:43:36 +00:00
  • ebb40d324b enhanced memory chart: shows now also the size of the word cache as third vector. The PPM is now shown without a scale, but with a new anotation at the chart entry. orbiter 2008-08-04 10:47:26 +00:00
  • 17b7845eb5 * refactoring - moved constants from plasmaSwitchboard to own class (all 232 ;) - moved remoteProxy-Methods to httpRemoteProxyConfig, better names - removed some unnecessary code (else-statements) * formatting (correct indentation) * minor bugfixes (due to findbugs.sf.net) * hopefully fixed "missing quote" (announcing StringParts as UTF-8) danielr 2008-08-02 13:57:00 +00:00
  • 3bb870bfcd added final where possible danielr 2008-08-02 12:12:04 +00:00
  • 7e92484400 fix for open browser on windows 2000 lotus 2008-08-01 12:58:36 +00:00
  • b0724e5ec0 * add config option to disable cookie monitoring (disabled by default) f1ori 2008-07-30 21:19:06 +00:00
  • f0dfb858d8 reverted balloon messages from r5014. don't try to annoy the user. ;) lotus 2008-07-30 07:42:02 +00:00
  • cafa1a952f - performance settings refactoring: made headlines to fieldsets - show performance profiles more prominent for easier configuration lotus 2008-07-30 07:37:11 +00:00
  • 6952b13c08 * fix automatic decrementing accepted remote crawl limit: -> http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1355 f1ori 2008-07-29 18:52:48 +00:00
  • d02a26d642 * added lock icon to ConfigAppearance menu item f1ori 2008-07-28 21:09:19 +00:00
  • 0b2f67577e Index Transfer: - fix for chunk size calculation - fix: if chunk size was 1, an infinite selection loop ran because no entries were found. if chunk size fails <=3 it will be set back to 500 lotus 2008-07-27 18:53:51 +00:00
  • 0baa8d651e * marked some text as labels for checkboxes f1ori 2008-07-27 11:39:42 +00:00
  • 694084c570 fix for NPE on shutdown lotus 2008-07-27 06:59:56 +00:00
  • f9fb2d0fee hide memory tables by default lotus 2008-07-27 06:59:24 +00:00
  • 5f77f55ed7 possible fix for negative speed values lotus 2008-07-27 06:58:35 +00:00
  • 79dba5445d init-script: fixed some variables to general defaults danielr 2008-07-24 19:04:35 +00:00
  • 785688ef82 - creating pid-file under linux - added modified init-script (using startYACY.sh instead of doing the same thing) danielr 2008-07-24 18:56:29 +00:00
  • 50ef5c406f - refactoring of robots parser (removed opaque Objects[] result vector) - added Allow-component to robots result object orbiter 2008-07-24 11:54:37 +00:00
  • 7913bdb75b Flextable: filename in errormessage if inconsistent danielr 2008-07-24 08:22:36 +00:00
  • d42eae25f8 yacyTray: fix for unproper shutdown some messages lotus 2008-07-24 06:49:30 +00:00
  • 7cec908813 dont't show HTTPC debug messages danielr 2008-07-23 17:08:40 +00:00
  • 5f41913043 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1347&hilit=&p=9216#p9216 orbiter 2008-07-20 21:52:51 +00:00
  • c3d461d191 - removed superfluous copyright statement - updated my email address orbiter 2008-07-20 17:14:51 +00:00
  • 3ca98fee42 removed superfluous copyright statement orbiter 2008-07-20 00:21:07 +00:00
  • c049d80fbd fixed login problem with yacy as proxy (POST and Cookies) danielr 2008-07-19 15:10:00 +00:00
  • 62afea0c9f some improvements for yacyTray lotus 2008-07-18 14:17:52 +00:00
  • af616a92ff fixed welcome message above image on custom search page danielr 2008-07-18 13:41:06 +00:00
  • 7c110e07f0 removed debug danielr 2008-07-16 12:39:38 +00:00
  • 10d01fdd0d addendum to 5002 danielr 2008-07-16 09:47:48 +00:00
  • eadc204130 gzip POST wiederholbar gemacht (macht transferURL stabiler) danielr 2008-07-16 09:46:25 +00:00
  • d14e8d348f - times of LOCAL_SEARCH are shown in milliseconds (also in yacysearch.java ;) danielr 2008-07-15 17:35:02 +00:00
  • 28c39e2aa4 fix for new starter files lotus 2008-07-14 18:41:11 +00:00
  • b63a519456 fixed build problem danielr 2008-07-14 17:44:49 +00:00
  • e12438142e - warning instead of NPE if urlHash is not in index of CrawResults - times of LOCAL_SEARCH are shown in milliseconds danielr 2008-07-14 09:12:58 +00:00
  • 5784070f6e added user agent lulabad 2008-07-14 08:38:11 +00:00
  • 3e26aca356 added startYACY_debug.bat to dist Target lulabad 2008-07-13 20:32:28 +00:00
  • fa695c2d9f tray is now only shown on Windows and doesn't block on linux lotus 2008-07-13 19:03:38 +00:00
  • d77ed28e2f temporary disabled tray because of flaws on only-shell-linux lotus 2008-07-13 08:41:39 +00:00
  • adeb881288 fix for building Windows installer lotus 2008-07-13 08:17:20 +00:00
  • b704cf1fbc * no need to update the searchpage links anymore lotus 2008-07-13 07:55:20 +00:00
  • 0bb7c42bc8 rename of Windows start scripts * startYACY.bat -> startYACY_debug.bat * startYACY_noconsole.bat -> startYACY.bat lotus 2008-07-13 07:54:51 +00:00
  • f8a1e3175e new yacyTray this will make a YaCy icon in the tray area on supported platforms enabled by default the search page will open on double click lotus 2008-07-13 07:51:45 +00:00
  • 4a7e5f377e added translation for new customization pages daburna 2008-07-12 12:27:33 +00:00
  • 05c26d58d9 fixed missing remove operation in balancer orbiter 2008-07-11 12:03:18 +00:00
  • 606b323a2d fixed bug that appeared when a new crawl ist started orbiter 2008-07-11 10:59:06 +00:00
  • 38eb5bd1ee fixed a bug in kelondroBLOBHeap. The following files are probably inconsistent and should be deleted: DATA/HTCACHE/responseHeader.heap DATA/PLASMADB/crawlRobotsTxt.heap orbiter 2008-07-11 10:38:20 +00:00
  • 28d5703f8a - fixed a bug in Robots.txt loader which could have caused that robots.txt files had been loaded from the same domain more than once - patch in BLOBHeap to prevent OOM during startup orbiter 2008-07-11 09:12:54 +00:00
  • 7b1c9e6aee discovered and removed a (possibly large) memory leak: many classes used the kelondroMapDataMining (was: kelondroMapObjects) which adds statistical functions to the kelondroMap (was: kelondroObjects), but these functions were not used by these classes. Especially the HTCACHE and robots.txt database allocate a very large number of objects for statistical use, but never used them. By replacing the kelondroMapDataMining with the kelondroMap object for these classes now less memory is allocated. orbiter 2008-07-11 07:34:48 +00:00
  • 0f5fe8cc53 refactoring of method calling for objects from kelondroMapDataMining orbiter 2008-07-11 07:15:46 +00:00