Commit Graph

  • 4a237bfa5d Windows Installer: - add support for Windows Firewall on Win XP (SP2/SP3), Vista and Win 7 (open port 8090) - this should cover almost every Windows installation at home pca 2011-03-14 19:32:08 +00:00
  • 9199b9e3c6 also putting jcifs-1.3.15 into classpath (let me me build YaCy again :-) sixcooler 2011-03-13 22:44:50 +00:00
  • 9956dc9dce Update jcifs-library to Version 1.3.15. Small Changes, read: http://jcifs.samba.org/ - "Minor adjustments have been applied to DcerpcHandle locking routines in the SID class to fix sporadic occurances of "All pipe instances are busy" errors under high load." suessthomas 2011-03-13 20:09:52 +00:00
  • 8f11d3a5bb redesigned the ScoreMap classes: - new concurrent score map using atom operation from java concurrency classes - redesigned difference beween StaticScore and Dynamic Score into ScoreMap and ReversibleScoreMap allowed that many classes can now use simple ScoreMap Objects which can be used better in concurrent environments using the ConcurrentScoreMap - switched from DynamicScore to ConcurrentScoreMap usage wherever possible orbiter 2011-03-13 01:41:44 +00:00
  • a564230c48 more enhancements against blocked threads occurred in seed age evaluation (blocks httpd in some cases) orbiter 2011-03-12 22:54:41 +00:00
  • 2d2df64870 * jetty works for many pages now Florian Richter 2011-03-11 13:15:56 +01:00
  • dc0db3550e avoid string conversion orbiter 2011-03-11 00:59:27 +00:00
  • 694fa3a2a5 - replaced more direct string-based UTF-8 conversions by predefined UTF-8 conversion - changed menu structure slightly orbiter 2011-03-10 23:25:07 +00:00
  • bbb7aea8f3 fix basic config change in portal mode lotus 2011-03-10 20:04:15 +00:00
  • df68bf6001 Windows Installer: - check Windows-Version on startup, support only Windows 2000 and newer (necessary for Sun-JRE and as preparation for firewall section) - little changes in JRE section handling pca 2011-03-10 19:30:05 +00:00
  • 30aed9824a moved getBytes() to UTF8.getBytes() to use a default String encoding orbiter 2011-03-10 12:35:32 +00:00
  • cb6d307bba adding extension for parser lotus 2011-03-09 20:36:01 +00:00
  • 61a64bdbef Windows Installer: - detect JRE at startup, showing install-option depends on result - hide window for external call "attrib" - some cleanup and restructure for readability pca 2011-03-09 20:19:34 +00:00
  • 4d733608fb fix for broken JSON, see: http://forum.yacy-websuche.de/viewtopic.php?p=22162#p22162 orbiter 2011-03-09 20:08:20 +00:00
  • 1214615185 fix for 'invisible entry', see http://forum.yacy-websuche.de/viewtopic.php?p=22133#p22133 orbiter 2011-03-09 17:04:34 +00:00
  • 3820525464 more memory protection: auto-flush of caches in case of memory shortage orbiter 2011-03-09 16:32:34 +00:00
  • 7962d35425 - removed file upload function in crawl start and replaced it with an input field for a file path where the crawl start file is loaded. This was necessary to support the API steering for file crawl starts, for two reasons: 1) if the file is changed for a re-crawl this is not reflected in the steering because it would take the previously uploaded crawl start file 2) browsers do not submit the full path of the selected file even if this path is shown in the input field because of security reasons. There is no work-around or hack to make the submission of the full path possible orbiter 2011-03-09 12:50:39 +00:00
  • 1989ba64c0 * jetty Florian Richter 2011-01-17 12:06:17 +01:00
  • adbdabb5e7 Merge branch 'master' of github.com:f1ori/yacy Florian Richter 2011-03-09 12:17:45 +01:00
  • 96bb33ed9b added default size to StringBuffer in logger (and it is not possible to replace the StringBuffer with a StringBuilder...) orbiter 2011-03-09 09:53:57 +00:00
  • e1b6916423 always try to guess the size of a StringBuilder to prevent too many memory re-allocations orbiter 2011-03-09 09:29:05 +00:00
  • bea8137997 *) minor changes *) fixed potential NPE in suggest.java low012 2011-03-08 23:27:41 +00:00
  • 3e03963b1c *) minor changes low012 2011-03-08 22:37:17 +00:00
  • 8b94e33a33 Cleanup for last commit (forget some unnecessary parts) pca 2011-03-08 19:11:49 +00:00
  • b49f8894e1 Add check for hard drive and free space to Windows-Installer pca 2011-03-08 19:07:22 +00:00
  • 31a8ebe02a Merge branch 'master' of github.com:f1ori/yacy Florian Richter 2011-03-08 15:21:20 +01:00
  • 3b40b98256 *) set SVN properties *) minor changes low012 2011-03-08 01:51:51 +00:00
  • 2af8e33773 better performance computing search targets with index abstracts orbiter 2011-03-07 23:32:01 +00:00
  • 619b561a4a enhanced secondary search: index abstracts decompression is now much faster and does not cause strong CPU load after several searches with more than one word orbiter 2011-03-07 23:12:39 +00:00
  • bf27a72d53 *) set SVN properties low012 2011-03-07 23:05:23 +00:00
  • b649ce2dd7 *) minor changes low012 2011-03-07 22:59:19 +00:00
  • 0da3b6489e *) added the only changes from r7557 which actualy made sense *) caught potential exception (occured when user entered a string which did not contain digits only for the maximum number of lines) *) use prop.putHTML to avoid potential XSS attack in case an attacker manages to cause something to end up in the logs which contains a string which was defined by the attacker low012 2011-03-07 21:44:58 +00:00
  • 27ecdb5444 use less peers for remote search orbiter 2011-03-07 21:24:46 +00:00
  • 29acd2f108 reverted also changes in ViewLog from SVN 7557 because the ThreadDump submenu was not visible any more. orbiter 2011-03-07 21:19:47 +00:00
  • 70a996a06c reverted SVN 7557 because these classes are called using reflection. The class declaration is in the log configuration. Without these classes you get errors during runtime and a non-formatted log output, i.e.: orbiter 2011-03-07 20:42:19 +00:00
  • cb1f49d0f2 replaced all 'new String' with default encoding (missing) or UTF-8 encoding with a String generation method that uses a pre-defined Charset constant for UTF-8. This avoids a cache-lookup for the Charset object using String hashing of the String 'UTF-8'. orbiter 2011-03-07 20:36:40 +00:00
  • 9d366ee9d7 *) removed unused code (I assume that most of the code was really dead, but if you need any of the classes, tell me and I will put it back in.) *) minor code cleanup in ViewLog low012 2011-03-07 18:55:11 +00:00
  • 7138f4036b less synchronization, better thread dump tool orbiter 2011-03-07 15:29:45 +00:00
  • 8d14916c74 more patches for a better out-of-memory management orbiter 2011-03-07 01:45:11 +00:00
  • c2c5b12882 - even less memory for circle tool - background thread for bookmark initialization: this uses a DNS lookup which may cause long waiting times during startup orbiter 2011-03-06 12:30:22 +00:00
  • 6badc5e558 reduce size of static memory usage: use short instead of int in circle coordinates cache orbiter 2011-03-06 11:23:04 +00:00
  • ce0c8247fc removed (most probably!?!) superfluos System.err output orbiter 2011-03-06 01:01:29 +00:00
  • 799c534935 one more patch again OOM during secondary remote search see also: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3202 orbiter 2011-03-05 19:52:34 +00:00
  • 77b1e921a9 this asserts prevents a network operation in case of sabotage and must be removed therefore orbiter 2011-03-04 14:34:37 +00:00
  • f8d0454c53 small bug fixes and experiments with search speed enhancement orbiter 2011-03-04 14:29:22 +00:00
  • bed79402be introduction of a new remote search load control: the remote search has taken 10 results per peer with a time-out of 3 seconds so far. The attributes of number of results per peer and time-out time can now be configured. This has two aspects: the user who searches may want to increase these values to get more results and more load on the remote side and the user of the server which is accessed for this search may want to restrict the load. Both sides can now be configured. The server-site maximum load parameters are defined by a network definition and the client-side search request load can be defined by each user individually but when the remote search is done the requested service is limited to the network definition. orbiter 2011-03-04 13:44:00 +00:00
  • 6dfaf6fef7 fix for bug in deletion of old seeds orbiter 2011-03-04 10:00:37 +00:00
  • ac13343f12 jre update lotus 2011-03-03 20:44:53 +00:00
  • fa5b911082 remove old libraries in case of update lotus 2011-03-03 18:34:32 +00:00
  • 993b9bc1a8 memory/performance hacks, less synchronization, better concurrency orbiter 2011-03-03 11:30:04 +00:00
  • 65bcc60808 stupid me: revert placement of closing connection which caused unclosed connections + reuse sockets sixcooler 2011-03-03 04:16:33 +00:00
  • e3d75d6cd5 Not storing external header in an Header-Array and reduce a loop for its conversion. Ensure connection close if a OOM is thrown. Ensure setting resolved host is set at the request. sixcooler 2011-03-01 13:50:11 +00:00
  • 42d90664f3 - fixed a memory leak in the httpc.post method (no finish) - patched some more memory-saving relevant code - some more minor bug fixes orbiter 2011-03-01 09:03:33 +00:00
  • 38dce547c0 better concurrency (less locking on date formatting) more logging and minor bug fixes orbiter 2011-02-28 06:28:29 +00:00
  • 85f5c02deb de.lng: Updated German translation and removed old unused strings, e.g. 8080 -> 8090 and Search Portal translations Bookmarks.html, Ranking_p.html, base.css: Fixed XHTML errors to make pages compatible again - switched div -> span inside dt and replaced css definition of id (unique) with class (class of elements) header.template: Fixed link to berliOS changelog by replacing & -> & and adding translation for German page by refering to German berliOS UI ;-] mikeworks 2011-02-28 00:22:05 +00:00
  • 59dea3a284 * implement url proxy, a proxy via the url http://peer:port/proxy.html?url=http://domain.tld/path * enable with proxyURL = true * could be useful to browse specific pages with proxy or use own improvements in proxy f1ori 2011-02-27 21:39:38 +00:00
  • ee7b1d90ac Merge branch 'augmentedProxy' of github.com:f1ori/yacy Florian Richter 2011-02-27 21:12:05 +01:00
  • 8b7b783c49 Tray.java: Broke the build on with wrong non UTF-8 encoded file and french umlauts (unmappable character for encoding UTF8) mikeworks 2011-02-27 15:01:46 +00:00
  • db65ada467 Tray.java: Added localization for french tray icon command - although this can probably also done better than with if statements. (preferably also from the locales file) mikeworks 2011-02-27 11:42:33 +00:00
  • 073ee5525f de.lng: Updated German translation added missing line no change when no other network was selected YaCy logos: removed outer white line that made the logo blitz on black or dark themes http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1724#p21655 mikeworks 2011-02-27 01:19:46 +00:00
  • 89d337841c more logging for OOMs orbiter 2011-02-26 09:27:15 +00:00
  • b1781d7aae some more performance hacks orbiter 2011-02-26 01:24:49 +00:00
  • b2f147d28e performance hack: excluded map encoding in many cases from synchronization block, especially when doing an iteration orbiter 2011-02-25 21:29:55 +00:00
  • 5e186e0122 continuing the fight against deadlocks during time formatting: better caching. orbiter 2011-02-25 21:11:53 +00:00
  • dec24244cf added convenience class to generate UTF StringBody objects with a default UTF8 charset. Reason: if this is not used in StringBody-Class initialization, a default charset name is parsed. This is a synchronized process and all classes using default charsets synchronize at that point Synchronization is omitted if this class is used orbiter 2011-02-25 13:26:09 +00:00
  • 1110d16af9 performance hack: replaced generic row.getColBytes() call with row.getPrimaryKeyBytes() where the column is 0 orbiter 2011-02-25 12:41:27 +00:00
  • 19b2a50578 - enhanced date formatter cache - added more instances of formatter objects to different classes to make them independent in case of lockings that may applay during synchronization of the date formatter object (date formatting is not thread-safe and must be synchronized therefore) orbiter 2011-02-25 12:23:00 +00:00
  • 48a61c39a3 speed hacks in BLOB ArrayStack: - more concurrency if possible - less threads if no concurrency necessary orbiter 2011-02-25 11:58:01 +00:00
  • a92d80a545 performance enhancements using an alternative to a insensitive collator (a complex string compare): - less synchronizations - better speed ..at most important and commonly used classes: http headers, url parsing and html parsing orbiter 2011-02-25 11:23:57 +00:00
  • 85d660a6e8 * augmented proxy Florian Richter 2011-02-11 16:49:46 +01:00
  • f2e8ffd768 enhancement in synchronisation orbiter 2011-02-25 01:19:39 +00:00
  • bcea497644 next try to fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3193&start=0&sid=b98aa9a7466397602b436eb45f4a9d39 sixcooler 2011-02-25 01:16:15 +00:00
  • ad7fcb9d61 Enhanced Base64Order transformation: less overhead (transformation between StringBuilder and byte[]) orbiter 2011-02-25 00:56:31 +00:00
  • f95e50ec3d more explanation orbiter 2011-02-25 00:06:31 +00:00
  • bb36bf841a emergency commit (sorry sixcooler for not waiting) because without that automatic updating peers would not be able to do the next update. Please see http://forum.yacy-websuche.de/viewtopic.php?p=22059#p22059 orbiter 2011-02-25 00:02:04 +00:00
  • 8ad4e10491 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3193&start=0&sid=b98aa9a7466397602b436eb45f4a9d39 sixcooler 2011-02-24 23:15:27 +00:00
  • 0ce17d823a - fixed bug in ordering - fixed ConcurrentModificationException in set join orbiter 2011-02-24 10:32:46 +00:00
  • dec4f36700 - fix for missing favicons in search widgets - fix for bad digest/hash computation in case of interrupts to class orbiter 2011-02-23 23:04:05 +00:00
  • 28c7615f24 fix missing translation lotus 2011-02-23 15:02:00 +00:00
  • 804ae2275b - do not delete idx and gap files if the heap is not modified this change may have bugs in it which may cause damage to your existing data. please use with care. orbiter 2011-02-23 11:28:12 +00:00
  • e3ef4e3021 - increased default peer ping time from 2 minutes to 1 minute - filtering out too old peers when reading seed lists (limit is now 240 minutes) - added concurrent host names resolving in front of the http client because the http client uses the java built-in DNS resolve which is not multithreading-safe (i have seen deadlocks in thread dumps showing that this bug in jdk is still there) orbiter 2011-02-23 09:42:01 +00:00
  • 5e45ded8e2 - removed locks from WordReference - refactoring of HeapReader/Writer orbiter 2011-02-23 00:32:16 +00:00
  • cd19d0517e added dns resolve to HTTPClient POST using a dns cache to prevent that that not-thread-safe built-in dns cache inside apache http client is used orbiter 2011-02-22 22:58:19 +00:00
  • d28f8040e0 removed unnecessary recording function that caused also a performance problem after serving too much files orbiter 2011-02-22 13:33:28 +00:00
  • af87af0d4c - removed synchronization in serverSwitch which should improve speed - fixed wrong assert in network graph - enhanced double check method in table class orbiter 2011-02-22 12:56:25 +00:00
  • 4bd65532da initialization of libraries concurrently (faster start-up) orbiter 2011-02-22 10:57:38 +00:00
  • 24909b3006 slightly less restrictive values for DoS orbiter 2011-02-21 15:24:09 +00:00
  • 311f57d360 DoS to prevent online snippet fetch: allow read from cache. orbiter 2011-02-21 15:11:03 +00:00
  • 83a38b16bb added link to svn log orbiter 2011-02-21 12:11:12 +00:00
  • 57e6728cb7 - removed usage of /etc/alternatives/www-browser because of problems with lynx, see: http://forum.yacy-websuche.de/viewtopic.php?p=21959#p21959 please look if the browser that is linked with /etc/alternatives/www-browser can be detected and insert call again if it can be made sure that this does not call lynx - replaced severe warnings with just warnings in yacyClient orbiter 2011-02-21 11:53:45 +00:00
  • 91eeaf2cff fix in ftp client orbiter 2011-02-21 10:51:15 +00:00
  • 09a98a6ae4 - disabled arrow keys in search (pages switch) again -- too disturbing when editing the query line - fixed alt text in AccessGrid orbiter 2011-02-21 10:30:58 +00:00
  • e717bf74ba more logging, more care about OOMs orbiter 2011-02-21 09:51:05 +00:00
  • d84b4a072e healing for some OOM problems orbiter 2011-02-21 00:38:49 +00:00
  • 4aa406fb0f added log output to find bug in url parser for short hosts orbiter 2011-02-21 00:07:00 +00:00
  • 82f262f685 - enhanced circle drawing speed - beautified 'moving dot' feature (using smaller and correctly positioned dots) - added moving dots to DHT transfer orbiter 2011-02-21 00:03:11 +00:00
  • 6e93a3eb2f Small correction suessthomas 2011-02-19 22:02:44 +00:00
  • 29dc416ac6 more animations in graphics. See network and access picture. orbiter 2011-02-19 01:56:12 +00:00
  • 93b9c4fbc9 added missing file for latest commit orbiter 2011-02-18 23:25:58 +00:00
  • a80ee9a03d THE GRID is coming to YaCy .. see new animated graphics on http://localhost:8090/AccessGrid_p.html showing incoming and outgoing connections in an animated way orbiter 2011-02-18 23:19:35 +00:00