Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-09 00:16:11 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • cb1f49d0f2 replaced all 'new String' with default encoding (missing) or UTF-8 encoding with a String generation method that uses a pre-defined Charset constant for UTF-8. This avoids a cache-lookup for the Charset object using String hashing of the String 'UTF-8'. orbiter 2011-03-07 20:36:40 +00:00
  • 9d366ee9d7 *) removed unused code (I assume that most of the code was really dead, but if you need any of the classes, tell me and I will put it back in.) *) minor code cleanup in ViewLog low012 2011-03-07 18:55:11 +00:00
  • 7138f4036b less synchronization, better thread dump tool orbiter 2011-03-07 15:29:45 +00:00
  • 8d14916c74 more patches for a better out-of-memory management orbiter 2011-03-07 01:45:11 +00:00
  • c2c5b12882 - even less memory for circle tool - background thread for bookmark initialization: this uses a DNS lookup which may cause long waiting times during startup orbiter 2011-03-06 12:30:22 +00:00
  • 6badc5e558 reduce size of static memory usage: use short instead of int in circle coordinates cache orbiter 2011-03-06 11:23:04 +00:00
  • ce0c8247fc removed (most probably!?!) superfluos System.err output orbiter 2011-03-06 01:01:29 +00:00
  • 799c534935 one more patch again OOM during secondary remote search see also: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3202 orbiter 2011-03-05 19:52:34 +00:00
  • 77b1e921a9 this asserts prevents a network operation in case of sabotage and must be removed therefore orbiter 2011-03-04 14:34:37 +00:00
  • f8d0454c53 small bug fixes and experiments with search speed enhancement orbiter 2011-03-04 14:29:22 +00:00
  • bed79402be introduction of a new remote search load control: the remote search has taken 10 results per peer with a time-out of 3 seconds so far. The attributes of number of results per peer and time-out time can now be configured. This has two aspects: the user who searches may want to increase these values to get more results and more load on the remote side and the user of the server which is accessed for this search may want to restrict the load. Both sides can now be configured. The server-site maximum load parameters are defined by a network definition and the client-side search request load can be defined by each user individually but when the remote search is done the requested service is limited to the network definition. orbiter 2011-03-04 13:44:00 +00:00
  • 6dfaf6fef7 fix for bug in deletion of old seeds orbiter 2011-03-04 10:00:37 +00:00
  • ac13343f12 jre update lotus 2011-03-03 20:44:53 +00:00
  • fa5b911082 remove old libraries in case of update lotus 2011-03-03 18:34:32 +00:00
  • 993b9bc1a8 memory/performance hacks, less synchronization, better concurrency orbiter 2011-03-03 11:30:04 +00:00
  • 65bcc60808 stupid me: revert placement of closing connection which caused unclosed connections + reuse sockets sixcooler 2011-03-03 04:16:33 +00:00
  • e3d75d6cd5 Not storing external header in an Header-Array and reduce a loop for its conversion. Ensure connection close if a OOM is thrown. Ensure setting resolved host is set at the request. sixcooler 2011-03-01 13:50:11 +00:00
  • 42d90664f3 - fixed a memory leak in the httpc.post method (no finish) - patched some more memory-saving relevant code - some more minor bug fixes orbiter 2011-03-01 09:03:33 +00:00
  • 38dce547c0 better concurrency (less locking on date formatting) more logging and minor bug fixes orbiter 2011-02-28 06:28:29 +00:00
  • 85f5c02deb de.lng: Updated German translation and removed old unused strings, e.g. 8080 -> 8090 and Search Portal translations Bookmarks.html, Ranking_p.html, base.css: Fixed XHTML errors to make pages compatible again - switched div -> span inside dt and replaced css definition of id (unique) with class (class of elements) header.template: Fixed link to berliOS changelog by replacing & -> & and adding translation for German page by refering to German berliOS UI ;-] mikeworks 2011-02-28 00:22:05 +00:00
  • 59dea3a284 * implement url proxy, a proxy via the url http://peer:port/proxy.html?url=http://domain.tld/path * enable with proxyURL = true * could be useful to browse specific pages with proxy or use own improvements in proxy f1ori 2011-02-27 21:39:38 +00:00
  • ee7b1d90ac Merge branch 'augmentedProxy' of github.com:f1ori/yacy Florian Richter 2011-02-27 21:12:05 +01:00
  • 8b7b783c49 Tray.java: Broke the build on with wrong non UTF-8 encoded file and french umlauts (unmappable character for encoding UTF8) mikeworks 2011-02-27 15:01:46 +00:00
  • db65ada467 Tray.java: Added localization for french tray icon command - although this can probably also done better than with if statements. (preferably also from the locales file) mikeworks 2011-02-27 11:42:33 +00:00
  • 073ee5525f de.lng: Updated German translation added missing line no change when no other network was selected YaCy logos: removed outer white line that made the logo blitz on black or dark themes http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1724#p21655 mikeworks 2011-02-27 01:19:46 +00:00
  • 89d337841c more logging for OOMs orbiter 2011-02-26 09:27:15 +00:00
  • b1781d7aae some more performance hacks orbiter 2011-02-26 01:24:49 +00:00
  • b2f147d28e performance hack: excluded map encoding in many cases from synchronization block, especially when doing an iteration orbiter 2011-02-25 21:29:55 +00:00
  • 5e186e0122 continuing the fight against deadlocks during time formatting: better caching. orbiter 2011-02-25 21:11:53 +00:00
  • dec24244cf added convenience class to generate UTF StringBody objects with a default UTF8 charset. Reason: if this is not used in StringBody-Class initialization, a default charset name is parsed. This is a synchronized process and all classes using default charsets synchronize at that point Synchronization is omitted if this class is used orbiter 2011-02-25 13:26:09 +00:00
  • 1110d16af9 performance hack: replaced generic row.getColBytes() call with row.getPrimaryKeyBytes() where the column is 0 orbiter 2011-02-25 12:41:27 +00:00
  • 19b2a50578 - enhanced date formatter cache - added more instances of formatter objects to different classes to make them independent in case of lockings that may applay during synchronization of the date formatter object (date formatting is not thread-safe and must be synchronized therefore) orbiter 2011-02-25 12:23:00 +00:00
  • 48a61c39a3 speed hacks in BLOB ArrayStack: - more concurrency if possible - less threads if no concurrency necessary orbiter 2011-02-25 11:58:01 +00:00
  • a92d80a545 performance enhancements using an alternative to a insensitive collator (a complex string compare): - less synchronizations - better speed ..at most important and commonly used classes: http headers, url parsing and html parsing orbiter 2011-02-25 11:23:57 +00:00
  • 85d660a6e8 * augmented proxy Florian Richter 2011-02-11 16:49:46 +01:00
  • f2e8ffd768 enhancement in synchronisation orbiter 2011-02-25 01:19:39 +00:00
  • bcea497644 next try to fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3193&start=0&sid=b98aa9a7466397602b436eb45f4a9d39 sixcooler 2011-02-25 01:16:15 +00:00
  • ad7fcb9d61 Enhanced Base64Order transformation: less overhead (transformation between StringBuilder and byte[]) orbiter 2011-02-25 00:56:31 +00:00
  • f95e50ec3d more explanation orbiter 2011-02-25 00:06:31 +00:00
  • bb36bf841a emergency commit (sorry sixcooler for not waiting) because without that automatic updating peers would not be able to do the next update. Please see http://forum.yacy-websuche.de/viewtopic.php?p=22059#p22059 orbiter 2011-02-25 00:02:04 +00:00
  • 8ad4e10491 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3193&start=0&sid=b98aa9a7466397602b436eb45f4a9d39 sixcooler 2011-02-24 23:15:27 +00:00
  • 0ce17d823a - fixed bug in ordering - fixed ConcurrentModificationException in set join orbiter 2011-02-24 10:32:46 +00:00
  • dec4f36700 - fix for missing favicons in search widgets - fix for bad digest/hash computation in case of interrupts to class orbiter 2011-02-23 23:04:05 +00:00
  • 28c7615f24 fix missing translation lotus 2011-02-23 15:02:00 +00:00
  • 804ae2275b - do not delete idx and gap files if the heap is not modified this change may have bugs in it which may cause damage to your existing data. please use with care. orbiter 2011-02-23 11:28:12 +00:00
  • e3ef4e3021 - increased default peer ping time from 2 minutes to 1 minute - filtering out too old peers when reading seed lists (limit is now 240 minutes) - added concurrent host names resolving in front of the http client because the http client uses the java built-in DNS resolve which is not multithreading-safe (i have seen deadlocks in thread dumps showing that this bug in jdk is still there) orbiter 2011-02-23 09:42:01 +00:00
  • 5e45ded8e2 - removed locks from WordReference - refactoring of HeapReader/Writer orbiter 2011-02-23 00:32:16 +00:00
  • cd19d0517e added dns resolve to HTTPClient POST using a dns cache to prevent that that not-thread-safe built-in dns cache inside apache http client is used orbiter 2011-02-22 22:58:19 +00:00
  • d28f8040e0 removed unnecessary recording function that caused also a performance problem after serving too much files orbiter 2011-02-22 13:33:28 +00:00
  • af87af0d4c - removed synchronization in serverSwitch which should improve speed - fixed wrong assert in network graph - enhanced double check method in table class orbiter 2011-02-22 12:56:25 +00:00
  • 4bd65532da initialization of libraries concurrently (faster start-up) orbiter 2011-02-22 10:57:38 +00:00
  • 24909b3006 slightly less restrictive values for DoS orbiter 2011-02-21 15:24:09 +00:00
  • 311f57d360 DoS to prevent online snippet fetch: allow read from cache. orbiter 2011-02-21 15:11:03 +00:00
  • 83a38b16bb added link to svn log orbiter 2011-02-21 12:11:12 +00:00
  • 57e6728cb7 - removed usage of /etc/alternatives/www-browser because of problems with lynx, see: http://forum.yacy-websuche.de/viewtopic.php?p=21959#p21959 please look if the browser that is linked with /etc/alternatives/www-browser can be detected and insert call again if it can be made sure that this does not call lynx - replaced severe warnings with just warnings in yacyClient orbiter 2011-02-21 11:53:45 +00:00
  • 91eeaf2cff fix in ftp client orbiter 2011-02-21 10:51:15 +00:00
  • 09a98a6ae4 - disabled arrow keys in search (pages switch) again -- too disturbing when editing the query line - fixed alt text in AccessGrid orbiter 2011-02-21 10:30:58 +00:00
  • e717bf74ba more logging, more care about OOMs orbiter 2011-02-21 09:51:05 +00:00
  • d84b4a072e healing for some OOM problems orbiter 2011-02-21 00:38:49 +00:00
  • 4aa406fb0f added log output to find bug in url parser for short hosts orbiter 2011-02-21 00:07:00 +00:00
  • 82f262f685 - enhanced circle drawing speed - beautified 'moving dot' feature (using smaller and correctly positioned dots) - added moving dots to DHT transfer orbiter 2011-02-21 00:03:11 +00:00
  • 6e93a3eb2f Small correction suessthomas 2011-02-19 22:02:44 +00:00
  • 29dc416ac6 more animations in graphics. See network and access picture. orbiter 2011-02-19 01:56:12 +00:00
  • 93b9c4fbc9 added missing file for latest commit orbiter 2011-02-18 23:25:58 +00:00
  • a80ee9a03d THE GRID is coming to YaCy .. see new animated graphics on http://localhost:8090/AccessGrid_p.html showing incoming and outgoing connections in an animated way orbiter 2011-02-18 23:19:35 +00:00
  • 83ae46902b *) removed link to LogStatistics *) removed translation of LogStatistics low012 2011-02-18 02:11:19 +00:00
  • ce012e11aa *) deleted LogStatistics since the page did not work anymore and it seemed to be obsolete, tell me if you miss it and I will add it again *) a few minor changes low012 2011-02-18 01:46:07 +00:00
  • c5051c4020 *) fixed bug which caused entries to not be deleted when deleting by URL on IndexCreateWWWLocalQueue_p.html (I hope this did not break anything else) *) cleaned up code a little bit low012 2011-02-18 01:25:46 +00:00
  • d58071947a maybe terminateOldSessions is too slow, removed sleep orbiter 2011-02-17 23:36:46 +00:00
  • fb8b046bb4 removed unused properties orbiter 2011-02-17 22:47:39 +00:00
  • b0bdf2d9ed *) Oops! low012 2011-02-17 20:42:35 +00:00
  • de065e594f *) make sure that only positive values are accepted as refresh interval on Crawler Monitor page low012 2011-02-17 20:40:34 +00:00
  • c69a4874b4 fix for non-valid json, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3179 orbiter 2011-02-17 16:47:05 +00:00
  • addbd5b482 moved the main update url - because of the many languages we support now on yacy.net orbiter 2011-02-17 01:22:22 +00:00
  • 3e380c51b6 update to browser start with linux orbiter 2011-02-16 14:53:47 +00:00
  • 4473cf8c61 replaced utf-8 with UTF-8 orbiter 2011-02-16 13:51:30 +00:00
  • 6083f2f171 fix for (false) oom orbiter 2011-02-15 14:26:25 +00:00
  • d2eb2fe8d9 added patch from quix0r, see http://forum.yacy-websuche.de/viewtopic.php?p=21188#p21188 orbiter 2011-02-14 23:16:47 +00:00
  • abb35addb8 added accept-charset="UTF-8" to all forms this applies patches from http://forum.yacy-websuche.de/viewtopic.php?p=20891#p20891 orbiter 2011-02-14 22:57:43 +00:00
  • b35fda43ea more changes to headless mode; now non-headless mode is used when: - YaCy runs on Windows - YaCy is started with the -gui option in all other cases YaCy runs in headless mode orbiter 2011-02-14 22:17:59 +00:00
  • 6c52e31993 new methods to open a browser - if YaCy is started with the option -gui, it is not in headless mode. Then the java 1.6 browse method is used if all other methods fail - in linux, the path /etc/alternatives/www-browser is used if no firefox is installed orbiter 2011-02-14 16:15:14 +00:00
  • 5892fff51f introduction of dht-burst modes: this can expand the number of target peers in some cases where a better heuristic is needed. The problematic cases are either when a muti-word search is made (still a hard case for our term-oriented DHT) or when a network operator wants that all robinson peers are asked. We therefore introduced two new network steering values that switch on more peers during the peer selection. Because the number of peers can now be very large, the number of maximum httpc connections was also increased. Please see new coments in yacy.network.freeworld.unit for details of the new DHT selection methods. The number of maximum peers is now not fixed to a specific number but may increase with - the partition exponent - the number of redundant peers - the robinson burst percentage - the multiword burst percentage The maximum can then be the number of senior peers (all visible peers). orbiter 2011-02-13 17:37:28 +00:00
  • 4588b5a291 - fixed document number limitation for crawls that restrict the number of documents per domain - some restructuring of the document counting and logging structures was necessary - better abstraction of CrawlProfiles - added deletion of logs to the index deletion option (if the index is deleted using the servlets) which is necessary to reset the domain counters for the page limitation - more refactoring to get the LibraryProvider more clean - some refactoring of the Condenser class orbiter 2011-02-12 00:01:40 +00:00
  • 64f32e8f00 *) replaced all IPs in IP filters for proxy with the proper regular expression *) some cleanup low012 2011-02-11 23:37:13 +00:00
  • 9f6e3f9793 fix: same number format display before and after get/post lotus 2011-02-10 09:08:44 +00:00
  • 4716aa7d3a fix display of statistics link on network.html (caused by menu option) lotus 2011-02-09 21:32:45 +00:00
  • 3e8b72be50 update to httpclient-4.1 - sorry forgot some sixcooler 2011-02-08 21:53:20 +00:00
  • 45dcfa3460 update to httpclient-4.1 sixcooler 2011-02-08 21:46:24 +00:00
  • d38c739b31 * add ant-target deleteData, to simulate fresh yacy installation * useful in IDEs like eclipse f1ori 2011-02-08 09:12:48 +00:00
  • 74b22dfa24 *) fixed bug which affected blacklist entries which consisted of domain _and_ path parts *) minor cleanup low012 2011-02-06 18:07:08 +00:00
  • 4843f04247 *) more input from Moubai low012 2011-02-06 16:00:45 +00:00
  • b9990e722f *) updated French langugage file with input from Moubai (http://yacy-forum.org/viewtopic.php?p=1646) low012 2011-02-05 11:20:25 +00:00
  • 93732d6773 increased number of target peers orbiter 2011-02-04 13:25:28 +00:00
  • 70ca7cec8c fix for http://forum.yacy-websuche.de/viewtopic.php?p=21763#p21763 and another fix for non-working global search when search options are switched off orbiter 2011-02-03 10:43:09 +00:00
  • fe93caac5a added flags and administration options to show advanced search and to show search result attributes (for each search result) Administration can be done at ConfigPortal.html orbiter 2011-02-02 15:54:13 +00:00
  • 01cb3bbaec * fix patchCharsetEncoding-test (patchCharsetEncoding now returns null on input null) f1ori 2011-02-02 15:28:41 +00:00
  • 431f780f41 patch for bad data in url metadata orbiter 2011-02-02 01:19:25 +00:00
  • 0dfb1ef7d2 added custom targets for media search orbiter 2011-02-02 00:50:06 +00:00
  • 5905f912c5 replaced more double types with float orbiter 2011-02-02 00:22:00 +00:00
  • 0cdfb82963 replaced more appearance of double values by float values orbiter 2011-02-02 00:06:29 +00:00