Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-09 00:16:11 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 661867923a ... migrating to HttpComponents-Client-4.x ... The Client is dead, long live the Client! (no references to the old client) sixcooler 2010-08-22 17:38:27 +00:00
  • 6e4d2f0800 fix for the network image sync bug orbiter 2010-08-21 10:59:21 +00:00
  • 7aa860c505 - more logging - more stability for database heap in case of buffer failure orbiter 2010-08-21 10:16:05 +00:00
  • 4d5446d641 code cleanup orbiter 2010-08-21 00:08:36 +00:00
  • 6b06e94c8c make searched word(s) in search-results viewable at dark themes sixcooler 2010-08-20 23:54:46 +00:00
  • 66ac3a7d9d corrected database row iteration orbiter 2010-08-20 23:33:56 +00:00
  • dfd416e3fb removed a mysterious image buffer orbiter 2010-08-20 23:13:59 +00:00
  • e10cd115a9 - added a new RSS reader interface. This is not finished but you can now load and look at RSS feeds. It will be used to index RSS feeds in a way that is appropriate for such kind of data. - refactoring of Mediawiki and PHPBB3 loader interface names (just renamed) - removed two old not used RSS loader interfaces - fixed a bug in RSS parser library of cora - added a new RSS parser component to the set of yacy document parsers orbiter 2010-08-20 11:30:02 +00:00
  • 933dc1a600 removed old rss parser (will be replaced with parser from cora package) orbiter 2010-08-20 07:42:38 +00:00
  • 70dd26ec95 added the new crawl scheduling function to the crawl start menu: - the scheduler extends the option for re-crawl timing. Many people misunderstood the re-crawl timing feature because that was just a criteria for the url double-check and not a scheduler. Now the scheduler setting is combined with the re-crawl setting and people will have the choice between no re-crawl, re-crawl as was possible so far and a scheduled re-crawl. The 'classic' re-crawl time is set automatically when the scheduling function is selected - removed the bookmark-based scheduler. This scheduler was not able to transport all attributes of a crawl start and did therefore not support special crawling starts i.e. for forums and wikis - since the old scheduler was not aber to crawl special forums and wikis, the must-not-match filter was statically fixed to all bad pages for these special use cases. Since the new scheduler can handle these filters, it is possible to remove the default settings for the filters - removed the busy thread that was used to trigger the bookmark-based scheduler - removed the crontab for the bookmark-based scheduler orbiter 2010-08-19 23:52:38 +00:00
  • 5a994c9796 added a scheduler based on API actions - every process that is monitored with the API Steering interface can now be scheduled! - added input methods in Steering interface to set a scheduling time - added a view on the steering api that shows only crawl jobs inside the Crawl Profile servlet - added a scheduling call process in the cleanup process handler that triggers the scheduled processes This causes that the cleanup now also looks for scheduled processes. Such processes are therefore not executed at the same time as given in the target execution time but they will be executed within the cleanup process time window. orbiter 2010-08-19 12:13:54 +00:00
  • 189a986ebd - modified api-call interface to record api calls with references to api-call database (carries pk) - added recording date, last execution date and next execution date for a scheduler (scheduler to be implemented next) - extended database access methods for more data formats, especially for date insert/retrieval - extended 'Steering' interface to show new database fields - migrated Steering to new http client - extended cora http client to transmit authentication and also added some convenience methods (http response code) - simplified database back-end (not so much specialized methods for multiple properties) - extended date formatter to produce a special format to show dates in html (  in spaces of date format) orbiter 2010-08-18 15:56:38 +00:00
  • 1bc08e1416 support debconf in debian package * now you are ask some questions to preconfigure yacy after installing the debian package f1ori 2010-08-18 13:30:57 +00:00
  • 054c22e2c6 added TLDs from http://www.opennicproject.org orbiter 2010-08-18 10:39:49 +00:00
  • f616cdfce4 better resistance of NetworkImage generation against heavy load this is needed for the network image on the yacy.net home page orbiter 2010-08-18 09:51:00 +00:00
  • 2f8ff8ec02 de.lng: Added some German translation for Config* pages that I have found untranslated ConfigNetwork_p.html: Updated Javascript for P2P <-> Robinson selection to use the new ID values - sorry for breaking this in 6996 (undoing id -> name changes again in 7041 and 7042 because the name tag is not allowed in XHMTL Strict 1.0) mikeworks 2010-08-18 05:55:11 +00:00
  • 86d7f8a989 - the web visualization can now be generated in custom color - added input fields in WatchWebStructure_p.html - introduced enum classes for Draw Mode and Filter Mode orbiter 2010-08-17 10:44:00 +00:00
  • 64d4204f44 fix for NPE in network image computation orbiter 2010-08-17 08:18:17 +00:00
  • 7fdb17bb96 redirect uncaught exceptions to logging + small other changes orbiter 2010-08-16 12:33:06 +00:00
  • 237cfc44b0 fixed auto-set values for robinson selection; this reverts a single line from SVN 6996 orbiter 2010-08-15 18:23:47 +00:00
  • 85501414e9 Amending and supplementing de. Translation of the network.html suessthomas 2010-08-14 20:11:23 +00:00
  • 239fec1c42 Small Changes suessthomas 2010-08-13 20:49:22 +00:00
  • 59c035c40b changed explanation of Xmx and Xms orbiter 2010-08-13 20:03:10 +00:00
  • 92df768c39 * fix http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2929&hilit= * strings for navigation links have to be urlencoded f1ori 2010-08-13 15:59:52 +00:00
  • eb97bed1df patch for http://forum.yacy-websuche.de/viewtopic.php?p=20576#p20576 orbiter 2010-08-13 13:06:06 +00:00
  • 87b1684211 additional double-check in balancer orbiter 2010-08-12 17:18:15 +00:00
  • 653e617a1f * fix debian package dependencies for recent ubuntu and debian testing f1ori 2010-08-12 15:05:10 +00:00
  • 0d81731e88 fixed crawler bug caused by NPE in logging orbiter 2010-08-12 01:29:56 +00:00
  • a82a93f2fc - better url double check in crawler - more logging for error urls orbiter 2010-08-11 09:54:18 +00:00
  • a6ed6e8cb9 ... migrating to HttpComponents-Client-4.x ... make the occurrence of multiple header-keys possible sixcooler 2010-08-10 21:22:30 +00:00
  • 171f2bd84e - removed unused network oanet - added new network definition 'allip' which can be used in networks where intranet and internet-addresses shall be indexed - added a auto-switch-off for global search if there are no global peers orbiter 2010-08-09 23:41:17 +00:00
  • 1802c54317 LGPL-Header sixcooler 2010-08-09 14:38:49 +00:00
  • a835a22b32 fixed isLocal() property (better recognition of intranet hosts) orbiter 2010-08-09 11:22:56 +00:00
  • b480b7a4d0 fix for bug in last commit orbiter 2010-08-09 00:13:32 +00:00
  • b12bfe1f91 better usage of OSM tile cache and YaCy cache by usage of better tile server computation based on a coordinate hash orbiter 2010-08-08 23:51:37 +00:00
  • 388aa021c2 - concurrent loading of OSM tiles - added a 4-time re-try in case that tile server does not respond orbiter 2010-08-08 23:14:08 +00:00
  • 670c746dc5 dual-licensed HttpConnectionInfo for LGPL original GPL license holder granted dual-licensing by email orbiter 2010-08-07 23:03:10 +00:00
  • 838e8a1cb7 added a Macintosh OSX application wrapper. You can now create a YaCy Mac application like this: - build a new version of YaCy - take everything that is in the yacy home directory (from the fresh build) and move it into a copy of the YaCy.app directory under YaCy.app/Contents/Resources/Java/ - ready: double-click the YaCy.app icon and the new YaCy gui starts, then the browsers is also opened. - if the Mac application is terminated, also the YaCy demon should be stopped automatically and vice versa. This is currently not really good working and needs some more care. A build script for this is missing. Does anyone know how to do that in ant? orbiter 2010-08-05 11:11:15 +00:00
  • 301a59e07f moved browser access method from kelondro/util/OS to gui/framework/Browser orbiter 2010-08-05 10:49:58 +00:00
  • ec72387165 added a very early test version of a YaCy gui component. The gui currently does nothing else than providing a search window that sends the search string to the browser The gui is started when YaCy is started with the option -g or --gui, like ./startYACY.sh -g The gui will primary be used to provide a 'real' macintosh version that can be started and operated like any other macintosh application. A special mac application wrapper will follow. orbiter 2010-08-05 10:43:03 +00:00
  • d88b9606d1 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2923 + some client fine tune sixcooler 2010-08-04 16:58:33 +00:00
  • 6388a58fc7 better memory management and slightly less (in total and temporary) RAM allocation: - confirm that database objects that are not supposed to grow do not have a index memory management that is designed for growth - changed index sorting method in such a way that it allocates less objects during quicksort - database classes classes renaming (shorter, naming addresses that objects hold in RAM) - added a large number of asserts to check if objects actually take the RAM that they should have orbiter 2010-08-04 13:33:12 +00:00
  • 5924a0d851 - enhanced concurrency in database index access for multicore - added statistics about database index caches in PerformanceMemory_p.html - adoped many classes to use the new statistics - added missing close statements orbiter 2010-08-03 04:58:48 +00:00
  • 55a2536bcf enhancement in drawing speed and reduction of object allocation during drawing orbiter 2010-08-03 02:44:08 +00:00
  • 610855e362 do not use network graph cache if called from authorized account orbiter 2010-08-03 02:43:15 +00:00
  • 9ab06bc333 enhancement in sorting efficiency (database root operation): less object allocation orbiter 2010-08-03 02:42:28 +00:00
  • 39d96abbb5 fix yacyRelease download (http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2920&p=20545#p20545) better cookie policy sixcooler 2010-08-02 20:13:20 +00:00
  • 1bfa21f973 *) HTML fix low012 2010-08-02 17:31:05 +00:00
  • 349e4dee9d ... migrating to HttpComponents-Client-4.x ... added cookie policy sixcooler 2010-08-02 14:16:44 +00:00
  • c29f24a519 ... migrating to HttpComponents-Client-4.x ... - Proxy - Release-download sixcooler 2010-08-01 22:35:11 +00:00
  • ced07970c1 *) fix for last commit *) HTML fixes low012 2010-08-01 19:04:57 +00:00
  • 4e60c69f84 *) HTML fixes low012 2010-07-28 15:54:44 +00:00
  • 66266a288e better network image cache orbiter 2010-07-28 14:54:56 +00:00
  • e7ea3b3cc5 added a buffer for network images to reduced load on yacy.net network image server orbiter 2010-07-28 12:45:53 +00:00
  • d5c65b17a6 added another network activity visualization: show strong query activity as radiation around peer orbiter 2010-07-28 11:40:58 +00:00
  • 989948e1a9 fixed generic image parser orbiter 2010-07-27 07:13:15 +00:00
  • e1015ead2c static access to constants orbiter 2010-07-27 06:52:58 +00:00
  • 27d8a8b53e removed wrong com.sun.codec class access in generic image parser orbiter 2010-07-27 06:49:09 +00:00
  • bbf887d879 added generics to UPnP classes orbiter 2010-07-27 06:48:01 +00:00
  • 15e8c13526 ... migrating to HttpComponents-Client-4.x ... (gzip decompression, httploader, robots, ...) sixcooler 2010-07-27 01:16:26 +00:00
  • a55af783bf healing for color blindness orbiter 2010-07-26 22:54:06 +00:00
  • 710e7bb700 de.lng: Added German translation for http://localhost:8080/Ranking_p.html without the actual values (hardcoded in HashMap in Ranking_p.java) mikeworks 2010-07-26 20:57:54 +00:00
  • 6b13101d18 Collage.html: Fixed problem where the German translation broke the action that contained Collage in a form build.xml: Fixed check for existing private.key, added check for non existing release in target sign and changed the include filenames for changed libs Added log4j.properties file to eliminate the warning about a not initialized log4j subsystem with parameters for one console appender mikeworks 2010-07-26 20:18:19 +00:00
  • 63c5634b0f added online documentation for ranking configuration orbiter 2010-07-26 10:08:21 +00:00
  • aa663cda4d ConfigUpdate_p.html and ConfigUpdate_p.java: Added check for downloaded releases and disabled buttons in case no new releases available de.lng: Updated German translation for additional String in ConfigUpdate_p.html XHTML 1.0 Strict fixes for all the other .html files yacy/ui/css/yacyui-portalsearch.css: added .hidden class that was removed from ConfigProperties_p.html Switchboard.java: Added URL for thread Remote Crawl Job and set URL for Remote Crawl URL Loader to null to fix empty href="" mikeworks 2010-07-25 13:19:16 +00:00
  • afd1cd7979 *) HTML fixes low012 2010-07-24 15:42:09 +00:00
  • 0f248e7433 ConfigBasic.html: XHTML 1.0 Strict fixes DictionaryLoader_p.html: Filled <dt> elements to eliminate warnings Moved CSS for portalsearch field from header to metas template because it belongs in the <head>er yacui-portalsearch.css Added #yacylivesearch form { display: inline; } because HTML 1.0 Strict does not allow <form><input> and the added <p> would otherwise provoke a line break de.lng: Updates translations for added <dt> elements and deactivated statement in DictionaryLoader_p.html mikeworks 2010-07-24 15:26:53 +00:00
  • b12db14b9f Added Generics to new net.yacy.upnp.* classes to eliminate compiler warnings Added @Deprecated for deprecated functions getIPDevices and getPPPDevices in class InternetGatewayDevice Changed debug statement in Domains.java and corrected filename in comments header mikeworks 2010-07-24 13:48:45 +00:00
  • 0b89fa2c8d *) HTML fixes low012 2010-07-24 12:28:48 +00:00
  • ad96a14d0a *) jump to Crawl Profile editor if a profile is selected to be edited low012 2010-07-23 17:35:09 +00:00
  • e4ced6484b yacyinteractive.html: - added type="text/javascript" to script resource - removed unintentional "\" from <a> link - changed "name" tag in <form> element to "id" for XHTML 1.0 Strictness (remaining warnings come from script elements writing end tags like </tr> that might confuse some validators) mikeworks 2010-07-23 06:36:06 +00:00
  • b7102eff92 ... migrating to HttpComponents-Client-4.x ... sixcooler 2010-07-22 23:08:37 +00:00
  • 572e429eff - fixes UPnP not working discussion on forum: http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2881 SVN 6987 fixed net.yacy.upnp.devices.UPNPRootDevice for usage with JxPath > 1.3 by using a default namespace (xmlns="urn:schemas-upnp-org:device-1-0") This commit now fixes the same problem for net.yacy.upnp.devices.UPNPService with default namespace (xmlns="urn:schemas-upnp-org:service-1-0") mikeworks 2010-07-22 19:13:37 +00:00
  • 2a20282505 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6987 6c8d7289-2bf4-0310-a012-ef5d649a1542 mikeworks 2010-07-22 19:07:02 +00:00
  • 965aa97993 including sbbi upnplib as source again http://www.sbbi.net/site/upnp/index.html lotus 2010-07-22 18:02:16 +00:00
  • 74f6fd229e some comments + debug code lotus 2010-07-22 08:12:58 +00:00
  • 60caade056 removed debug output orbiter 2010-07-22 07:59:22 +00:00
  • 52718e6dcb ... migrating to HttpComponents-Client-4.x ... monitoring: replaced unused 'idletime' by uploading bytes added some kind of 'upload-throttling' at dht-out :-) sixcooler 2010-07-22 00:51:41 +00:00
  • b143f6b169 ConfigHeuristics_p.html: XHTML 1.0 Strict Changes - added empty action tag to form - replaced name tags with id (name is not a valid tag in XHTML 1.0 Strict) - changed label for target (so now clicking on the labels also activates the checkboxes) de.lng: Test with Subversion properties #2 mikeworks 2010-07-21 22:40:34 +00:00
  • a9474b3caa German language file de.lng updated - Removed one obsolete line in Blacklist_p.html - Testing the new SVN Properties http://forum.yacy-websuche.de/viewtopic.php?f=15&t=2906 mikeworks 2010-07-21 22:05:46 +00:00
  • 89b0f5bce8 fix for exception in http://forum.yacy-websuche.de/viewtopic.php?p=20418#p20418 orbiter 2010-07-21 11:26:08 +00:00
  • 5fa8038f10 ... migrating to HttpComponents-Client-4.x ... monitoring and first try to use remoteProxy sixcooler 2010-07-20 01:14:28 +00:00
  • dec1419bc3 ;-) orbiter 2010-07-18 20:18:32 +00:00
  • 22dbbcfa56 better (and corrected) recognition of intranet and internet-addresses. This corrects the isLocal property that is used by network definitions to restrict index ranges to local and global addresses. Address locations (intranet or internet) had been partly identified by the top level domain of the host address. Since intranet addresses can also be addressed using a host name that is in a country domain it is necessary to do a dns resolving for each check. The check is supported by a local dns cache so the intranet/internet check should not affect network traffic too much. To ensure that the cache works properly the cache class was upgraded to better concurrency data structures. orbiter 2010-07-18 20:14:20 +00:00
  • 2d2771a12e *) more HTML fixes low012 2010-07-18 19:21:59 +00:00
  • eb8550526d *) fixed small HTML bug low012 2010-07-18 18:40:41 +00:00
  • 8674a65488 removed override directive which caused a compile error in eclipse helios orbiter 2010-07-18 18:37:20 +00:00
  • b4d5bb6a3e Steering.html: Changed link from Settings_p.html to ConfigAccounts_p.html for setting not existing Administrator password de.lng: Added missing translations for Steering.html during restart/update mikeworks 2010-07-18 13:31:44 +00:00
  • dc5f0e357c *) fixed SVN properties low012 2010-07-18 10:02:03 +00:00
  • 01d6b952f0 *) minor changes for easier to read code, no functional changes low012 2010-07-18 10:00:43 +00:00
  • 0e6fed1fb6 *) less HTML errors (according to https://addons.mozilla.org/de/firefox/addon/249/) *) followed some suggestions by PMD low012 2010-07-18 09:10:46 +00:00
  • 2d263a7157 *) less HTML errors (according to https://addons.mozilla.org/de/firefox/addon/249/) *) Is line 112 there on purpose or can it be deleted? low012 2010-07-17 19:00:54 +00:00
  • 0e56d29335 ... migrating to HttpComponents-Client-4.x ... sixcooler 2010-07-15 00:59:53 +00:00
  • 2ad5829b26 correct Timeoutparamter at HttpComponents-Client-4.x sixcooler 2010-07-14 02:47:40 +00:00
  • e1316d12d0 ... migrating to HttpComponents-Client-4.x ... sixcooler 2010-07-13 22:10:24 +00:00
  • c5c67f0504 start migrating to HttpComponents-Client-4.x see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2872 sixcooler 2010-07-12 23:07:05 +00:00
  • 2de0ded377 *) trying to fix bug described in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2900 low012 2010-07-10 18:03:07 +00:00
  • d851758dc6 Added German translation for ConfigHeuristics_p.html to de.lng Fixed Network -> Heuristics title tag of the page mikeworks 2010-07-05 22:58:51 +00:00
  • 43e6ce62af use heuristics only if user is authenticated orbiter 2010-07-05 21:52:02 +00:00
  • dcfb5b942d Updated German translation for Network.html in de.lng mikeworks 2010-07-05 21:26:37 +00:00