Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-06-21 04:06:09 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 74957f3760 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-10-07 17:51:18 +02:00
  • 2a052f446a Added an experimental audio feedback system. This is the first element of a new 'decoration' component which may hold switches for different external appearance parameters. The first switch in that context is decoration.audio (as usual in yacy.init). This value is set to false by default, that means the audio feedback element is switched off by default. To switch it on, set decoration.audio = true (using /ConfigProperties_p.html). You will then hear sounds for the following events: - remote searches - incoming dht transmissions - new documents from the crawler Sound clips are stored in htroot/env/soundclips/ which is done so because a future implementation will read these files using the http client and with configurable urls which will make it very easy for the user to replace the given sounds with own sounds. Michael Peter Christen 2014-10-07 17:51:07 +02:00
  • 1e6e69bc40 Finished implementation of UPNP: Marc Nause 2014-10-07 13:10:06 +02:00
  • d0358e568b Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-10-06 17:44:38 +02:00
  • e1bc768f9d more IPv6 bugfixes Michael Peter Christen 2014-10-06 17:44:27 +02:00
  • 59c6532a65 add link extraction to pdfParser this extracts clickable links in pdf and adds it to the list of links reger 2014-10-06 04:51:31 +02:00
  • aa2e15d846 allow url parameter in worktable apicall allow url=wwwl?param=a&param=b (with ?, & encoded) fix: http://mantis.tokeek.de/view.php?id=100 reger 2014-10-05 20:05:03 +02:00
  • f3a12801f0 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-10-05 14:50:35 +02:00
  • d93325a578 lazy handling of process_sxt field (part of postprocessing) orbiter 2014-10-05 14:50:22 +02:00
  • b31db00010 toString fixes Michael Peter Christen 2014-10-05 11:03:57 +02:00
  • 961f06c0b6 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-10-05 01:25:12 +02:00
  • 209e0f2fe8 allow url parameter in worktable apicall allow url=wwwl?param=a&param=b (with ?, & encoded) fix: http://mantis.tokeek.de/view.php?id=100 reger 2014-10-04 04:11:48 +02:00
  • b5ca20de15 preserve content_type (mime) if supplied in preference of construct in from file type. (this eventually can benefit image search by using mime only) reger 2014-10-03 22:08:07 +02:00
  • 0773c73a19 upd to jsoup-1.8.1.jar reger 2014-10-03 20:54:45 +02:00
  • 3562b5e3a4 open rejected urls in new browser reger 2014-10-03 20:49:40 +02:00
  • fe9f1c594e fix char encoding parameter in UrlProxy reger 2014-10-03 08:51:23 +02:00
  • b0c87d8240 fix image search expand box, cut-off of 2nd capture line height tested with IE11 and Firefox 32 (change worked for both to show 2nd line without cutting off height) reger 2014-10-03 01:43:05 +02:00
  • 2c2ed8bf4e typo in javadoc Michael Peter Christen 2014-10-02 09:38:06 +02:00
  • fa99b286cc add html5 autofocus to query input field (leave onload untouched = redundant, for IE9 http://www.w3schools.com/tags/att_input_autofocus.asp) reger 2014-10-01 23:53:41 +02:00
  • 329262231f unresolved pattern fix Michael Peter Christen 2014-10-01 15:34:43 +02:00
  • 528f583d72 ipv6 fixes Michael Peter Christen 2014-10-01 15:32:10 +02:00
  • e4ccca9497 fix for xss bugs found by CTF365 Michael Peter Christen 2014-10-01 12:22:55 +02:00
  • 6ee5b4352d Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-10-01 10:21:13 +02:00
  • 247e626083 IPv6 host parsing bugfixes Michael Peter Christen 2014-10-01 10:21:03 +02:00
  • fb1fcc2b03 handle noarchive tag, skip writing page to cache http://mantis.tokeek.de/view.php?id=44 reger 2014-10-01 04:35:34 +02:00
  • fe917deb2d when pinging other peers, be able to select the right IP option Michael Peter Christen 2014-10-01 03:47:57 +02:00
  • 65e6ae52fb IPv6-enhanced Network monitoring page Michael Peter Christen 2014-10-01 03:10:39 +02:00
  • 7c1707872b search result showPicture update search parameter used parameter &cat=image is obsolete and returns no results - remove &cat=image and &cat=href references - remove &tenant= references (unused) Use contentdom=image and inurl: parameter to make showPicture link display something (open in new window because of used inurl modifier changes original query) reger 2014-09-30 22:22:13 +02:00
  • 3073c69aee Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-09-30 14:54:06 +02:00
  • 6491270b3a large IPv6 redesign of peer ping methods! removed preferred IPv4 in start options and added a new field IP6 in peer seeds which will contain one or more IPv6 addresses. Now every peer has one or more IP addresses assigned, even several IPv6 addresses are possible. The peer-ping process must check all given and possible IP addresses for a backping and return the one IP which was successful when pinging the peer. The ping-ing peer must be able to recognize which of the given IPs are available for outside access of the peer and store this accordingly. If only one IPv6 address is available and no IPv4, then the IPv6 is stored in the old IP field of the seed DNA. Many methods in Seed.java are now marked as @deprecated because they had been used for a single IP only. There is still a large construction site left in YaCy now where all these deprecated methods must be replaced with new method calls. The 'extra'-IPs, used by cluster assignment had been removed since that can be replaced with IPv6 usage in p2p clusters. All clusters must now use IPv6 if they want an intranet-routing. Michael Peter Christen 2014-09-30 14:53:52 +02:00
  • eaccce3467 added metadataImageParser for tif and psd (Photoshop) images. This is a modified genericImageParser adding tif (and psd) support even if java ImageIO plugin for tif is not installed in JDK. Adds just tif and psd to the available parsers. Uses the same library to extract metadata, so could eventually be merged with genericImageParser. All detected metadata are added to the parsed document (potentially some more as with genericImageParser) reger 2014-09-30 05:04:47 +02:00
  • a69f5358ff use javax ImageIO getReader to add supported image extension/mime genericImageParser uses javax ImageIO, supported images depend on available plugins for ImageIO package (this is JDK installation specific). Jpeg, png and gif are availabel by default. Tif and others only on avalable plugin (in classpath). Add supported image type dynamically on startup. reger 2014-09-29 07:42:51 +02:00
  • 8b1ce49ee6 remove unused variable timeout reger 2014-09-29 02:24:29 +02:00
  • cd0a16cf2e update to PDFBox 1.8.7 reger 2014-09-28 03:18:18 +02:00
  • 0ecbf32134 update to Jetty 9.2.3 reger 2014-09-27 23:27:05 +02:00
  • 48aed15c48 skip loader wait cycle on concurrent access in nocache configuration. In nocache config resource is loaded online, leaving no benefit to wait for a faster cache hit. reger 2014-09-26 23:49:10 +02:00
  • 851e96cf6e update German translation http://mantis.tokeek.de/view.php?id=447 reger 2014-09-26 22:34:11 +02:00
  • 67cd4c37bd activated the new apk parser which was already ready but not included in the parser initialization. To make the apk parser usable, the handling of application type links had to be modified. Now all documents which have not a parser attached are placed to the noload-queue while all other documents are parsed using the associated parser class. This may have side-Effects on other parsers and the display of different file classes (images, apps, videos). Michael Peter Christen 2014-09-24 13:32:58 +02:00
  • 309d978520 Merge branch 'master' of git@gitorious.org:yacy/rc1.git orbiter 2014-09-22 15:29:07 +02:00
  • a922b122a3 added a hack to forward solr search results from an external attached solr to the YaCy built-in solr search servlet. Its not complete and not fully correct (there is still a utf8 encoding problem) but it is a way to get easily requests forwarded through YaCy to an external Solr. orbiter 2014-09-22 15:28:54 +02:00
  • 46afdf7d21 add link to thread pool settings in status panel reger 2014-09-21 22:35:03 +02:00
  • 54019313e7 fix NPE in ViewFile - show snippet on document not in index reger 2014-09-21 03:48:54 +02:00
  • 4873a2d3a4 adjust link to peer in Network list (www path obsolete) reger 2014-09-21 00:10:20 +02:00
  • 537ad6239e upd Maven pom (to current dev version) reger 2014-09-21 00:04:54 +02:00
  • 025516f682 fix for crawl limit for number of pages fail Michael Peter Christen 2014-09-20 13:06:46 +02:00
  • 2645dc816a added warning for not well-formed postprocessing queries Michael Peter Christen 2014-09-18 14:36:57 +02:00
  • 437ce3b8a0 added internal api for partial updates to Solr Michael Peter Christen 2014-09-18 14:26:45 +02:00
  • 3ac31614a3 added option to reverse-sort YaCy tables (internal API change only) orbiter 2014-09-18 11:11:09 +02:00
  • 6d3d4c4ea6 changed the concurrent enumeration of query results in such a way that it is now possible to get the results in two steps: - first retrieve all IDs as given for a query - then retieve each document individually Michael Peter Christen 2014-09-17 13:58:55 +02:00
  • ad35d9294f added a 'stats' table which records some peer statistics twice every hour. The table can be shown with http://localhost:8090/Tables_p.html?table=stats Michael Peter Christen 2014-09-17 12:54:50 +02:00
  • a11bc10629 next development cycle. Please be careful with the usage of next commits, maybe new and unstable things will come... Michael Peter Christen 2014-09-17 00:22:23 +02:00
  • 8284ea751a catch TimeoutException during ping and do not delete yacy.conf during prereadconfigfile found a situation after crash (reboot) with existing running semaphore but YaCy not running. Ping generated exception which finally deleted the conf file (during pre-read procedure) - change to ping (catch exception solved it) - additionally removed delete yacy.conf file (if needed we need to make a backup) reger 2014-09-16 23:14:13 +02:00
  • dc14824814 fix for Mac.app config - but does still not run. looking for build bug. Michael Peter Christen 2014-09-16 17:46:07 +02:00
  • ffa7c7116f better fix for NPE in image search replace 8931e14514 reger 2014-09-16 16:43:17 +02:00
  • b9de39be11 Release 1.80 Release_1.80 Michael Peter Christen 2014-09-16 16:02:45 +02:00
  • f03dd0df24 updated seedlist Michael Peter Christen 2014-09-16 15:49:03 +02:00
  • 759e7d9538 fix for http://forum.yacy-websuche.de/viewtopic.php?p=30720#p30720 Michael Peter Christen 2014-09-16 14:53:30 +02:00
  • bf18a39d0e replaced warning with info Michael Peter Christen 2014-09-16 14:41:04 +02:00
  • f1032fb8fe more enhancements to image search in case that a restriction to a single domain is done Michael Peter Christen 2014-09-16 13:41:01 +02:00
  • 19c6b97572 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-09-16 00:21:07 +02:00
  • 475125f9d7 hack to get more results when doing a remote site search Michael Peter Christen 2014-09-16 00:13:26 +02:00
  • ed0d7a80d5 modifiy description for Field-Reindex to act only on local index http://mantis.tokeek.de/view.php?id=279 reger 2014-09-15 23:29:42 +02:00
  • 81f9b34da7 increaesed ability ot search for all images on a single server within the p2p remote search Michael Peter Christen 2014-09-15 20:33:22 +02:00
  • 2c26013c50 better contentdom abstraction Michael Peter Christen 2014-09-15 14:00:41 +02:00
  • 6a8fb8190b changed default value for maximum number of connections to 50 Michael Peter Christen 2014-09-15 13:50:40 +02:00
  • 9b92685771 automatically add a wild card if only a search on a single domain is done. This makes it possible to search all documents on a single domain even if no search word is given. This is in particular interesting when searching for all images on a single domain. Michael Peter Christen 2014-09-15 13:38:53 +02:00
  • abde89438b fix for favicon Michael Peter Christen 2014-09-15 13:03:08 +02:00
  • ca8b2bf099 removed www and welcome servlet, these had been demo servlets and are not needed any more Michael Peter Christen 2014-09-15 12:48:58 +02:00
  • 5247d01cd4 implement a forward to remote peer link in P2P Network list Most links in Network.html are only available with transparent proxy = on, which is switched off by default, to make the provided links useable in default setup a small forward servlet added (goto_p.java), which takes the peer hash as parameter and forwards to current public ip (optional with path= parameter). The servlet is protected ( _p ending) to assure forwarding works only for authorized YaCy users. reger 2014-09-14 23:26:22 +02:00
  • de7641023c add recommended link "self" to atom feed output reger 2014-09-14 01:40:27 +02:00
  • 03a7a29db3 limit OAI import urn resolver try for Deutsche National Library The resolver service of National Library uses name space nbn, limit use of nbn-resolving.de accordingly to urn:nbn: - add resolver for rfc's reger 2014-09-14 01:38:27 +02:00
  • 0838326a76 changed error message, see http://mantis.tokeek.de/view.php?id=439 Michael Peter Christen 2014-09-13 17:02:26 +02:00
  • 805a95a98b fix for http://mantis.tokeek.de/view.php?id=467 Michael Peter Christen 2014-09-13 16:26:40 +02:00
  • d1604258c1 added a script which retrieves the public ip of the local peer and prints it out to the terminal using the new servlet /yacy/seedlist.xml. just call: bin/myip.sh Michael Peter Christen 2014-09-13 11:09:35 +02:00
  • 7527ae63e7 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-09-13 11:02:38 +02:00
  • b93ea4e2a6 Added the option to retrieve only the own seed or a seleceted seed (selected by peer-hash) in the /yacy/seedlist.[json/xml] api. Added also a xml-version of the servlet. The own seed can be retrieved i.e. with http://localhost:8090/yacy/seedlist.xml?my= http://localhost:8090/yacy/seedlist.json?my= and any other peer can be selected with http://localhost:8090/yacy/seedlist.xml?id=<peerhash> http://localhost:8090/yacy/seedlist.json?id=<peerhash> Michael Peter Christen 2014-09-13 11:02:11 +02:00
  • b5e0f70197 - remove repositoryPath post from ConfigBasic (obsolete) - remove static snippetComputationTime from ResultEntry (not used) reger 2014-09-13 03:21:52 +02:00
  • ffc259c944 changed link to new tutorial repository (yes, Youtube..). The link does not point to youtube directly to prevent that the referer to the peer address is given to youtube. Instead, a forwarder address at yacy.net is used to redirect to the tutorial repository (and can be changed later). Michael Peter Christen 2014-09-13 02:15:36 +02:00
  • eab35afb78 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 Michael Peter Christen 2014-09-13 01:19:24 +02:00
  • 8931e14514 fix NPE in image search reger 2014-09-13 00:27:39 +02:00
  • a10f4189f5 Update russian translation malykhin.dmitry 2014-09-13 01:11:25 +04:00
  • b0bfafa581 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-09-12 16:37:21 +02:00
  • 1735dbc9d9 enhanced image search: bugfixes and performance enhancements Michael Peter Christen 2014-09-12 16:37:01 +02:00
  • 1d5d0b82a6 - skip html template specific servlet post variables (show_xxx) for feeds, - add <updated> (in required format) to atom feed reger 2014-09-12 02:10:18 +02:00
  • 8ed6550261 adding totalResults and id to atom feed output reger 2014-09-12 00:08:22 +02:00
  • 9f6ea41353 Update russian translation malykhin.dmitry 2014-09-11 13:34:17 +04:00
  • cb4637fce8 Update russian translation malykhin.dmitry 2014-09-11 05:40:57 +04:00
  • ebd0be2cea fixes and speed updates for search process Michael Peter Christen 2014-09-10 14:24:03 +02:00
  • 7611bf79bd Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 Michael Peter Christen 2014-09-10 13:24:49 +02:00
  • 524bedc00a fixed text in startup tray icon and added shutdown icon during shutdown Michael Peter Christen 2014-09-10 13:19:08 +02:00
  • d3b000b089 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-09-10 13:18:15 +02:00
  • 9962b9e548 use configured search items per page if not specified in post - remove verify=cacheonly from admin screen search box to use the configured values (otherwise definition overwrites configured behavior and is used for following searches what might give unexpected/confusing different results compared to using /yacysearch ) reger 2014-09-10 00:52:37 +02:00
  • 65de1236b3 Update russian translation malykhin.dmitry 2014-09-08 14:20:43 +04:00
  • 2a52c6f0f1 using htroot/api/blacklists as source folder: removed package declaration of some classes in that folder Michael Peter Christen 2014-09-08 11:36:28 +02:00
  • 4709d8417c npe fix for non-tray users Michael Peter Christen 2014-09-08 10:26:28 +02:00
  • 53ecce81e3 changed translation of submenuCustomization.template to submenuDesign.template - removed obsolete scroogle translation reger 2014-09-08 05:00:30 +02:00
  • 5b5635e187 replaced font for boot tray icon with image and added some more images for further tray icon displays orbiter 2014-09-08 00:21:29 +02:00
  • aa6cdc4ab5 speed-up of start process if remote DNS waits for timeout orbiter 2014-09-07 12:28:19 +02:00
  • 40b3977c21 added an animation of the tray icon during the boot phase of YaCy. Additionally, there is a tooltip and a new headline at the tray menu which states the current booting status. orbiter 2014-09-07 12:04:35 +02:00
  • ec6082c872 very bad language detection hack fix hack Michael Peter Christen 2014-09-05 23:29:09 +02:00