Commit Graph

  • 41dc0f82c1 open service manager upon install failure in installYaCyWindowsService.bat likely service is already installed Service Manager allows then to modify settings reger 2014-01-06 07:22:23 +01:00
  • 30d925a96e reimplemented server access restriction via Jetty IPAccessHandler to allow only configured IP's to access. Handler is only loaded if a restriction is configured. reger 2014-01-06 07:00:16 +01:00
  • 3cb6c7861f fixed shutdown authenticaton problem orbiter 2014-01-06 01:48:54 +01:00
  • ed06b5b94b set a realm message to log-in input window which explains that a password for the account 'admin' can be (re-)set with the script bin/passwd.sh Michael Peter Christen 2014-01-05 17:43:34 +01:00
  • 7005ecdabd cleanup Michael Peter Christen 2014-01-05 15:06:40 +01:00
  • 2939b47986 removed non-working realm setting in http client (auth for localhost was added in previous commit) Michael Peter Christen 2014-01-05 15:04:18 +01:00
  • 9d52b337f3 added http authentification to YaCy http client for all localhost acesses to enable self-steering of the peer using the API table. This is necessary in case that an password for the administration pages is set. orbiter 2014-01-05 14:46:11 +01:00
  • c951945666 modified log-in detail to enable admin-login from localhost with stored hash even if localhost access is disabled. This is urgently needed for the apicall.sh script since that is used for high-availability set-up (checkalive and indexdump for index mirroring) Michael Peter Christen 2014-01-05 11:50:23 +01:00
  • 9bd71fdbb4 made the access tracker class static because it shall be used by the jetty auth module Michael Peter Christen 2014-01-05 05:04:28 +01:00
  • 1c56befb93 fixed mess with test on localhost (which means local hosts for some cases) Michael Peter Christen 2014-01-05 04:55:30 +01:00
  • 7d6fc79eb8 refactoring (usage of constant names for attributes of authentication check) Michael Peter Christen 2014-01-05 04:23:44 +01:00
  • b9d36e45e0 removed the &amp explicit encoding of ampersand character since this is double-translated within the template replacement process. Michael Peter Christen 2014-01-05 03:40:10 +01:00
  • e2ccb6ce9d modified DefaultServlet parameter on invoke templates call response with post=0 (if post empty) simulating previous behavior. reger 2014-01-04 20:49:26 +01:00
  • cabe0943cd fix opensearch resultcount in yacysearch.rss see merge request https://gitorious.org/yacy/rc1/merge_requests/24 use result count in searchtrailer.xml which is on p2p search more accurate (timing) reger 2014-01-04 17:14:10 +01:00
  • eaf596a257 adding proxy status to (private) status box (show also transparent and url proxy status) reger 2014-01-04 16:10:54 +01:00
  • 4c38bceafc handle http connect for proxy refactor header cleanup (reuse existing code) reger 2014-01-04 13:09:34 +01:00
  • cfabe8f67a harmonize access restriction for urlproxy servlet with proxy handler, what is currently - use switched on in config - access from a local IP / hostname reger 2014-01-03 12:28:40 +01:00
  • e3d8459906 extend ssl enabled msg on status page - post the portnr reger 2014-01-03 02:56:09 +01:00
  • e6b9643fd6 extended request for local peer check to by hostname resolved ip the current islocal() check did not detect a domain.com address as request for the local peer. reger 2014-01-03 01:13:56 +01:00
  • c797f108a1 add error response on deniedl proxy access send http 403 response reger 2014-01-02 09:11:08 +01:00
  • 0583f44306 reimplement proxy access log (to Jetty ProxyHandler) - using existing HTTPDProxyHandler logger - allow local loopback ip to access proxy reger 2014-01-02 03:37:33 +01:00
  • 8cbc1c970a Security Hot-Fix: for transparent proxy. reger 2014-01-01 20:48:35 +01:00
  • 58ecf5e4dd add to blacklist button in CrawlResults http://bugs.yacy.net/view.php?id=220 introduced Blacklist.add with sourcefile only parameter reger 2014-01-01 11:01:22 +01:00
  • 17b454f957 fix external link (open in new tab) reger 2014-01-01 10:33:20 +01:00
  • e9081c0f17 moved startup execAPIActions call after Jetty startup execAPIActions require http to be up. The 10s sleep was sufficient to allow Jetty to start, but it's more robust to place the call after http is assigned to switchboard/serverSwitch. reger 2014-01-01 10:28:49 +01:00
  • 19c1a7a5ca change SolrServlet from Filter to Servlet (as no multicore required) this allows to simplify context/servlet initialization in Jetty init. reger 2014-01-01 10:20:32 +01:00
  • 14c977dd26 fix NPE GSAresponseWriter on query=null java.lang.NullPointerException at net.yacy.cora.federate.solr.responsewriter.GSAResponseWriter.highlight(GSAResponseWriter.java:328) at net.yacy.cora.federate.solr.responsewriter.GSAResponseWriter.write(GSAResponseWriter.java:263) at net.yacy.http.servlets.SolrServlet.service(SolrServlet.java:235) reger 2013-12-31 23:01:41 +01:00
  • c3dee2d6bd added security patch orbiter 2013-12-31 15:25:44 +01:00
  • dcf46ce8f6 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git orbiter 2013-12-31 15:20:49 +01:00
  • 343d2ef49a new data type for access tracker (unfinished) orbiter 2013-12-31 15:20:34 +01:00
  • dd8ea0cdd6 fix "add to blacklist" button style in IndexControlRWIs_p - added default filename filter to select field (as only addition to *.black list is permanent) reger 2013-12-30 20:03:59 +01:00
  • e03c9306e8 include install/uninstallYaCyWindowsService.bat as wrappers to copy reger 2013-12-29 23:16:20 +01:00
  • abbf487023 fix QueryGoal Image query (missing space) see query log example .. url_file_ext_s:(jpg OR png OR gif) ORcontent_type:(image/*)) .. reger 2013-12-29 20:14:10 +01:00
  • 2861183359 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git orbiter 2013-12-29 13:04:14 +01:00
  • 4035e20f0b unescaping the path orbiter 2013-12-29 13:03:33 +01:00
  • 7e21d1ff70 "inaccessible" better describes the state of a server which cannot be reached (while 30c3: too many users) orbiter 2013-12-29 12:40:34 +01:00
  • 26e9d7e066 fix NPE in IndexControlRWIs_p.html - metatags my be null Caused by: java.lang.NullPointerException at net.yacy.search.query.QueryParams.getFacets(QueryParams.java:445) at net.yacy.search.query.QueryParams.getBasicParams(QueryParams.java:400) at net.yacy.search.query.QueryParams.solrTextQuery(QueryParams.java:345) at net.yacy.search.query.QueryParams.solrQuery(QueryParams.java:334) at net.yacy.search.query.SearchEvent.<init>(SearchEvent.java:290) at net.yacy.search.query.SearchEventCache.getEvent(SearchEventCache.java:176) at IndexControlRWIs_p.genSearchresult(IndexControlRWIs_p.java:641) at IndexControlRWIs_p.respond(IndexControlRWIs_p.java:141) reger 2013-12-29 08:05:37 +01:00
  • 7f9b9315fe Merge origin/master reger 2013-12-29 02:05:07 +01:00
  • 8eaabb9600 remove dependency from old serverCore.java - remaining getPortNr not needed (as current release allows only to set plain integer as port, see ConfigBasic) reger 2013-12-29 02:00:44 +01:00
  • 2a48c4138e upd NB gui classpath reger 2013-12-29 01:51:37 +01:00
  • 2018e55f8b switched back on index deletion (was accidently off because new jetty framework delivers never null to post arguments .. there may be more of that kind of problems) orbiter 2013-12-29 01:39:30 +01:00
  • f0d3c74193 remove in distro not existing path setting from stopYaCy.bat reger 2013-12-29 01:33:07 +01:00
  • 3961b643a3 write solr searches to search log orbiter 2013-12-29 01:25:44 +01:00
  • 15882beb19 fix for strange NPE java.lang.NullPointerException at net.yacy.search.Switchboard.updateMySeed(Switchboard.java:3667) at net.yacy.peers.Network.peerPing(Network.java:195) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at net.yacy.kelondro.workflow.InstantBusyThread.job(InstantBusyThread.java:107) at net.yacy.kelondro.workflow.AbstractBusyThread.run(AbstractBusyThread.java:165) orbiter 2013-12-29 00:40:31 +01:00
  • d4942ad5e0 startRecord fix; this is not according to SRU definition because this states that the first record has number 0; but +1 is not consistent with other places where the number is used. orbiter 2013-12-28 23:34:43 +01:00
  • f3ac923a7e ftp client shall be able to open non-anonymous ftp servers if login details are given orbiter 2013-12-28 22:42:02 +01:00
  • 3d913558ab display configured adminUserName in ConfigAccounts_p - fix read default username in in loginservice reger 2013-12-27 21:04:14 +01:00
  • fbdd89e198 Merge origin/master reger 2013-12-27 06:53:14 +01:00
  • 65a2f3d5e7 tweak Jetty credentials to work with YaCy UserDB - user entry in UserDB with admin right can login to access protected pages - dto. admin user, choosen username is stored in conf (adminAccountUserName=) reger 2013-12-27 06:45:22 +01:00
  • ffdfe5fb9b Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2013-12-27 03:06:38 +01:00
  • 7d6b34a89f Merge origin/master reger 2013-12-27 03:04:14 +01:00
  • 45e8750ba5 nasty quick fix for admin login with other username as admin - userDB is not sync'ed with Jetty credentials as of now only the std. admin account can login reger 2013-12-27 02:59:19 +01:00
  • ee17bd0b69 added option to attach remote solr servers in read-only mode Michael Peter Christen 2013-12-27 02:55:21 +01:00
  • 25f9c35033 add patch which shall prevent that naive search mistakes like usage of regular expressions cause no results. Usage of '*' followed by a dot or any expression will now cause that this expression is used as a filetype search. Michael Peter Christen 2013-12-27 00:34:55 +01:00
  • 667a6adddb - use default files from yacy.init property "defaultFiles" if no jetty-configuration is given for default files. - fix a problem with default paths if no path is given (i.e. http://localhost:8090 instead of http://localhost:8090/). Without this patch the path was resolved automatically to http://localhost:8090// Michael Peter Christen 2013-12-26 23:59:04 +01:00
  • 77aeb288a2 suppress deprecation warning (for now); TODO: find alternatives Michael Peter Christen 2013-12-26 23:26:21 +01:00
  • 8954b2d25f removed classpathentry to 'remove obsolete htroot/solr htroot/gsa YaCy-servlets' sixcooler 2013-12-26 22:23:40 +01:00
  • 37859dfc85 missing entrys for: 'updated poi-3.9 / poi-scratchpad-3.9' sixcooler 2013-12-26 22:01:01 +01:00
  • ee79b6c8de upd installWindowsService.bat - remove javaopts according to startYaCy.bat reger 2013-12-26 05:34:53 +01:00
  • 7bdc10c1a0 added Windows Service installer - used Apache procrun as it has a small footprint and comes with a GUI to edit the service settings see http://commons.apache.org/proper/commons-daemon/procrun.html reger 2013-12-26 05:07:26 +01:00
  • e05320b776 upd: to open more external links in new browser-tab reger 2013-12-26 01:16:53 +01:00
  • cbb5dc01e4 remove obsolete htroot/solr htroot/gsa YaCy-servlets - now handled by standard servlets reger 2013-12-25 22:53:11 +01:00
  • 090f789261 update Maven pom reger 2013-12-25 22:33:35 +01:00
  • 2507722fbb updated poi-3.9 / poi-scratchpad-3.9 reger 2013-12-25 22:31:41 +01:00
  • fca7f1d043 run SSL/HTTPS port (8443) ping test in migration only if SSL/HTTPS is on - see last commit reger 2013-12-25 05:33:00 +01:00
  • 71cac1a278 added SSL/HTTPS connector to support SSL/https connection on port 8443 !!! attention !!! to make sure YaCy can start, https will be disabled if port 8443 is used - added ping test for above to migration reger 2013-12-25 05:20:13 +01:00
  • f681ce15ae remove obsolete HTTPServer input field reger 2013-12-24 05:11:31 +01:00
  • 68d7ee812e aaaaaaaaaaaaaa Michael Peter Christen 2013-12-23 12:05:44 +01:00
  • 687f6c6aed remove large memory pages option and added MMapDirectoryFactory for debian Michael Peter Christen 2013-12-23 11:20:52 +01:00
  • 82c0525e71 wrong logger fix Michael Peter Christen 2013-12-23 10:52:02 +01:00
  • 122d026910 alphabetic order fix Michael Peter Christen 2013-12-23 10:47:11 +01:00
  • e17624b6dd added html retrieval from alternative DATA/HTDOCS path Michael Peter Christen 2013-12-23 02:06:33 +01:00
  • 07cee6b99c removed more unused code Michael Peter Christen 2013-12-23 01:51:48 +01:00
  • 20b48f894f refactoring: moving all servlets to the same package (the solr servlet is currently actually a filter which should be changed somehow) Michael Peter Christen 2013-12-23 01:32:29 +01:00
  • 84167adb49 removed unused anomichttpd code after migration to jetty Michael Peter Christen 2013-12-23 01:23:40 +01:00
  • b461a27abb fixed the SolrServlet Michael Peter Christen 2013-12-20 01:51:51 +01:00
  • 7603e879dc Merge branch 'master' into HEAD Michael Peter Christen 2013-12-20 01:19:06 +01:00
  • 25250405f1 solr servlet preparation for join with jetty branch Michael Peter Christen 2013-12-20 00:45:58 +01:00
  • 8b97489ff2 updated guava to 15.0 Michael Peter Christen 2013-12-19 22:21:33 +01:00
  • 34b4eda4a8 upgraded json-simple to 1.1.1 Michael Peter Christen 2013-12-19 22:16:01 +01:00
  • 75ae36da9c upgraded jsch to 0.1.50 Michael Peter Christen 2013-12-19 22:13:34 +01:00
  • db793a2a5e removed mysql connector which was used only for testing in the past Michael Peter Christen 2013-12-19 22:09:01 +01:00
  • 7ebc74b76a migrated to pdfbox 1.8.3 Michael Peter Christen 2013-12-19 22:06:10 +01:00
  • 2f16770681 migrated to solr 4.6.0 Michael Peter Christen 2013-12-19 21:51:05 +01:00
  • b5ce834059 next try to fix m4 Michael Peter Christen 2013-12-19 15:35:31 +01:00
  • 439f8927fc fix for deb m4 Michael Peter Christen 2013-12-19 14:40:11 +01:00
  • 57f0f71ac6 added patch to allow binary response writer Michael Peter Christen 2013-12-19 10:13:43 +01:00
  • 31f4607f2e update to Mac start parameters Michael Peter Christen 2013-12-19 09:42:01 +01:00
  • 8de3f55a7a removed malicious java start arguments in debian start script which had been removed from the other start scripts recently. The reason to do so was a comparisment of a debian-installed YaCy with 20 million document which crashed after 10 hours with the debian start script, but did not crash with the startYACY.sh start script. Both scripts now use the same java start arguments. Added also the Solr MMapDirectoryFactory switch which was missing so far in the debian start script. Michael Peter Christen 2013-12-19 09:07:04 +01:00
  • a909a3dbc4 removed non-root restriction in startYACY.sh because that is also not applied for the debian version. There is no reason to apply this restriction. Added also the -d64 option if the system is 64 bit. Michael Peter Christen 2013-12-19 09:04:23 +01:00
  • 937273d4e3 added parsing of metadata to surrogate reading: a dublin core record inside of surrogate input files may now contain tokens within the namespace 'md' (short for: metadata). The token names must be valid withing the namespace of the solr field names. All md-tokens inside of surrogate files then overwrite values within solr documents before they are written to the solr index. This makes it possible to assign collection names to each surrogate entry and also ranking information can be added. Please see the example file. orbiter 2013-12-17 14:02:27 +01:00
  • 18497f6475 remove unused init parameter from DefaultServlet - remove "RelativeResourceBase" parameter reger 2013-12-15 23:39:19 +01:00
  • 4de3fefdb5 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git orbiter 2013-12-15 19:13:00 +01:00
  • 7e346e1d79 using stringbuilder in query construction orbiter 2013-12-15 19:12:49 +01:00
  • c84c313fe1 Merge origin/master into jetty reger 2013-12-14 20:02:24 +01:00
  • 69829fc417 update Netbeans GUI build classpath reger 2013-12-14 19:50:41 +01:00
  • 2702d9e56b - added a SolrQueryResponse2SolrDocumentList method which is able to work around the unfolding process in Solr's BinaryResponseWriter. This was a huge performance bottleneck in the embedded solr connector and the problem is actually on Solr side, but we have now a workaround. - This made it possible to abstract a high-performance index access method which is implemented as method getDocumentListByParams. That method is also implemented in the SolrServerConnector and provides a very efficient access to a solr index if the index is embedded. - a popular use of the document list retrieval is a result count which can now also make use of the new method, via getDocumentCountByParams. - enhanced the Error cache which now does not store error documents within the ram cache if the document is also written to solr. When documents are retrieved from the cache, they are partly read from the ram cache and if not existent there, from the Solr index. Michael Peter Christen 2013-12-13 15:56:29 +01:00
  • 74466d731a use pre-compiled patterns in ymark Michael Peter Christen 2013-12-12 11:50:48 +01:00
  • 34633044b4 made pattern computation static Michael Peter Christen 2013-12-12 10:55:36 +01:00
  • ef7ddbc933 added date parser caches to prevent re-calculation of costly date parsing Michael Peter Christen 2013-12-12 10:55:12 +01:00