Commit Graph

  • dcf46ce8f6 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git orbiter 2013-12-31 15:20:49 +01:00
  • 343d2ef49a new data type for access tracker (unfinished) orbiter 2013-12-31 15:20:34 +01:00
  • dd8ea0cdd6 fix "add to blacklist" button style in IndexControlRWIs_p - added default filename filter to select field (as only addition to *.black list is permanent) reger 2013-12-30 20:03:59 +01:00
  • e03c9306e8 include install/uninstallYaCyWindowsService.bat as wrappers to copy reger 2013-12-29 23:16:20 +01:00
  • abbf487023 fix QueryGoal Image query (missing space) see query log example .. url_file_ext_s:(jpg OR png OR gif) ORcontent_type:(image/*)) .. reger 2013-12-29 20:14:10 +01:00
  • 2861183359 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git orbiter 2013-12-29 13:04:14 +01:00
  • 4035e20f0b unescaping the path orbiter 2013-12-29 13:03:33 +01:00
  • 7e21d1ff70 "inaccessible" better describes the state of a server which cannot be reached (while 30c3: too many users) orbiter 2013-12-29 12:40:34 +01:00
  • 26e9d7e066 fix NPE in IndexControlRWIs_p.html - metatags my be null Caused by: java.lang.NullPointerException at net.yacy.search.query.QueryParams.getFacets(QueryParams.java:445) at net.yacy.search.query.QueryParams.getBasicParams(QueryParams.java:400) at net.yacy.search.query.QueryParams.solrTextQuery(QueryParams.java:345) at net.yacy.search.query.QueryParams.solrQuery(QueryParams.java:334) at net.yacy.search.query.SearchEvent.<init>(SearchEvent.java:290) at net.yacy.search.query.SearchEventCache.getEvent(SearchEventCache.java:176) at IndexControlRWIs_p.genSearchresult(IndexControlRWIs_p.java:641) at IndexControlRWIs_p.respond(IndexControlRWIs_p.java:141) reger 2013-12-29 08:05:37 +01:00
  • 7f9b9315fe Merge origin/master reger 2013-12-29 02:05:07 +01:00
  • 8eaabb9600 remove dependency from old serverCore.java - remaining getPortNr not needed (as current release allows only to set plain integer as port, see ConfigBasic) reger 2013-12-29 02:00:44 +01:00
  • 2a48c4138e upd NB gui classpath reger 2013-12-29 01:51:37 +01:00
  • 2018e55f8b switched back on index deletion (was accidently off because new jetty framework delivers never null to post arguments .. there may be more of that kind of problems) orbiter 2013-12-29 01:39:30 +01:00
  • f0d3c74193 remove in distro not existing path setting from stopYaCy.bat reger 2013-12-29 01:33:07 +01:00
  • 3961b643a3 write solr searches to search log orbiter 2013-12-29 01:25:44 +01:00
  • 15882beb19 fix for strange NPE java.lang.NullPointerException at net.yacy.search.Switchboard.updateMySeed(Switchboard.java:3667) at net.yacy.peers.Network.peerPing(Network.java:195) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at net.yacy.kelondro.workflow.InstantBusyThread.job(InstantBusyThread.java:107) at net.yacy.kelondro.workflow.AbstractBusyThread.run(AbstractBusyThread.java:165) orbiter 2013-12-29 00:40:31 +01:00
  • d4942ad5e0 startRecord fix; this is not according to SRU definition because this states that the first record has number 0; but +1 is not consistent with other places where the number is used. orbiter 2013-12-28 23:34:43 +01:00
  • f3ac923a7e ftp client shall be able to open non-anonymous ftp servers if login details are given orbiter 2013-12-28 22:42:02 +01:00
  • 3d913558ab display configured adminUserName in ConfigAccounts_p - fix read default username in in loginservice reger 2013-12-27 21:04:14 +01:00
  • fbdd89e198 Merge origin/master reger 2013-12-27 06:53:14 +01:00
  • 65a2f3d5e7 tweak Jetty credentials to work with YaCy UserDB - user entry in UserDB with admin right can login to access protected pages - dto. admin user, choosen username is stored in conf (adminAccountUserName=) reger 2013-12-27 06:45:22 +01:00
  • ffdfe5fb9b Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2013-12-27 03:06:38 +01:00
  • 7d6b34a89f Merge origin/master reger 2013-12-27 03:04:14 +01:00
  • 45e8750ba5 nasty quick fix for admin login with other username as admin - userDB is not sync'ed with Jetty credentials as of now only the std. admin account can login reger 2013-12-27 02:59:19 +01:00
  • ee17bd0b69 added option to attach remote solr servers in read-only mode Michael Peter Christen 2013-12-27 02:55:21 +01:00
  • 25f9c35033 add patch which shall prevent that naive search mistakes like usage of regular expressions cause no results. Usage of '*' followed by a dot or any expression will now cause that this expression is used as a filetype search. Michael Peter Christen 2013-12-27 00:34:55 +01:00
  • 667a6adddb - use default files from yacy.init property "defaultFiles" if no jetty-configuration is given for default files. - fix a problem with default paths if no path is given (i.e. http://localhost:8090 instead of http://localhost:8090/). Without this patch the path was resolved automatically to http://localhost:8090// Michael Peter Christen 2013-12-26 23:59:04 +01:00
  • 77aeb288a2 suppress deprecation warning (for now); TODO: find alternatives Michael Peter Christen 2013-12-26 23:26:21 +01:00
  • 8954b2d25f removed classpathentry to 'remove obsolete htroot/solr htroot/gsa YaCy-servlets' sixcooler 2013-12-26 22:23:40 +01:00
  • 37859dfc85 missing entrys for: 'updated poi-3.9 / poi-scratchpad-3.9' sixcooler 2013-12-26 22:01:01 +01:00
  • ee79b6c8de upd installWindowsService.bat - remove javaopts according to startYaCy.bat reger 2013-12-26 05:34:53 +01:00
  • 7bdc10c1a0 added Windows Service installer - used Apache procrun as it has a small footprint and comes with a GUI to edit the service settings see http://commons.apache.org/proper/commons-daemon/procrun.html reger 2013-12-26 05:07:26 +01:00
  • e05320b776 upd: to open more external links in new browser-tab reger 2013-12-26 01:16:53 +01:00
  • cbb5dc01e4 remove obsolete htroot/solr htroot/gsa YaCy-servlets - now handled by standard servlets reger 2013-12-25 22:53:11 +01:00
  • 090f789261 update Maven pom reger 2013-12-25 22:33:35 +01:00
  • 2507722fbb updated poi-3.9 / poi-scratchpad-3.9 reger 2013-12-25 22:31:41 +01:00
  • fca7f1d043 run SSL/HTTPS port (8443) ping test in migration only if SSL/HTTPS is on - see last commit reger 2013-12-25 05:33:00 +01:00
  • 71cac1a278 added SSL/HTTPS connector to support SSL/https connection on port 8443 !!! attention !!! to make sure YaCy can start, https will be disabled if port 8443 is used - added ping test for above to migration reger 2013-12-25 05:20:13 +01:00
  • f681ce15ae remove obsolete HTTPServer input field reger 2013-12-24 05:11:31 +01:00
  • 68d7ee812e aaaaaaaaaaaaaa Michael Peter Christen 2013-12-23 12:05:44 +01:00
  • 687f6c6aed remove large memory pages option and added MMapDirectoryFactory for debian Michael Peter Christen 2013-12-23 11:20:52 +01:00
  • 82c0525e71 wrong logger fix Michael Peter Christen 2013-12-23 10:52:02 +01:00
  • 122d026910 alphabetic order fix Michael Peter Christen 2013-12-23 10:47:11 +01:00
  • e17624b6dd added html retrieval from alternative DATA/HTDOCS path Michael Peter Christen 2013-12-23 02:06:33 +01:00
  • 07cee6b99c removed more unused code Michael Peter Christen 2013-12-23 01:51:48 +01:00
  • 20b48f894f refactoring: moving all servlets to the same package (the solr servlet is currently actually a filter which should be changed somehow) Michael Peter Christen 2013-12-23 01:32:29 +01:00
  • 84167adb49 removed unused anomichttpd code after migration to jetty Michael Peter Christen 2013-12-23 01:23:40 +01:00
  • b461a27abb fixed the SolrServlet Michael Peter Christen 2013-12-20 01:51:51 +01:00
  • 7603e879dc Merge branch 'master' into HEAD Michael Peter Christen 2013-12-20 01:19:06 +01:00
  • 25250405f1 solr servlet preparation for join with jetty branch Michael Peter Christen 2013-12-20 00:45:58 +01:00
  • 8b97489ff2 updated guava to 15.0 Michael Peter Christen 2013-12-19 22:21:33 +01:00
  • 34b4eda4a8 upgraded json-simple to 1.1.1 Michael Peter Christen 2013-12-19 22:16:01 +01:00
  • 75ae36da9c upgraded jsch to 0.1.50 Michael Peter Christen 2013-12-19 22:13:34 +01:00
  • db793a2a5e removed mysql connector which was used only for testing in the past Michael Peter Christen 2013-12-19 22:09:01 +01:00
  • 7ebc74b76a migrated to pdfbox 1.8.3 Michael Peter Christen 2013-12-19 22:06:10 +01:00
  • 2f16770681 migrated to solr 4.6.0 Michael Peter Christen 2013-12-19 21:51:05 +01:00
  • b5ce834059 next try to fix m4 Michael Peter Christen 2013-12-19 15:35:31 +01:00
  • 439f8927fc fix for deb m4 Michael Peter Christen 2013-12-19 14:40:11 +01:00
  • 57f0f71ac6 added patch to allow binary response writer Michael Peter Christen 2013-12-19 10:13:43 +01:00
  • 31f4607f2e update to Mac start parameters Michael Peter Christen 2013-12-19 09:42:01 +01:00
  • 8de3f55a7a removed malicious java start arguments in debian start script which had been removed from the other start scripts recently. The reason to do so was a comparisment of a debian-installed YaCy with 20 million document which crashed after 10 hours with the debian start script, but did not crash with the startYACY.sh start script. Both scripts now use the same java start arguments. Added also the Solr MMapDirectoryFactory switch which was missing so far in the debian start script. Michael Peter Christen 2013-12-19 09:07:04 +01:00
  • a909a3dbc4 removed non-root restriction in startYACY.sh because that is also not applied for the debian version. There is no reason to apply this restriction. Added also the -d64 option if the system is 64 bit. Michael Peter Christen 2013-12-19 09:04:23 +01:00
  • 937273d4e3 added parsing of metadata to surrogate reading: a dublin core record inside of surrogate input files may now contain tokens within the namespace 'md' (short for: metadata). The token names must be valid withing the namespace of the solr field names. All md-tokens inside of surrogate files then overwrite values within solr documents before they are written to the solr index. This makes it possible to assign collection names to each surrogate entry and also ranking information can be added. Please see the example file. orbiter 2013-12-17 14:02:27 +01:00
  • 18497f6475 remove unused init parameter from DefaultServlet - remove "RelativeResourceBase" parameter reger 2013-12-15 23:39:19 +01:00
  • 4de3fefdb5 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git orbiter 2013-12-15 19:13:00 +01:00
  • 7e346e1d79 using stringbuilder in query construction orbiter 2013-12-15 19:12:49 +01:00
  • c84c313fe1 Merge origin/master into jetty reger 2013-12-14 20:02:24 +01:00
  • 69829fc417 update Netbeans GUI build classpath reger 2013-12-14 19:50:41 +01:00
  • 2702d9e56b - added a SolrQueryResponse2SolrDocumentList method which is able to work around the unfolding process in Solr's BinaryResponseWriter. This was a huge performance bottleneck in the embedded solr connector and the problem is actually on Solr side, but we have now a workaround. - This made it possible to abstract a high-performance index access method which is implemented as method getDocumentListByParams. That method is also implemented in the SolrServerConnector and provides a very efficient access to a solr index if the index is embedded. - a popular use of the document list retrieval is a result count which can now also make use of the new method, via getDocumentCountByParams. - enhanced the Error cache which now does not store error documents within the ram cache if the document is also written to solr. When documents are retrieved from the cache, they are partly read from the ram cache and if not existent there, from the Solr index. Michael Peter Christen 2013-12-13 15:56:29 +01:00
  • 74466d731a use pre-compiled patterns in ymark Michael Peter Christen 2013-12-12 11:50:48 +01:00
  • 34633044b4 made pattern computation static Michael Peter Christen 2013-12-12 10:55:36 +01:00
  • ef7ddbc933 added date parser caches to prevent re-calculation of costly date parsing Michael Peter Christen 2013-12-12 10:55:12 +01:00
  • 552ef9f18e fix for bad ErrorCache.exists test (bug from latest commit) Michael Peter Christen 2013-12-12 10:38:32 +01:00
  • 09412ea3a4 counting search requests in solr interface Michael Peter Christen 2013-12-12 03:37:19 +01:00
  • 303f5694ba avoid usage of existsByQuery. If a document can be loaded by the ID before testing other fields from the existsByQuery request, then a document cache fills and queries after that one can be avoided. Michael Peter Christen 2013-12-12 03:36:30 +01:00
  • b43bbd3cc4 join DefaultServlet and Jetty8 implementation - removing Jetty 8 specific dependencies reger 2013-12-09 23:45:57 +01:00
  • 8ac48aac27 update Maven pom to latest version number - include newer dependency versions of several lib/jar for eval. reger 2013-12-09 23:43:58 +01:00
  • 089c5007ee move conditionalHeader to DefaultServlet - by removing Jetty specific implementation detail reger 2013-12-08 00:56:45 +01:00
  • 67e7dc0cc6 added more properties to seedlist servlet Michael Peter Christen 2013-12-06 14:30:47 +01:00
  • 79771c60c0 IPv6 fixes Michael Peter Christen 2013-12-06 14:30:08 +01:00
  • 4e3375d983 next development version Michael Peter Christen 2013-12-06 13:47:50 +01:00
  • 92d9c56f9f Merge origin/master into jetty reger 2013-12-05 22:53:29 +01:00
  • f722e450b3 changed start parameters which caused deadlocks in mac and windows versions Michael Peter Christen 2013-12-05 00:55:35 +01:00
  • ddc7a24853 intermediate release 1.66 Michael Peter Christen 2013-12-04 23:16:06 +01:00
  • 78eac85161 better calibration of caches and queue maximum sizes Michael Peter Christen 2013-12-04 23:15:10 +01:00
  • da380343c2 perform greedy learning heuristic only if load < 1.0 Michael Peter Christen 2013-12-04 22:44:51 +01:00
  • 81926c055d fixed bug with image search in yacyinteractive Michael Peter Christen 2013-12-04 18:44:23 +01:00
  • edda0699e4 changed default timeout for port scanner Michael Peter Christen 2013-12-04 18:13:43 +01:00
  • c8af19bd37 removed unnecessary check which causes a NPE when searching with empty search string Michael Peter Christen 2013-12-04 17:58:36 +01:00
  • e3c2f09de9 - reduce computation in case that specific postprocessing fields are not selected - de-select citation rank computation Michael Peter Christen 2013-12-04 17:48:12 +01:00
  • cfa08024c7 removed optimization bevore postprocessing because that may cause a time-out which will cause that postprocessing fails. Michael Peter Christen 2013-12-04 16:04:29 +01:00
  • 6f3a923691 fixed urlmask which was not able to combine several constraints Michael Peter Christen 2013-12-04 13:48:01 +01:00
  • 9a27bf6e82 removed filter computation in Protocol class for remote searches because that is already done in the QueryParams class Michael Peter Christen 2013-12-04 13:09:15 +01:00
  • f1b5db2c45 - performance graph does not shop peer ping in memory monitor any more - after a forced GC, the PerformanceMemory view switches to automatic update by default Michael Peter Christen 2013-12-04 12:59:30 +01:00
  • a125904a1c fixed a NPE in surrogat processing Michael Peter Christen 2013-12-04 01:56:38 +01:00
  • 0db8e34625 enhanced webgraph processing Michael Peter Christen 2013-12-04 01:54:45 +01:00
  • 9d8b32c63a fixed a division by zero Michael Peter Christen 2013-12-04 01:54:14 +01:00
  • ac067b5236 clean-up Jetty handler classes reger 2013-12-01 19:36:24 +01:00
  • 10a6346056 clean-up test cases to work with current source reger 2013-12-01 03:38:58 +01:00
  • b75e92aac3 add read queryparameter in gsaservlet reger 2013-11-30 06:29:57 +01:00