Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-04 23:36:12 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 8410536f75 keep svnRevision in .init for convert of .conf until release >1.83 reger 2016-03-20 18:12:55 +01:00
  • 726ebee65a include Version config string in yacy.init (replacing svnRevision) reger 2016-03-20 03:42:33 +01:00
  • fb8ae14b21 make migration version safe reger 2016-03-20 03:34:28 +01:00
  • be0b09552c Merge pull request #46 from reelsense/patch-1 Burkhard 2016-03-19 18:29:34 +01:00
  • 898f6c5891 Merge pull request #4 from yacy/master Andreas 2016-03-19 13:13:04 +01:00
  • 4d781c660d Distilled sentence - ConfigNetwork_p Bryan Black 2016-03-18 22:29:44 -07:00
  • 94ce617188 Grammar fix Bryan Black 2016-03-18 21:40:11 -07:00
  • b4adbcbd35 Added YaCy icons luccioman 2016-03-18 14:02:08 +01:00
  • 23b523cb50 upd to poi-3.14 reger 2016-03-14 22:34:13 +01:00
  • 258cd41577 reduce logging (EmbeddedSolrConnector.query) mainly to reduce the frequent metadat checks like > EmbeddedSolrConnector.query QUERY: q={!cache=false raw f=id}xXxXxX&rows=1&start=0&fl=id,load_date_dt (p.s. direct servlet queries logged via AccessTracker.addToDump) reger 2016-03-14 22:32:06 +01:00
  • 6783ef5540 move example code SearchClient out of yacycore package to example directory reger 2016-03-14 02:22:06 +01:00
  • 6a8f3f3eba adding Mavens output dir to gitignore reger 2016-03-14 01:17:41 +01:00
  • df80ff3c81 upd Eclipse classpath for slf4j jars reger 2016-03-14 00:57:21 +01:00
  • dce85a72c5 correct "SLF4J: Defaulting to no-operation (NOP) logger implementation" introduced earlier d9036bb9b7 reger 2016-03-13 05:50:51 +01:00
  • b1926d1e98 activate hack in libbuild/pom.xml to include main project as build module This allows to use libbuild/pom as main maven project to build all needed libs to compile and run YaCy, including YaCy itself. reger 2016-03-13 04:03:32 +01:00
  • d9036bb9b7 upd to slf4j-1.7.18 remove direct declaration of slf4j-api in pom (let maven do it's job) reger 2016-03-13 01:34:10 +01:00
  • a9c2f8503e upd to Solr 5.5.0 reger 2016-03-12 22:08:22 +01:00
  • 5ee56ea8e5 del outdated lib/dependencies.txt as alternative you may use maven build site:site goal which produces a complete list of direct and transitive dependencies. reger 2016-03-12 02:12:56 +01:00
  • 567467869e upd to httpclient-4.5.2 reger 2016-03-12 02:00:23 +01:00
  • a57226caa6 put settings_p servlet (back) as start page for System Administration to display the options available (as tables_p only used for indepth edit) see http://mantis.tokeek.de/view.php?id=460 reger 2016-03-12 01:15:05 +01:00
  • f4591b1b51 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git Michael Peter Christen 2016-03-11 18:12:38 +01:00
  • b89465d952 0N - basic dump upload servlet infrastructure, to share index dumps within an experimental new sharing model Michael Peter Christen 2016-03-11 18:12:13 +01:00
  • f12a900f3e harmonization of http post of files for one and several files - this had been differently - and wrong for several files. also: base64-encoding for gzipped push files because our data structures currently only supports ASCII POST pushes.. Michael Peter Christen 2016-03-11 08:59:33 +01:00
  • 1ce38fdaed 0n - added experimental zeronet network which supports intranet peers (still needs work) Michael Peter Christen 2016-03-11 08:55:51 +01:00
  • 849ab671a9 0n: modified the p2p bootstraping process - rules had been too tight and did not support the re-start of a network with just one principal peer. Michael Peter Christen 2016-03-11 08:54:42 +01:00
  • d05ffa1c51 update to seed list Michael Peter Christen 2016-03-11 07:20:38 +01:00
  • 16724c1283 remove unused proxyCookieWhiteList from yacy.init reger 2016-03-11 01:14:54 +01:00
  • 51e7151591 more fixes for sevenZip parser exception on specific archives Found 2 more cases were modified code throws exceptions while original J7Zip unpacks it. Reimplemented error prone CoderMixer2ST from unmodified J7Zip.jar. reger 2016-03-09 01:01:58 +01:00
  • 826e6e5894 remove transitive dependency guava from pom (let Maven do it's job) reger 2016-03-09 00:56:34 +01:00
  • 5b07f3473e fix sevenZip parser exception with LZMA BCJ2 format archives, see http://mantis.tokeek.de/view.php?id=641 + sanitize some type cast's in modified sevenZip lib reger 2016-03-08 00:53:38 +01:00
  • c2a88d53ab fix use of not initialized variable (m_LiteralDecoder) reger 2016-03-06 03:24:09 +01:00
  • 96b8d9b09e moving the J7Zip-modified source and Maven build to libbuild from main pom. Using source included in j7zip-modified.jar. This combines all external lib preparation in the libbuild main pom. reger 2016-03-06 03:19:52 +01:00
  • 764f5100f0 fix delete of temp file after odt % ooxml parser Close zipfile after parsing reger 2016-03-04 23:05:55 +01:00
  • 379e9b330d use supplied url port to get robots.txt in crawlers hostqueue reger 2016-03-02 00:12:34 +01:00
  • ed765de29b adjust start/stop classpath in build script (with servlet classloader no need for htroot in system classpath) reger 2016-02-29 00:04:36 +01:00
  • 9a7efa7814 harmonize classpath with startYaCy.bat (with servlet classloader no need for htroot in system classpath) reger 2016-02-28 22:53:41 +01:00
  • 0dcda3809e harmonize classpath with startYaCy.bat reger 2016-02-28 22:10:43 +01:00
  • 58a959403d fix mixed logfactory in UrlProxyServlet, Class doesn't use functions of declared ancestor, change to extend on httpservlet reger 2016-02-27 03:44:43 +01:00
  • dc112d0e32 upd to slf4j-1.7.16 reger 2016-02-26 00:50:26 +01:00
  • 2494a820c7 0N - added recording of dump exports if given time frame is not negative Michael Peter Christen 2016-02-24 15:13:20 +01:00
  • ef2cc4f690 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git Michael Peter Christen 2016-02-24 11:19:32 +01:00
  • 7b02cacb12 upd to Jetty 9.2.15.v20160210 reger 2016-02-24 02:32:12 +01:00
  • a6bf0b1649 0N - added option to generate index export files for a specific number of minutes in the past and reverted latest change. The export file dump will now contain four data elements: f - first date of index entry write date, l - last date of index write date, n - now-date of index dump time, c - count of numbers inside the dump. '0N' denotes a series of changes which will lead to the opportunity to exchange index data dumps in a way that is needed to integrate ZeroNet index data. This will be based on index dump sharing; that causes this commit. Michael Peter Christen 2016-02-23 18:56:20 +01:00
  • 9312fbe563 making WebStructurePicture_p less vulnerable to faulty host input parameter (like host1,,host3) by continue host loop on exception reger 2016-02-21 21:38:11 +01:00
  • 6d56beaed8 fix assertion exception in toString of MultiProtocolURL toString of AnchorURL and MultiProtocolURL are identical code (no need to override or to protect call to parent) reger 2016-02-21 00:23:00 +01:00
  • b12b8fb1c2 include initial japaneese translation to language selection reger 2016-02-20 23:17:59 +01:00
  • 6a3d27ca5b Merge pull request #44 from ImpactCrater/master Burkhard 2016-02-20 22:43:41 +01:00
  • 42a7bdb2af fix SolrSelectServlet authentication to default to true reger 2016-02-20 22:30:15 +01:00
  • 567c292302 Created a translation file ja.lng ImpactCrater 2016-02-21 03:55:33 +09:00
  • 5b9030180c added peer hash to export dump name. Michael Peter Christen 2016-02-19 19:26:02 +01:00
  • 287b918bd7 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git Michael Peter Christen 2016-02-19 07:52:59 +01:00
  • 20e3c25ae3 upd to weupnp-0.1.4.jar reger 2016-02-18 01:09:29 +01:00
  • dbb28bb4f3 del unused statistic parameter (from status servlet) reger 2016-02-17 22:47:03 +01:00
  • b851308ee6 enhanced robustnes of image computation Michael Peter Christen 2016-02-16 17:36:49 +01:00
  • 06d0e2aeb9 result heuristic (also used in greedy learning mode) to use outbound links if result is full index doc. Otherwise use default loader methode. - Above brought up that parser start url parameter, declared as AnchorURL uses only methodes of parent object DigestURL (changed parameter declaration accordingly). reger 2016-02-16 02:05:58 +01:00
  • caf9e98f09 put metadata dc_publisher in corresponding schema field reger 2016-02-14 21:13:25 +01:00
  • 38e2b054d4 remove servlet classloder internal cache map (to save the resources, cache hits marginal) - DefaultServlet includes already a class cache "templateMethodCache" which is emptied on low mem status - avoid classloader cache gets has no hits but over time holds all (used) servlet classes reger 2016-02-12 01:20:03 +01:00
  • 3f338777f7 Also check and index eventual icon url information from metadata. luc 2016-02-11 09:33:20 +01:00
  • 9f712146df Display icons in ViewFile "links" mode. luc 2016-02-10 10:08:07 +01:00
  • 8682dfbd5e Updated getpageinfo outputs to return page icons list. luc 2016-02-10 09:02:21 +01:00
  • 26f1ead57c Created ViewFavicon class specialized in favicon viewing. luc 2016-02-09 20:46:44 +01:00
  • f2e5b3adb7 format2 otter 2016-02-08 17:47:26 +01:00
  • 000ec16bf8 format otter 2016-02-08 17:44:26 +01:00
  • 6f0b073bf3 override detected language (statistic langdetect) only with TLD determided language if langdetect probability is not high. + additionally truncate zh-cn / zh-tw returned by langdetect to 2 char ISO639-1 zh used by YaCy reger 2016-02-07 21:16:22 +01:00
  • b65e2b527d include use of condenser's content text for language detection. Language identification may show poor performance on documents with short or no title but clear lang indication in text content. Using content text too improves lang detection. + remove double caching of text in Identificator reger 2016-02-07 01:52:32 +01:00
  • 756c55e6d1 upd to Solr 5.4.1 reger 2016-02-06 21:32:54 +01:00
  • c3c5e7928b Correctly handle POSTed parameter also with HTTPS activated otter 2016-02-06 20:22:17 +01:00
  • 07222b3e1a Added favicon url transmission in RWI chunks. luc 2016-02-05 17:05:36 +01:00
  • 480772c070 Fixed json search results from commit "Improved URLLicence reliability" luc 2016-02-05 08:29:41 +01:00
  • 937fbb0b9f correct isHidden() for smb from last commit reger 2016-02-04 19:20:27 +01:00
  • 535d4bf75f respect hidden attribute for file and smb directory listing (hidden directories are not listed, effects crawling of local file system) reger 2016-02-04 19:16:00 +01:00
  • 53781299d8 Extracted intranet and filtype related rules from getFaviconURL func luc 2016-02-04 08:14:49 +01:00
  • cc79ad8de6 compare search page, remove diminished search target (romso.de, dbpedia.neofonie.de ) reger 2016-02-04 00:47:42 +01:00
  • 375d49d536 upd classpath in batches (remove not necessary htroot) see prev commit reger 2016-02-03 21:50:50 +01:00
  • 3cc5619d93 Improved HTML icons indexing and rendering in search results. luc 2016-02-02 09:57:54 +01:00
  • edef6cd0dc Merge branch 'master' of https://github.com/yacy/yacy_search_server luc 2016-02-02 07:58:12 +01:00
  • c28142095a add findClass() to servlet class loader (used in YaCyDefaltServlet) In the 2 cases where servlet calls servlet the jvm classloader chain is invoked and servlet class loaded by jvm loader (successful while requiring htroot in system classpath). This patch uses the standard override design for loaders to handle these cases (making in not longer crucial to have htroot in system classpath, as this classLoader is mainly used for servlets and looks in this case for the class in the configured path). + As the default classloader is parallelcapable we should register this too. reger 2016-02-02 03:44:01 +01:00
  • f6e6250b83 Merge branch 'master' of https://github.com/otteresk/yacy_search_server.git otter 2016-02-01 21:06:00 +01:00
  • 770bb1d41f Improved plotting otter 2016-02-01 21:04:38 +01:00
  • e971f2af4a Merge pull request #3 from yacy/master Andreas 2016-02-01 10:52:49 +01:00
  • db6fc67b77 Merge branch 'master' of https://github.com/yacy/yacy_search_server luc 2016-02-01 08:32:01 +01:00
  • 8e60788c8f fix json date facet displayname reger 2016-01-31 02:38:39 +01:00
  • 46772e08d0 upd to pdfbox 1.8.11 reger 2016-01-31 00:30:39 +01:00
  • f7b854465b Merge branch 'master' of https://github.com/yacy/yacy_search_server luc 2016-01-29 08:20:10 +01:00
  • a6617ad887 expand initRemoteCrawler() to terminate worker threads if called to deactivate remote crawl. On startup we save the resources for remote crawler if disabled. Once started threads are running idle after disable remote crawl. Now threads are terminated to save the resources also while disabeling during runtime. + remove empty class Channels reger 2016-01-28 23:14:09 +01:00
  • e35444dfad Merge pull request #2 from yacy/master Andreas 2016-01-27 17:34:33 +01:00
  • 2048b7e057 support scraping start-/enddate from html tag with property "datetime" This may be used in html5 <time> tag (which we don't explicite support yet for date in content scraping). reger 2016-01-26 21:27:44 +01:00
  • 900d4584ba complet resource cleanup of lists in contentscraper's close() reger 2016-01-25 23:54:20 +01:00
  • 06e5cd6164 add support parsing swf-metadata to swfparser flash supports metadata tag in swf file with metadata in xmp (xml) format. parse some common data to include it in the head section of the html string of converttohtml. reger 2016-01-25 22:13:04 +01:00
  • e0ac26d63e Merge branch 'master' of https://github.com/yacy/yacy_search_server luc 2016-01-25 08:56:18 +01:00
  • 11b1587067 replace remaining use of java.util.Vector by ArrayList (WebCat-swf) reger 2016-01-24 02:30:27 +01:00
  • 9331acdb18 add support for DEFINEFONT3 (swf8) to webcat parser experienced issue with JPEGTABLE tag (with length=0) causing abort of parsing (ioexception) as we don't use/need it for text parsing skip this tag. reger 2016-01-23 22:46:22 +01:00
  • bf5fca5d99 add missing swf tag constants according to latest spec reduce use of synced vector in webcat parser reger 2016-01-23 20:19:01 +01:00
  • aa60ad1dbc Merge branch 'master' of https://github.com/yacy/yacy_search_server luc 2016-01-21 08:12:22 +01:00
  • 1f18653de0 pass parsed swf content trough htmlscraper Swf may contain subset of html tags which shoul'd appear as text. Especially <font> tag may totally screw up metadata servlet if not filtered out. reger 2016-01-21 02:55:05 +01:00
  • 18ecf57792 add support of compressed swf to swfParser from JavaSWF2 (source compatible to WebCat). Moved swf file signature check to parser Changed use of synced vector to list swf InStream reger 2016-01-20 00:58:29 +01:00
  • 5cb7ba0dc4 fix for connections not getting closed to get favicon.ico during seach sixcooler 2016-01-19 20:57:22 +01:00
  • e1dd808e1c fix for 'move test classes to test/java' sixcooler 2016-01-19 20:50:26 +01:00
  • ef83e34b8a Merge branch 'master' of https://github.com/yacy/yacy_search_server luc 2016-01-19 08:06:49 +01:00
  • 6c25710a34 replace bugfixed webcat-swf.jar reger 2016-01-18 23:36:18 +01:00