yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-03 23:26:12 -05:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#721

#722

#730

#734

#737

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

86b5094970 Fix numbered page navigation from getting corrupted when statistics() runs. JeremyRand 2017-09-03 18:03:48 +00:00
a888254769 Add UI for numbered page navigation when Javascript re-sorting is enabled. JeremyRand 2017-09-03 18:09:44 +00:00
74333c931e Fix the sidebar item "Wiki Name Space" with Javascript re-sorting. JeremyRand 2017-04-03 03:33:10 +00:00
4a9e64caea (WIP) Add numbered page navigation when Javascript re-sorting is enabled. JeremyRand 2017-04-03 03:18:16 +00:00
6ec256dc34 (WIP) Fix the sidebar when Javascript resorting is in use. JeremyRand 2017-04-03 02:32:09 +00:00
d37df75afa (WIP) Optionally sort HTML search items via Javascript. JeremyRand 2017-09-03 17:50:08 +00:00
61be709a97 Add data-ranking attribute to each HTML search item. JeremyRand 2017-08-28 14:33:53 +00:00
8e4f31bdc7 Updated internal ISO 639-1 language codes with latest standards. luccioman 2017-09-02 09:53:38 +02:00
a28428047a Fixed count of filtered results from local solr. luccioman 2017-08-31 11:24:59 +02:00
30c2f50e0b Use final results counts in progress bar detailed statistics. luccioman 2017-08-31 07:37:24 +02:00
2f71005a93 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2017-08-30 23:51:44 +02:00
2314f8e358 try to fix problem with error description http://forum.yacy-websuche.de/viewtopic.php?f=5&t=6023&p=33889&sid=37bc7aa029422be571b9266cdef43c52#p33889 Michael Peter Christen 2017-08-30 23:50:14 +02:00
3c9df6e0ce Use local solr filtered results in total search results count. luccioman 2017-08-30 12:23:45 +02:00
8b25b485eb Make result action links visible when focusing them with keyboard. luccioman 2017-08-29 08:16:12 +02:00
3e933979df Removed duplicate HTML class attribute. luccioman 2017-08-29 07:39:12 +02:00
ce22076920 Fixed Unresolved_Pattern occurence on results favicon HTML id. luccioman 2017-08-29 07:32:33 +02:00
a1a0515312 Added a button to manually refresh sorting of p2p search results. luccioman 2017-08-28 19:03:51 +02:00
31c99b2a8a update master.lng, RankingSolr_p.html text reger 2017-08-27 04:22:39 +02:00
4eba88f2ff Removed some unnecessary uses of java.lang.reflect api. luccioman 2017-08-24 18:47:18 +02:00
da3dbf9ea1 Use Javadoc style comments on SearchEvent properties. luccioman 2017-08-23 08:20:37 +02:00
c6ae87168a Added unit tests on the gzip parser. luccioman 2017-08-22 14:13:00 +02:00
169ffdd1c7 Finer control on max links to parse in the html parser. luccioman 2017-08-22 14:11:35 +02:00
4743a104b5 Added some unit tests on FileUtils. luccioman 2017-08-22 14:06:09 +02:00
e41d046a9d Improved parsing support for OOXML spreadsheets (.xlsx) luccioman 2017-08-21 09:38:20 +02:00
51a4e03c93 Allow to stop currently running warc import (stop button) reger 2017-08-20 22:17:27 +02:00
6cec2cdcb5 Use unredirected robots.txt URL when adding an entry to the table. luccioman 2017-08-16 14:21:07 +02:00
3f0446f14b Ensure proper synchronous robots entry retrieval on first check. luccioman 2017-08-16 09:30:33 +02:00
9da75ac76d Upgraded Docker base image from deprecated java to openjdk. luccioman 2017-08-15 21:04:36 +02:00
b23a563065 Prevent search result failure on incomplete images information. luccioman 2017-08-15 10:11:05 +02:00
30d71c6359 added usage of X-Real-IP http header to identify request IPs which came through NGINX reverse proxy configurations Michael Peter Christen 2017-08-15 07:16:01 +02:00
f45378c11c Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2017-08-14 20:12:26 +02:00
7f395ef937 added image link in search results This should be a help to make a preview of search results. The image is computed from the list of embedded images, it is always the first image in that list. In rss-type results the image is presented like <media:content medium="image" url="https://abc.xyz/logo.png"/> as defined in http://www.rssboard.org/media-rss#media-content Michael Peter Christen 2017-08-14 20:12:09 +02:00
780173008e Implemented partial stream parsing of tar archives. luccioman 2017-08-14 14:57:58 +02:00
acab6a6def Also handle text content when parsing XML within limits. luccioman 2017-08-14 14:47:01 +02:00
f38fb7f02c Add junit test for AbstractOperations.addOperand() reger 2017-08-14 02:16:43 +02:00
2a07799ad1 Correction of d03e2c98ea Fix Conjunction.addOperator to do nothing if term is empty prevent to result in query string with repeated logical operator like "field:term AND AND field:term" possibliy causing out of mem in postprocessing_doublecontent reger 2017-08-14 01:03:15 +02:00
d03e2c98ea Fix Conjunction.addOperator to do nothing if term is empty prevent to result in query string with repeated logical operator like "field:term AND AND field:term" possibliy causing out of mem in postprocessing_doublecontent reger 2017-08-14 00:52:03 +02:00
b6a41df4f7 Remove deprecated YaCyProxyServlet was replaced by UrlProxyServlet reger 2017-08-12 21:53:04 +02:00
8a94fef9e0 Prevent unwanted cached bytes duplication on stream parsing. luccioman 2017-08-12 09:43:49 +02:00
ed678186a8 Updated xml parser limited parsing test for use latest jdk. luccioman 2017-08-12 09:42:06 +02:00
366ceae35a Fixed missing transitive dependency to commons-collections4-4.1 luccioman 2017-08-11 20:50:36 +02:00
bf72cbffa3 Updated debian package configuration to match new Java 1.8 target luccioman 2017-08-11 20:34:59 +02:00
119b65389d upde to icu4j-59_1.jar reger 2017-08-10 23:57:37 +02:00
4979439e87 Skip public post of jre version. Added to determine switch to java8 596b5dfa59 reger 2017-08-06 23:41:53 +02:00
e918ec199e Replace deprecated ConcurrentHashSet with recommended Java8 ConcurrentHashMap.newKeySet() in postprocessDocuments() reger 2017-08-06 23:26:27 +02:00
fb71994342 Harmonizing use of xml reader / sax parser in XMLBlacklistImporter eliminating the need for lib/xercesImpl.jar reger 2017-08-05 23:47:27 +02:00
275d65fffe Patch last_modified date with internal FirstSeenTime() if no date provided to make sure updated documents are indexed with their last-modified date as provided in current crawl. (to patch moddate always with firstseen might bear the risk of miss actual updates). reger 2017-08-05 22:30:06 +02:00
d1b23afed6 Remove obsolete Protocol parameter ttl (time to live) not interpreted in target yacy/query.html also Protocol.querySeed() not used and parameter not interpreted in target servlet yacy/query.html reger 2017-08-01 00:59:53 +02:00
dedc6552d3 upd to poi-3.16.jar reger 2017-07-31 23:38:10 +02:00
15d78b1064 Replace deprecated getIP with getIPs in Protocol transferURL() and getProfile(). Remember used ip for error handling and departInterface reger 2017-07-31 01:55:01 +02:00
ed36b47bec Replace one more deprecated peerDeparture in Protocol.transferIndex() by moving/using interfaceDeparture() in transferRWI() reger 2017-07-30 23:02:15 +02:00
37f44941fb upd to pdfbox-2.0.7.jar reger 2017-07-30 20:09:06 +02:00
41616de0b8 Add SolrConfig ClassicIndexSchemaFactory to prevent Solr startup warning. This overrides Solr default to use managed schema. As we don't use programatic schema changes this directs Solr to use schema.xml, eliminating the warning. reger 2017-07-23 03:55:56 +02:00
0ee8c030c4 Log an error when Solr folder migration fails for some reason. luccioman 2017-07-17 15:35:10 +02:00
44d455dfed upd to jwat-warc-1.1.0.jar reger 2017-07-16 23:37:28 +02:00
588c6e96fb upd version for typeahead.jquery.js in jslicense.html reger 2017-07-16 23:35:56 +02:00
5a646540cc Support parsing gzip files from servers with redundant headers. luccioman 2017-07-16 14:46:46 +02:00
11a7f923d4 Distinguish response parsing failures from unexpected exceptions. luccioman 2017-07-16 14:39:53 +02:00
8100c033a2 URL Viewer : apply crawler size limits when adding to local index. luccioman 2017-07-16 14:37:06 +02:00
eda7b0aeb6 Merge branch 'master' of https://github.com/yacy/yacy_search_server luccioman 2017-07-15 08:49:25 +02:00
3005be7349 Clean up unmaintained and unused AugmentParser trail. reger 2017-07-15 00:19:23 +02:00
e5cff062b5 Clean up redundant but obsolete jquery.rdfquery-core-1.0.js script lib reger 2017-07-14 23:41:39 +02:00
cb4f1358e1 Added gzip parser support for max content bytes limit luccioman 2017-07-13 08:18:40 +02:00
5216c681a9 Added HTML parser support for maximum content bytes parsing limit luccioman 2017-07-13 08:12:10 +02:00
4aafebc014 Merge pull request #122 from Scarfmonster/patch-1 luccioman 2017-07-12 16:03:23 +02:00
651fad6da5 Added RSS parser support for maximum content bytes parsing limit luccioman 2017-07-12 00:18:12 +02:00
452a17a8d5 Finer control on bounded input streams with custom stream implementation luccioman 2017-07-12 00:13:24 +02:00
f8f1959ebb Added parsing within bounds implementation to the generic parser. luccioman 2017-07-11 09:07:48 +02:00
e0f400a0bd Support trying multiple parsers even when streaming on large resources. luccioman 2017-07-11 09:06:37 +02:00
1e84956721 Support loading local files with a per request specified maximum size. luccioman 2017-07-11 09:04:23 +02:00
f369679d1c Fixed read/copy on input streams reading sometimes less than expected. luccioman 2017-07-11 09:00:27 +02:00
23bda133d2 Fix css conflict of YMarks.html to make it viewable. yacy-ymarks.css sidebar conflicts with bootstraps sidebar (different overlay settings). Simply renamed it to ymark-sidebar. reger 2017-07-09 23:08:54 +02:00
af32d291c2 upd to commons-fileupload-1.3.3.jar reger 2017-07-08 23:46:10 +02:00
a21789d4e7 Fix unresolved pattern in api/share.html by init some display var's reger 2017-07-08 22:46:15 +02:00
bf55f1d6e5 Started support of partial parsing on large streamed resources. luccioman 2017-07-08 09:04:03 +02:00
2a87b08cea Removed temporary html parser test code luccioman 2017-07-03 14:53:36 +02:00
1b3c169a9c URL Viewer : decode raw text using the eventual response charset. luccioman 2017-07-03 13:51:14 +02:00
90a7c1affa HTML parser : removed unnecessary remaining recursive processing luccioman 2017-07-03 10:00:53 +02:00
e6e20dab52 upd to Jetty 9.4.6.v20170531 Modify loginservice to the changes in Jetty, partially based on pull request #101 https://github.com/yacy/yacy_search_server/pull/101 bu @automenta reger 2017-07-01 23:58:28 +02:00
e4c730b99f Updated PerformanceQueues_p.xml API with last related servlet changes luccioman 2017-06-30 11:41:48 +02:00
dcc56318bb Made remote search max system load limits configurable from UI. luccioman 2017-06-30 11:30:54 +02:00
ddd13b776d Add keyword constraint to rwi query result filter To discard rwi results not matching query keyword: parameter reger 2017-06-30 02:11:18 +02:00
e82eaee4b6 Apply consistent behavior on HTTP resource size exceeding limit. luccioman 2017-06-30 01:13:47 +02:00
0b75e92ac2 Do not wrap unnecessarily loader IOExceptions in IOExceptions luccioman 2017-06-30 01:06:17 +02:00
433bdb7c0d Respect maxFileSize limit also when streaming HTTP and when relevant. luccioman 2017-06-30 00:30:54 +02:00
4b72b29ea2 Added an informative title on the crawl start robots.txt status icon luccioman 2017-06-29 11:36:47 +02:00
d08f31c3a8 Crawl start Ajax request : properly handle eventual XML parsing errors luccioman 2017-06-29 11:25:27 +02:00
9b1bb2545e Refactored plain-text URLs detection implementation. luccioman 2017-06-27 19:30:40 +02:00
8da3174867 Ensure lower case conversion consistency with any default locale. luccioman 2017-06-27 06:42:33 +02:00
286f3018bd Made mime type and extension normalization locale independent. luccioman 2017-06-26 17:33:56 +02:00
319231a458 Added a generic XML parser, able to parse elements text and URLs. luccioman 2017-06-26 16:30:21 +02:00
aeeb8a7dd5 upd to jwat-warc-1.0.6.jar reger 2017-06-25 20:05:37 +02:00
f0ba828627 remove unused Solr optional extra handler lib solr-dataimporthandler-6.6.0.jar reger 2017-06-24 23:15:25 +02:00
1773b61b3e upd to jsoup-1.10.3.jar reger 2017-06-24 22:54:43 +02:00
3cedbbd4ed Wrong password was removed after the SSL certificate import Ryszard Goń 2017-06-23 02:23:49 +02:00
64cec2790d Improved character encoding detection from Content-Type header luccioman 2017-06-22 10:50:34 +02:00
1acb7005d0 Added a basic JUnit test with test gz files for the gzip parser luccioman 2017-06-21 09:14:50 +02:00
1e2fb76720 Properly close test files in htmlParser unit test luccioman 2017-06-21 09:11:17 +02:00
c41b31dcb3 Cleaned up memory usage page HTML luccioman 2017-06-20 09:21:55 +02:00
0487336ec3 Prevent integer overflow in table statistics and use strong typing luccioman 2017-06-19 17:02:11 +02:00