Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#698

#699

#700

#704

#704

#71

#710

#710

#715

#715

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

Mono Color

• 8d0f3d4208 Removed the Blacklist_p default=shared for new created blacklists issue https://github.com/yacy/yacy_search_server/issues/374 reger24 2022-01-26 14:31:52 +01:00
• 1244aaad6e Merge pull request #447 from WeNeedCoffee/patch-1 Michael Christen 2022-01-26 13:02:05 +01:00
• 6ace9789b5 Merge pull request #448 from WeNeedCoffee/patch-2 Michael Christen 2022-01-26 13:01:29 +01:00
• 3ced06c731 Various javadoc fixes Daleth Darko 2022-01-26 11:22:43 +01:00
• 2954997027 Typos, spelling, and grammar in README.md Daleth Darko 2022-01-26 10:47:13 +01:00
• 242745f622 Updated "To start developing YaCy in Eclipse:" Burkhard 2022-01-26 08:52:57 +01:00
• 255a709a65 Cleanup Gradle local config dir reger24 2022-01-26 07:24:19 +01:00
• 4d8b3311c4 Update to Gradle 7.3.3 reger24 2022-01-26 07:13:42 +01:00
• 6a1e259fd0 Fix NPE in Switchboard . getURL https://github.com/yacy/yacy_search_server/issues/441 reger24 2022-01-26 06:07:38 +01:00
• 3996fb0920 Config Gradle standard distZip/distTar to use legacy archive file name reger24 2022-01-25 16:19:46 +01:00
• 68e5c41385 Fix for upgrade to Gradle 7.3.3 reger24 2022-01-25 14:11:24 +01:00
• 475e1c7907 Fix build error for IntelliJ after fake sourceSet htroot has been add ( dfc7a23e60 ) reger24 2022-01-25 13:18:02 +01:00
• 459dfae4c0 add: To start developing YaCy in IntelliJ IDEA Burkhard 2022-01-25 12:07:52 +01:00
• 6c6cc28c13 Merge pull request #443 from WeNeedCoffee/gradle-idea-patch Michael Christen 2022-01-25 11:50:49 +01:00
• 65034be1ee Fix IntelliJ IDEA prime build error reger24 2022-01-25 09:31:42 +01:00
• e673c3b57f removed redundant line from gitignore Daleth Darko 2022-01-25 07:40:07 +01:00
• dfc7a23e60 Idea project files by Gradle not ANT Daleth Darko 2022-01-25 07:31:51 +01:00
• c49e9039e8 Prevent build script failing on prime build with fresh git clone reger24 2022-01-25 03:46:35 +01:00
• def68aeafa Merge pull request #442 from WeNeedCoffee/idea-patch Michael Christen 2022-01-24 23:18:41 +01:00
• f93c947c0d Idea project files Daleth Darko 2022-01-24 18:13:03 +01:00
• eae16287e9 Added epub (ebook) format to existing zipParser reger24 2022-01-24 13:51:27 +01:00
• a751369246 Further cleaned out transient dependencies + optimizations reger24 2022-01-24 10:37:11 +01:00
• 06cd77f7bc Clean up some transient dependencies reger24 2022-01-23 07:58:33 +01:00
• fa2fd37a48 Added NSIS plugin to Gradle build create Win install executable reger24 2022-01-23 01:48:02 +01:00
• 6dcb58a4b5 Configured Gradle javadoc, added distribution archive for portalsearch reger24 2022-01-22 10:56:11 +01:00
• 2e177661c9 Implement creation of legacy distribution archive in Gradle reger24 2022-01-22 06:27:14 +01:00
• 4df29edd03 Implement the Ant javac task to compile htroot direct in Gradle reger24 2022-01-21 07:42:47 +01:00
• eb69d535a3 Set all dependencies in Gradle build script reger24 2022-01-21 04:53:12 +01:00
• a34d514b4f Fix naming mismatch of build.xml and jar in ./lib reger24 2022-01-20 10:41:53 +01:00
• e39bb5fbab Modified GitRevNr Ant-Plugin to work in Gradle reger24 2022-01-20 09:59:34 +01:00
• 3e34f7c596 Import Ant build.xml into Gradle and use old compile of servlets in Gradle reger24 2022-01-18 20:00:55 +01:00
• 426c47013c Prepare to use Gradle dependencies while mimic current config reger24 2022-01-18 16:02:19 +01:00
• 398b105781 Prevent that YaCy always starts with a exception message on none Apple systems reger24 2022-01-18 13:02:12 +01:00
• 102277e946 Merge branch 'master' of https://github.com/yacy/yacy_search_server reger24 2022-01-18 12:03:46 +01:00
• 6a8d351df3 Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds. reger 2022-01-18 11:55:21 +01:00
• 46cb485e3e Update README.md Burkhard 2022-01-18 11:45:43 +01:00
• d411566c45 Obsolete since replacement of Maven by Gradle build script reger24 2022-01-16 05:36:24 +01:00
• e8a00007f6 add setting for public facing port Lukas Fülling 2022-01-11 17:10:48 +01:00
• c94b9b8197 Merge pull request #439 from otteresk/master Michael Christen 2022-01-10 01:08:56 +01:00
• 590f39b403 Add Sorting functionality to Crawler Queue Table Andreas 2022-01-09 16:06:14 +01:00
• 41e87a44bc Merge pull request #6 from yacy/master Andreas 2022-01-09 15:59:03 +01:00
• 7abfeb221b Merge pull request #436 from ZeroCool940711/master Michael Christen 2021-12-28 02:55:01 +01:00
• 870319e769 Fix typo + remove dead seeds lifeofguenter 2021-12-27 14:12:17 +01:00
• 7e765b8483 Improved the Image search page to have bigger thumbnails, use a bigger area for results and a smaller left sidebar. ZeroCool940711 2021-12-26 23:41:04 -07:00
• 6fe905bb82 feature https://github.com/yacy/yacy_search_server/issues/434 Michael Peter Christen 2021-12-26 23:33:31 +01:00
• d7b17d8935 fixed missing thread name revert after balancer waiting Michael Peter Christen 2021-12-22 01:46:18 +01:00
• 9c38b1254e proper deletion of loadtime index Michael Peter Christen 2021-12-22 01:22:46 +01:00
• bd3f2483a1 replaced url and date retrieval by only url retrieval This should prevent that the search index is used for freshnes of the index entry. Michael Peter Christen 2021-12-20 16:23:05 +01:00
• 163ba26d90 replaced check for load time method instead of loading the solr document, an index only for the last loading time was created. This prevents that solr has to fetch from its index while the index is created. Excessive re-loading of documents while indexing has shown to produce deadlocks, so this should now be prevented. Michael Peter Christen 2021-12-20 03:47:56 +01:00
• 1ead7b85b5 remove compiler warning "warning: [try] explicit call to close() on an auto-closeable resource" Michael Peter Christen 2021-12-13 12:28:34 +01:00
• 3dc6613096 updating slf4j 1.7.25 -> 1.7.32 Michael Peter Christen 2021-12-13 12:26:49 +01:00
• cd0ff48e99 there is no (more) log4j in YaCy Michael Christen 2021-12-12 13:53:19 +01:00
• 59777010dc Merge branch 'master' of git@github.com:yacy/yacy_search_server.git Michael Peter Christen 2021-11-18 00:49:56 +01:00
• 7898815c41 disabling concurrent logging (maybe temporary) Michael Peter Christen 2021-11-18 00:49:46 +01:00
• 4bf6954474 uses clientBuilder not HttpClients.custom() to have these inside the Pool too sgaebel 2021-10-31 19:08:20 +01:00
• cdf901270c always use HTTPClient by 'try with resources' pattern to free up resources sgaebel 2021-10-31 18:47:10 +01:00
• 69adaa9f55 makes our HTTPClient closable sgaebel 2021-10-31 15:07:17 +01:00
• fc4275f901 handle all references for client, response, request to be able to close them sgaebel 2021-10-31 14:53:40 +01:00
• 1cdc55a425 lets SOLR merge bigger segments (up to 50GB) + some setting to reduce caches sgaebel 2021-10-31 11:33:42 +01:00
• e7d3a363f2 refactor to use finish() sgaebel 2021-10-31 00:49:54 +02:00
• 4fc876f4a3 revert back to use EntityUtils.consumeQuietly - as it simply closes the underlying stream sgaebel 2021-10-31 00:27:10 +02:00
• 4f0392e93e refactor use of AuthSchemeProvider sgaebel 2021-10-30 21:07:26 +02:00
• b74f337859 removes double setting of UserAgent sgaebel 2021-10-30 20:07:36 +02:00
• 965748fefb some refactoring using try with resources sgaebel 2021-10-30 16:15:57 +02:00
• f4834e8e31 link fix Michael Christen 2021-10-29 11:10:23 +02:00
• 7f5d3e3a12 fixed name Michael Christen 2021-10-29 11:07:34 +02:00
• 552ab7051b fix for warc importer Michael Peter Christen 2021-10-25 19:35:15 +02:00
• 3c86b7b780 attempt to make a Mac Release using gradle This is almost working with many workarounds: - run rm lib/yacycore.jar - run ./gradlew clean build bundleNative - run ant clean all - run again rm lib/yacycore.jar - run ./fixMacBuild.sh Michael Peter Christen 2021-10-25 18:37:39 +02:00
• 49cae8ca62 network bootstraping addresses update Michael Peter Christen 2021-10-25 18:32:57 +02:00
• 8e4383c49e downgrading gradle to 6.9 to be able to support org.mini2Dx.parcl Michael Peter Christen 2021-10-25 18:32:34 +02:00
• 999c819e3e Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2021-10-24 20:50:14 +02:00
• fd770e90e2 spike to identify paths for YaCy within mac application bundles Michael Peter Christen 2021-10-24 20:49:59 +02:00
• d19872fd26 making sure that crawl queues are closed correctly to prevent data loss Michael Peter Christen 2021-10-14 00:30:04 +02:00
• 90507c0fdc comments out printing query params to std.out sgaebel 2021-10-04 18:03:06 +02:00
• be0aebad84 fixes https://github.com/yacy/yacy_search_server/issues/424 Michael Peter Christen 2021-10-04 14:38:49 +02:00
• 63ad8ce6b2 removed ymarks had not been used since a long time Michael Peter Christen 2021-09-16 22:23:51 +02:00
• ef5a71a592 enhanced crawl start response time for very very large crawl start lists Michael Peter Christen 2021-09-16 21:01:01 +02:00
• 1bab4ffe20 calculating the correct size of an export. This can be seen as a fix for https://github.com/yacy/yacy_search_server/issues/343 however, the export was not flawed, it is just the impression that something is wrong, but the export size must be smaller than the index size because the index also containers error documents. Now an information line is presented that shows i.e.: "The local index currently contains 181,319 documents, only 106,887 exportable with status code 200 - the remaining are error documents." Michael Peter Christen 2021-09-16 01:05:09 +02:00
• 4cadd557dc removed synchronization in table creation to avoid possible deadlocks when handling OnDemandOpenFileIndex which happens quite often during wide crawling Michael Peter Christen 2021-09-15 19:34:49 +02:00
• 8084960392 disabled citation index that was created but never used Michael Peter Christen 2021-09-15 18:46:37 +02:00
• 9b7668fa58 reduced memory footprint during indexing/crawling admin 2021-08-24 12:24:52 +02:00
• fbf8ddd32d upgrade of jsoup 1.12.1 -> 1.14.2 admin 2021-08-24 12:23:57 +02:00
• 53518a91ab In case of reload404, load only failed documents Ian Smirlis 2021-08-19 20:49:59 +03:00
• 4c889b7ff9 fixed build paths Michael Peter Christen 2021-08-18 19:05:44 +02:00
• 683cac125f updated bouncy castle 1.60 -> 1.69 Michael Peter Christen 2021-08-17 15:48:54 +02:00
• e6a87e0426 enhanced crawler a main problem when crawling is long waiting time cuased by crawl-delay values from robots.txt entries. that attribute is not supported by google and interpreted by yandex and bing in different ways. In large crawls there is always one host which blocks the whole crawl with extreme large values. YaCy now still obeys crawl-delay but limits them to 10 seconds. Additionally the blocking logic when loading new robots.txt was analyzed and a deadlock was removed. Furthermore the construction of new queue lists was redesigned and it was ensured that always a large list of different hosts for host-balancing is provided for the loader. Michael Peter Christen 2021-08-17 15:23:21 +02:00
• e9c5e78868 replaced new Number(Number) with Number.instanceOf to remove deprecation warnings for Java 9 Michael Peter Christen 2021-08-08 00:39:03 +02:00
• 9e13d77de4 removed call to class.finalize() because of deprecation in java 9 next: removal of finalize() implementation after testing with assert false Michael Peter Christen 2021-08-07 18:57:49 +02:00
• 9ef4503672 fixed some newInstance() warnings .. by adding .getDeclaredConstructor() Michael Peter Christen 2021-08-07 18:46:53 +02:00
• 82df012442 removed old lib Michael Peter Christen 2021-08-07 18:23:22 +02:00
• 8a2adb2b15 upgraded commons-compress lib cause: alert in https://github.com/yacy/yacy_search_server/security/dependabot/pom.xml/org.apache.commons:commons-compress/open Michael Peter Christen 2021-08-07 18:21:54 +02:00
• 9182b3dfca enhanced default value Michael Peter Christen 2021-08-05 09:18:05 +02:00
• 294d56d4a2 addressing better GC behavior after removing Xms with earlier heap increase strategy Michael Peter Christen 2021-08-05 09:16:52 +02:00
• 3959d43a5c fixed doku link Michael Peter Christen 2021-08-03 16:57:24 +02:00
• c4659f0fb0 removed Debian and Red Hat build process as announced in https://twitter.com/yacy_search/status/1414608643241152516 because of lack of community support for these kind of distributions. We will still support tarball, Windows, Mac and Docker releases. Michael Peter Christen 2021-07-19 20:33:52 +02:00
• 73360ed52b add gradle to gitignore Michael Peter Christen 2021-07-19 20:12:03 +02:00
• 15b7461bc7 removed Xms java memory startup parameter We will use the default value for now on. This is much better for resource economy and fits better into a container/docker/kubernetes strategy. Furthermore, a small memory footprint is essential for the usage on small devices like RaspberryPi. Michael Peter Christen 2021-07-19 20:04:11 +02:00
• c3b3087077 gradle cleanup admin 2021-07-14 14:07:49 +02:00
• a13986d659 replaced maven with gradle admin 2021-07-14 13:58:30 +02:00
• 1d41380f0a better support for mac-specific tray functions in java 9 Michael Peter Christen 2021-07-12 17:27:59 +02:00