Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-03-11 13:21:11 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • d0ac1a9737
         Merge 6bec159f60 into 4953151f6f Charlie Root 2025-02-22 11:16:50 +0000
  • 6bec159f60
         flake: drop flake-utils as a dependency Charlie Root 2025-02-22 12:14:49 +0100
  • 5b296b15bd Added Inno files for windows installer smokingwheels 2025-01-05 22:31:31 +0800
  • d1508b91dd Fix for AppImage smokingwheels 2025-01-05 15:50:26 +0800
  • 4967b2e0e8
         Merge branch 'yacy:master' into master smokingwheels 2025-01-05 10:31:19 +0800
  • 4953151f6f
         Merge pull request #670 from okybaca/startfix master Michael Christen 2025-01-03 13:00:16 +0100
  • 4e4d57a16f
         Merge pull request #672 from okybaca/kellogs Michael Christen 2025-01-03 12:59:21 +0100
  • e78d40fa02 Increase threadpoolexcutor to 30000 smokingwheels 2025-01-03 09:36:31 +0800
  • 89b3c7e8b2 Added Java17 with QB64 Windows installer smokingwheels 2025-01-02 14:22:50 +0800
  • 45f3ae166f changed bat to cmd smokingwheels 2025-01-02 11:46:28 +0800
  • 39218b74b1 modified kelondro so it uses KELONDRO prefix when logging okybaca 2024-12-24 00:54:23 +0100
  • 4b6ec7a131 if java executable not found using 'which', try to use 'command' okybaca 2024-12-13 02:09:55 +0100
  • d2d152f827
         Merge 0fb77994aa into 3ede322f5e ah9807073 2024-12-04 09:05:05 +0100
  • 3ede322f5e
         Merge pull request #666 from okybaca/eldarskinfix Michael Christen 2024-12-02 22:12:23 +0100
  • e979b32374 fine tuned the dark-green skin - tables font color okybaca 2024-11-29 13:39:34 +0100
  • 9f20f73362 library maintenance - updated some libraries Michael Peter Christen 2024-11-28 22:55:48 +0100
  • 51c612f845
         Merge pull request #657 from codymikol/nixify Michael Christen 2024-11-25 12:42:25 +0100
  • 0d58f60f45
         Merge pull request #664 from okybaca/log-kelo Michael Christen 2024-11-25 12:40:34 +0100
  • 54fa724352 reverted deprecation change since we are still using java 11, not 19 Michael Peter Christen 2024-11-25 12:34:05 +0100
  • 6ef3a0fca5 code maintenance - removed warnings and replaced deprecated functions Michael Peter Christen 2024-11-25 12:29:11 +0100
  • 91c753ab96 renamed INDEX-TRANSFER-DISPATCHER to DHT-OUT in the log okybaca 2024-11-25 01:23:57 +0100
  • feca150672 Automatically adjust crawling load limit to the local machine cpu cores The settings in the default configuration file is historic. Many machines have much more CPU cores today and now an auto-scaling to this hardware is better. Michael Peter Christen 2024-11-25 00:30:36 +0100
  • 16e031caeb added hint in README to install Ivy from archived updatesite. Michael Peter Christen 2024-11-24 23:59:27 +0100
  • 7e8a1ef0e2 log file when OOM appears Michael Peter Christen 2024-10-18 14:25:42 +0200
  • 3c88f87831 jetty upgrade Michael Peter Christen 2024-10-17 11:36:51 +0200
  • a8c64b1af2 added an artificial snippet [Synonym Match] in case that there is only a match in the synonyms] Michael Peter Christen 2024-09-21 21:56:12 +0200
  • f57df061da upgraded commons-io to 2.17.0 Michael Peter Christen 2024-09-21 21:56:12 +0200
  • c88c30a5c5 added an option to ViewFile to see all solr fields which contain texts Michael Peter Christen 2024-09-21 21:51:19 +0200
  • 0fb77994aa Add Dockerfile for YaCy deployment Agent001 2024-09-20 11:51:47 +0000
  • 7b108dadf7 Update vercel.json for correct deployment Agent001 2024-09-20 11:40:05 +0000
  • 1cabc452b5 Add vercel.json for Vercel deployment Agent001 2024-09-20 10:51:41 +0000
  • c6127e4f2e feat(nix): add a nix flake Cody Mikol 2024-08-30 20:41:09 -0400
  • 6db374fdcf upgraded metadata-extractor to 2.19.0 Michael Peter Christen 2024-08-26 23:49:27 +0200
  • 3944984840 added snippet extraction with synonym matching Michael Peter Christen 2024-08-26 23:44:42 +0200
  • d181b9e89b added deleted files from commit 254f12d60b which are still needed and had been linked outside of yacy/ui Michael Peter Christen 2024-07-24 15:57:51 +0200
  • 910a496c9f replaced http links with https Michael Peter Christen 2024-07-21 18:02:58 +0200
  • fd45ccf76e added sponsoring images Michael Peter Christen 2024-07-21 17:25:22 +0200
  • 833d720989 upgraded ppt parser by migration of org.apache,poi from 3.17 to 5.3.0 This also fixes the security waning https://github.com/yacy/yacy_search_server/security/dependabot/37 Michael Peter Christen 2024-07-21 15:28:13 +0200
  • 687820788d this assert does not work because of the 9_0_0 solr version format. An 9_0 is expected but it does not work this way with this version. Michael Peter Christen 2024-07-21 13:33:47 +0200
  • accf4e424b
         Merge pull request #649 from virginOne/master Michael Christen 2024-07-10 16:36:54 +0200
  • 2f5f3f8853
         Merge pull request #650 from zutto/master Michael Christen 2024-07-10 16:35:39 +0200
  • 326b5f6e6e
         Merge pull request #651 from okybaca/removeui Michael Christen 2024-07-10 16:34:07 +0200
  • 254f12d60b removed yacy/ui as obsolete okybaca 2024-07-09 16:26:50 +0200
  • 5268ae2ce9 check the document protocol & host values before proceeding to form final url. zutto 2024-06-29 10:11:58 +0300
  • 962aaec0c0 Improve the clarity of deep crawl feature UI text on AutoCrawler zutto 2024-06-29 09:37:05 +0300
  • d958d1c0c4 ensure that returned SolrDocument is not null zutto 2024-06-29 09:33:06 +0300
  • f3cc818305
         Merge branch 'yacy:master' into master virginOne 2024-06-23 19:52:54 +0800
  • 66cf7d4ca5 disables autowarm of filtercache, corrects luceneMatchVersion sgaebel 2024-06-12 12:59:34 +0200
  • 89c07f0900 Fix the issue of not being able to import the JSON format export of Solr index due to the inconsistency in time format between the exported JSON format and the Solr time format. Virgo 2024-06-19 21:14:45 +0800
  • 70454654f3 by default open the https url for a given host, not the http url (http does almost not exist any more) Michael Peter Christen 2024-05-27 00:53:18 +0200
  • 71a6074cc5 added setting of cache configuration for solr according to recommendation from https://community.searchlab.eu/t/yacy-support-gpt-chatgpt-assistant/1622 However it is not clear if this configuration actually works (has an effect at all) or is the solution for performance issues. Michael Peter Christen 2024-05-26 12:59:59 +0200
  • b8479430b6 400 is too small Michael Peter Christen 2024-05-25 01:21:06 +0200
  • 5f4ea9ac5d reduced memory amount for network image reduced also the number of memory allocation for image storage Michael Peter Christen 2024-05-25 01:10:23 +0200
  • fe4c0aa890 refactoring of RAG reverse proxy: extracted code for ollama code to their own classes Michael Peter Christen 2024-05-21 00:06:19 +0200
  • 8b65a4d14e fixed build clean Michael Peter Christen 2024-05-19 18:02:49 +0200
  • f1c70dce33 Merge branch 'master' of github.com:yacy/yacy_search_server Michael Peter Christen 2024-05-19 17:35:24 +0200
  • 8eb0d490aa migrated solr to 9.0 This is a major step because solr removed support for embedded solr instances in 9.0 and we want to keep it because we want to ship YaCy with an embedded solr. It was necessary to add parts of solr code into YaCy to make this migration possible. Further on with Solr 9.1 they removed even more parts which are required for embedded operation, therefore we cannot migrate yet further without big changes. If you are running a YaCy instance with Solr 8.x, the migration should be done automatically. If not you require to first migrate to a YaCy version 1.93 with Solr 8.x to migrate to Solr 8 data. Michael Peter Christen 2024-05-19 17:34:57 +0200
  • b8417e5619 removed Mac specific code which is not working any more on recent Macs Michael Peter Christen 2024-05-19 17:29:16 +0200
  • 13fbff0bff Added a RAG Proxy for AI Chat with YaCy Michael Peter Christen 2024-05-19 17:19:09 +0200
  • 59c0cb0f30 fixed aarch64 dockerfile Michael Peter Christen 2024-05-13 02:10:24 +0200
  • 0405ec8ad2
         Merge pull request #642 from HeliosLHC/reduce_image_size Michael Christen 2024-05-12 23:50:24 +0200
  • c2ad1950e8 updated jetty to 9.4.54.v20240208 Michael Peter Christen 2024-05-10 15:41:20 +0200
  • b295e38969 fine-tuned the import process of jsonl files which had been missing to actually be able to make searches and browse the index with the host browser Michael Peter Christen 2024-05-10 12:13:44 +0200
  • 262b23532d reduce image size HeliosLHC 2024-05-05 23:23:34 +0200
  • de941c6fee
         Merge pull request #633 from LillySchramm/fix/632/remove-sayat-link Michael Christen 2024-04-05 17:43:55 +0800
  • 160e346d4c fix: Remove SayAt.Me Link EPS-DEV 2024-04-04 15:05:41 +0000
  • 656d47c1ac
         Merge pull request #628 from frankenstein91/vagrant Michael Christen 2024-02-27 14:18:24 +0100
  • 9a406d310c
         switch user Frank Tornack 2024-02-04 19:36:48 +0100
  • 6864486196
         add Yacy vagrant Frank Tornack 2024-02-04 19:29:16 +0100
  • 331e0a24fc
         Merge pull request #621 from OFA54/patch-1 Michael Christen 2023-12-20 23:34:35 +0100
  • d825a85a01
         Merge pull request #619 from pr0vieh/initrecrawl Michael Christen 2023-12-09 14:47:13 +0100
  • 35620762ac bring defaults for recrawlindex to init config pr0vieh 2023-12-09 01:32:31 +0100
  • d097a642c2
         Merge pull request #615 from okybaca/logging2 Michael Christen 2023-12-03 16:40:21 +0100
  • 6d5e9ff53f
         Merge pull request #616 from okybaca/logging3 Michael Christen 2023-12-03 16:39:29 +0100
  • d5d4e8fe3a
         Merge pull request #617 from pr0vieh/master Michael Christen 2023-12-03 16:38:46 +0100
  • dfb2b79609 Add setting for DHT receive loadprereq insted of hardcoded load < 2.0 pr0vieh 2023-12-03 01:27:36 +0100
  • 5dee8dbcbd changed the log entry REJECTED to CRAWLER * REJECTED, loglevel fine okybaca 2023-12-02 12:24:36 +0100
  • 4c603e23f0
         Merge pull request #610 from okybaca/cr-text Michael Christen 2023-11-27 12:17:05 +0100
  • 040cd8be6d
         Merge pull request #612 from okybaca/sitemap-fix Michael Christen 2023-11-27 12:16:43 +0100
  • 0233ecd481
         Merge pull request #614 from okybaca/logging Michael Christen 2023-11-27 12:15:34 +0100
  • 7831f294a9 changed regular peerping messages to level fine okybaca 2023-11-27 08:12:03 +0100
  • 553c859703 logging: moved some log-cluttering DHT messages to level 'fine' okybaca 2023-11-27 07:51:42 +0100
  • 1c5fca9a58 changed network operation log category from YACY to NETWORK okybaca 2023-11-26 12:24:09 +0100
  • 2f44fc0257 added some logging prefixes to yacy.logging okybaca 2023-11-25 18:39:08 +0100
  • 89c2a92cfb
         tr.lng OFA 2023-11-18 01:03:28 +0300
  • 3d3bdb0f5f added zim importer rule for mdwiki Michael Peter Christen 2023-11-16 23:11:57 +0100
  • 4a611ac6a3 another possible fix for https://github.com/yacy/yacy_search_server/issues/500 Michael Peter Christen 2023-11-15 23:45:53 +0100
  • 9c59c6814b updated apache libs okybaca 2023-11-15 10:22:00 +0100
  • d72cd7916c Merge branch 'master' of https://github.com/yacy/yacy_search_server sgaebel 2023-11-14 20:43:42 +0100
  • 0663ae3c99 adds synchornized dumplog sgaebel 2020-12-01 22:34:30 +0100
  • cba84632ee UI: added a more descriptive message, CitationRank instead of cr okybaca 2023-11-14 00:05:23 +0100
  • cff0991d85 test if this is helpful for https://github.com/yacy/yacy_search_server/issues/500 Michael Peter Christen 2023-11-13 16:41:19 +0100
  • ceb07a5218 fixed problem with zim importer which crashed when non-valid urls appeared Michael Peter Christen 2023-11-13 11:12:10 +0100
  • 656b3e3e77 updated guava to latest and added missing library for failureaccess Michael Peter Christen 2023-11-13 10:59:49 +0100
  • 3268a93019 added a 'minified' option to YaCy dumps Michael Peter Christen 2023-11-13 10:27:50 +0100
  • c20c4b8a21 modified export: added maximum number of docs per chunk The export file can now be many files, called chunks. By default still only one chunk is exported. This function is required in case that the exported files shall be imported to an elasticsearch/opensearch index. The bulk import function of elasticsearch/opensearch is limited to 100MB. To make it possible to import YaCy files, those must be splitted into chunks. Right now we cannot estimate the chunk size as bytes, only as number of documents. The user must do experiments to find out the optimum chunk max size, like 50000 docs per chunk. Try this as first attempt. Michael Peter Christen 2023-11-12 22:11:55 +0100
  • 655d8db802 detailed directions in index export to explain how the export can be imported again using elasticsearch/opensearch Michael Peter Christen 2023-11-12 15:26:18 +0100
  • 24011dcbcc more file name extensions for json list surrogate files Michael Peter Christen 2023-11-06 22:44:18 +0100
  • 34a9fc1a07 bugfixes to zim reader: Michael Peter Christen 2023-11-05 12:46:37 +0100
  • 7db0534d8a Added a zim parser to the surrogate import option. You can now import zim files into YaCy by simply moving them to the DATA/SURROGATE/IN folder. They will be fetched and after parsing moved to DATA/SURROGATE/OUT. There are exceptions where the parser is not able to identify the original URL of the documents in the zim file. In that case the file is simply ignored. This commit also carries an important fix to the pdf parser and an increase of the maximum parsing speed to 60000 PPM which should make it possible to index up to 1000 files in one second. Michael Peter Christen 2023-11-05 02:16:40 +0100