yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-02 23:16:13 -05:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#721

#722

#730

#734

#737

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

1ab5ee3476 refactoring of llm classes master Michael Peter Christen 2025-10-27 23:59:28 +01:00
d61b3b85e7 code cleanup Michael Peter Christen 2025-10-12 23:22:17 +02:00
bc72f36c0b small fixes to MCP server Michael Peter Christen 2025-10-12 02:16:19 +02:00
9a1abb9c1e fixed method recognition in MCP Server Michael Peter Christen 2025-10-12 01:30:57 +02:00
02735a44a3 added loging to MCP server Michael Peter Christen 2025-10-12 01:05:53 +02:00
2a492a76bf Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2025-10-11 01:29:14 +02:00
f41415a299 added MCP server You can now use YaCy as a search tool within an agentic LLM framework, i.e. using MCP clients in N8N or OpenAI AgentBuilder. The tool address is /tools Michael Peter Christen 2025-10-11 01:28:55 +02:00
e178781d98 Merge pull request #737 from henschi/fix_tests Michael Christen 2025-10-05 19:21:57 +02:00
01122f6784 Fix for refactoring introduced in 8451cfdef8 As mentioned in https://github.com/yacy/yacy_search_server/issues/687#issuecomment-3368449331 Michael Peter Christen 2025-10-05 19:10:09 +02:00
2fb50ce5d6 fix test after the lastest changes Henschi 2025-10-04 17:44:02 +02:00
a7d8fc4c0a added YaCy logo vector graphics Michael Peter Christen 2025-09-29 22:47:43 +02:00
6ad89ab5e7 stub of ollama client app Michael Peter Christen 2025-09-25 23:56:15 +02:00
61fd46c006 Enhanced fonts: new 6-Pixel font like the greatest home computers in the 80s Michael Peter Christen 2025-09-25 23:55:05 +02:00
3560b58450 refactoring of FontGenerator Michael Peter Christen 2025-09-22 21:19:49 +02:00
534a7174d1 enlarged web structure image Only the headline gets a larger font, the network nodes stay with a 5-pixel font. However, the overall size had been increased by 20% Michael Peter Christen 2025-09-21 23:26:52 +02:00
24fd128dde enlarged Access Grid picture size by 20% Michael Peter Christen 2025-09-21 23:15:50 +02:00
0a343357dd enlarged by 20% also PerformaceGraph, ProfilingGraph NetworkHistory, ChartPlotter and the Status page. Michael Peter Christen 2025-09-21 22:41:57 +02:00
3b4710f1fb Enlarged Network Graphic by 20% The YaCy retro-pixel-art images had been designed in a time where displays had not been "retina displays" and device pixel ratios (DPR) of 2 (everything must be scaled up by 100% to have the same size). Because the YaCy images have a fixed-width size, they appear now tiny compared on how they appeared in the past. Our 6-pixel font is not readable any more on high-res displays because with a DPR-2 they are scaled down to 50%. Experiments with DPR-agnostic auto-scaling of the images did not show a beautiful result. Instead, we now simply give the graphics 20% more pixel space and also scale up the font from 6 pixel to 8 pixel. They still have a nice retro-style look. Michael Peter Christen 2025-09-21 21:37:38 +02:00
6575e97bc3 introduced 7 pixel font Michael Peter Christen 2025-09-21 20:30:22 +02:00
b16cc99d12 refactoring PrintTool Michael Peter Christen 2025-09-21 17:50:12 +02:00
725b41550c added some more visualization archetypes Michael Peter Christen 2025-09-21 17:33:10 +02:00
78d26f1ec5 added three more 80s style retro plotter: Isometric, Radar, StarTunnel Michael Peter Christen 2025-09-20 17:38:05 +02:00
9b91b52700 added experimental SkylinePlotter and unfinished network graph using the SkylinePlotter Michael Peter Christen 2025-09-20 17:22:46 +02:00
008b8c3b49 Merge pull request #722 from scyt01/master Michael Christen 2025-09-14 23:00:42 +02:00
7f16f35a0a upgraded commons-lang to commons-lang to fix "Uncontrolled Recursion" security warning: https://github.com/yacy/yacy_search_server/security/dependabot/48 Michael Peter Christen 2025-09-14 22:58:24 +02:00
b11ec8bfa8 added helper class Michael Peter Christen 2025-09-10 23:17:23 +02:00
122f8441c4 Merge pull request #730 from szarowski/last_modified Michael Christen 2025-09-10 21:20:08 +02:00
15178d2545 review of kelondro storage classes Michael Peter Christen 2025-09-10 00:15:06 +02:00
1e5f744327 review of serverObjects and ChunkedBytes Michael Peter Christen 2025-09-09 00:23:54 +02:00
80f24b6262 another fix for previous commit Michael Peter Christen 2025-08-26 21:56:39 -07:00
8106ab2be0 fix for latest commit Michael Peter Christen 2025-08-26 11:23:50 -07:00
8451cfdef8 enabling very large file uploads >2gb This is a complete re-design of the serverObjects data structure which holds all data that is submitted during http post requests to YaCy. Before the change, post attributes had been stored to Strings which cannot be larger than 2GB. Furthermore, byte[] uploads had been encoded to b64 Strings to fit into this data structure. Those strings are now replaced by a new data structure, ChunkedBytes which is an object that can hold more than 2GB data using a list of byte[] objects. All required streaming functions are implemented and streaming from http post upload into this data structure works. The b64 encoding has been removed. The ZIM and WARC reader make use of the new data structure. Michael Peter Christen 2025-08-26 10:44:06 -07:00
ab095b8686 support for /date search to be sorted by date published - https://github.com/yacy/yacy_search_server/issues/622 Roman Szarowski 2025-08-25 23:36:10 +02:00
c2060cc15d added YaCy Pack Downloader This does a direct scan of the dataset repositories at huggingface. At this time there is one repo which has the String "YaCy-Pack" inside the repo name. All repositories that have that String in its name are listed. A download button exist which downloads the YaCy Pack to the hold path. Michael Peter Christen 2025-08-19 22:53:53 -07:00
7a6dd868f5 fixes in pack generator and manager Michael Peter Christen 2025-08-19 22:51:34 -07:00
9c3024d59b another fix to the http client: - removed forced setting of the host attribute, let the library do that. Setting the host attribute caused failure in case of redirects - removed disabling of cookies, some pages require cookies to accept the request. Michael Peter Christen 2025-08-19 10:08:58 -07:00
85ba1293fa added delete button to pack manager Michael Peter Christen 2025-08-17 23:00:18 -06:00
7d049c4786 updated bcmail 1.79 -> 1.81 Michael Peter Christen 2025-08-17 22:59:47 -06:00
e373174835 added sec_fetch_mode to http request headers Michael Peter Christen 2025-08-17 22:59:07 -06:00
acb77bd68a implemented (most of) https://github.com/yacy/yacy_search_server/issues/727 some refactorings done as well to support multiple user agents instead of only one; per request then is one of those user agents selected, not one random per session. Also: made sure that no robots.txt is loaded any more in case that the user agent is not a robot user agent. Michael Peter Christen 2025-08-16 13:33:39 -06:00
4c953ee8fd added collection attribute setting for zim and warc imports Having the collection attribute for those imports enables to use those import methods for YaCy Pack generation which requires the collection name to produce a pack name. Fixed also file upload option through browser for both methods. For large zim/warc files you require large memory settings to be able to cache the uploaded file. You also need large memory requirements in your browser to upload gigabytes of files through multipart/form-data uploads. Michael Peter Christen 2025-08-15 10:26:21 -06:00
a803c6063b enhancements to http loading Michael Peter Christen 2025-08-13 00:29:58 -06:00
88080f48b7 fixes https://github.com/yacy/yacy_search_server/security/dependabot/48 Michael Peter Christen 2025-08-12 23:25:48 -06:00
a4bf2eb2aa Disabled check for canonical URL This check disables indexing if a canonical tag exists and the current page is not the canonical page. This check often fails after a forwarding of a www.-domain to a non-www.-domain where the canonical tag states that the forwarding page is the canonical page. This makes the page not indexable. We disable the check therefore by default. Michael Peter Christen 2025-08-12 23:18:28 -06:00
d1d3f22a27 added 'mix' category for YaCy Packs Michael Peter Christen 2025-08-12 23:08:12 -06:00
5c4541caee added Index Pack Manager Michael Peter Christen 2025-08-04 09:39:00 +09:00
d518dcd883 use minimized exports for packs by default. Michael Peter Christen 2025-08-04 06:11:07 +09:00
0b89b0e560 added the collection field to minimized exports, needed for packs. Also: replaced sku with urls_s. For this we also relaxed parsing of url fields in import, also url instead url_s is accepted. Michael Peter Christen 2025-08-04 06:10:23 +09:00
4beae345f3 more prominent place for collections in crawl start to promote correct use of pack generation using collection names Michael Peter Christen 2025-08-04 06:07:47 +09:00
02095e5e47 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git Michael Peter Christen 2025-08-01 15:31:15 +09:00
de8fef9bf1 YaCy Index Pack Generator - refactoring of the SURROGATE process into a "PACK" concept. Michael Peter Christen 2025-08-01 15:30:46 +09:00
213d8bf3e3 Merge pull request #721 from henschi/fix_dep Michael Christen 2025-07-28 20:48:43 +09:00
fd6a2bb943 Fix proper encoding in sendDirectory() function Sharon Chua 2025-07-28 16:36:42 +08:00
a7cc836e64 commons-fileupload 1.6.0 requires commons-io 2.19.0 Henschi 2025-07-25 17:20:17 +02:00
055a2eaa25 implemented option for bind address of host. Michael Peter Christen 2025-07-23 21:47:57 +09:00
6dc8fe872e implements suggestion from https://github.com/yacy/yacy_search_server/issues/703 Michael Peter Christen 2025-07-23 00:03:29 +09:00
5488bf2e90 fix for https://github.com/yacy/yacy_search_server/issues/717 Michael Peter Christen 2025-07-22 19:57:44 +09:00
7aa11433fd refactoring and extension of html parser to create markdown Michael Peter Christen 2025-07-22 19:39:11 +09:00
05f916ef56 less robots tasks by default Michael Peter Christen 2025-07-22 15:53:47 +09:00
3bb1228e45 fix for NumberFormatException which may have interrupted the parser Michael Peter Christen 2025-07-22 15:53:13 +09:00
e1390bef69 refactoring + distinguish getMap from getList in table operations Michael Peter Christen 2025-07-22 12:07:35 +09:00
b030188c27 export less data if not required Michael Peter Christen 2025-07-21 10:53:53 +09:00
65ea055b58 suppress field "_version_" in jsonl export Michael Peter Christen 2025-07-21 10:07:07 +09:00
b8875b892f fix NPE in index import Michael Peter Christen 2025-07-21 09:57:03 +09:00
281927d505 fix for https://github.com/yacy/yacy_search_server/security/dependabot/47 Michael Peter Christen 2025-07-10 11:04:41 +09:00
7e5a5b04a5 Merge pull request #718 from henschi/nodockeronforks Michael Christen 2025-06-24 14:50:02 +02:00
8829acb697 disable docker build for PRs Henschi 2025-06-24 11:47:17 +02:00
8a839668cf disable docker on forks Henschi 2025-06-24 11:39:54 +02:00
86bd58f11f do not create sha tag images Michael Peter Christen 2025-06-23 06:24:44 +02:00
e477de9fb8 fix in rag proxy Michael Peter Christen 2025-06-23 06:22:50 +02:00
f4509ae259 try to fix push problems #4 Michael Peter Christen 2025-06-22 16:12:31 +02:00
5c63775ebc try to fix push problems #3 Michael Peter Christen 2025-06-21 19:36:55 +02:00
569bb7e2f7 try to fix push problems #2 Michael Peter Christen 2025-06-21 19:29:57 +02:00
2866f913c6 try to fix push problems Michael Peter Christen 2025-06-21 19:28:24 +02:00
5aaffec11c introduced reponame for dockerhub Michael Peter Christen 2025-06-21 18:49:07 +02:00
fa77a20012 enhanced Dockerfiles Michael Peter Christen 2025-06-21 18:16:11 +02:00
c836eb95a3 fixed another bug in the docker build workflow, #3 Michael Peter Christen 2025-06-21 14:40:37 +02:00
5e9bfc1c70 fixed another bug in the docker build workflow, #2 Michael Peter Christen 2025-06-21 14:34:23 +02:00
ca78e9dea2 fixed another bug in the docker build workflow Michael Peter Christen 2025-06-21 14:24:18 +02:00
3244fadc9f remove double suffix Michael Peter Christen 2025-06-21 13:36:00 +02:00
1563fcd3a8 also produce -ubuntu -tags for default images Michael Peter Christen 2025-06-21 13:14:44 +02:00
27dbf5a9e5 fix attempt for wrong docker image type (alpine instead ubuntu for latest) Michael Peter Christen 2025-06-21 12:24:51 +02:00
76ee88c82b Update build-docker-image.yaml Michael Christen 2025-06-21 00:00:31 +02:00
205497efdf disabled selbhosted trigger Michael Christen 2025-06-20 23:52:31 +02:00
16689362f7 Update build-docker-image.yaml Michael Christen 2025-06-20 23:47:08 +02:00
13a9329b2d Update Dockerfile: added retry to prevent failing builds Michael Christen 2025-06-19 18:21:57 +02:00
09ad31b654 Merge pull request #698 from MisterX2000/master Michael Christen 2025-06-19 18:11:09 +02:00
087d924e95 Merge pull request #715 from 3ele-projects/piep/fix_bookmarks_json_api Michael Christen 2025-06-19 11:27:33 +02:00
02f1d722bb Merge pull request #704 from jtorelli/add-helm-support Michael Christen 2025-06-19 11:20:01 +02:00
84bb610f4b Merge branch 'master' into master Michael Christen 2025-06-19 11:14:34 +02:00
b0a94aba8f added Transformer from the llama3.java project This is the one-file "toy" transformer from https://github.com/mukel/llama3.java in an enhanced form: Michael Peter Christen 2025-06-19 11:01:05 +02:00
8f7f377393 enhanced OpenAI client for Ollama Michael Peter Christen 2025-06-19 10:55:18 +02:00
76210ab9fb added ZIM importer servlet Michael Peter Christen 2025-06-19 10:52:08 +02:00
4bf55a6ef9 Updated Dockerfile; using temurin 24 instead of temurin 11 now. The reason to update the java version here is to enhance the computation speed which is much better in more recent java versions. For now YaCy stays at java 11 and using java 24 in docker does not change that. Michael Peter Christen 2025-06-19 10:47:46 +02:00
de439f31ec updated guava Michael Peter Christen 2025-06-19 10:44:47 +02:00
d93c0765e3 htroot/api/bookmarks/get_bookmarks.json: remove parent [] for tagsjson piep 2025-06-17 09:44:14 +02:00
1953bc2811 source/net/yacy/htroot/api/bookmarks/get_bookmarks: change tag.toString in tag.toJsonList piep 2025-06-17 09:40:19 +02:00
157405da01 htroot/api/bookmarks/get_bookmarks.json change template to tagsjson piep 2025-06-17 09:37:55 +02:00
efa621e456 source/net/yacy/data/BookmarksDB: change Bookmark toString function and add getTagsJsonList piep 2025-06-17 09:25:35 +02:00
a7efdd3e2b htroot/api/bookmarks/get_bookmark: change template, change bookmark loop piep 2025-06-17 09:13:36 +02:00