yacy_search_server/help/ContentAnalysis_p.md

page, help, title, package, access, kind, backend_java

page	help	title	package	access	kind	backend_java
htroot/ContentAnalysis_p.html	help/ContentAnalysis_p.md	Content Analysis	ranking-ai-analysis	admin	admin-page	source/net/yacy/htroot/ContentAnalysis_p.java

Content Analysis

Purpose

Content Analysis inspects document text for duplicate or near-duplicate patterns.

Use it to understand whether repeated content, boilerplate, or very similar pages are polluting the index.

What You Can Do Here

• Content Analysis inspects document text for duplicate or near-duplicate patterns.
• Use representative queries or documents when evaluating changes.
• Change one model, field, weight, or threshold at a time so the effect can be explained.

Page Architecture

Ranking and analysis pages expose the signals that influence result order or retrieval augmentation. The visible form usually maps directly to weights, model choices, field selections, or diagnostic thresholds.

Control	Meaning	Values or examples
minTokenLen	minTokenLen.	Text value; use the page label and surrounding context to choose the exact content.
quantRate	quantRate.	Text value; use the page label and surrounding context to choose the exact content.
EnterDoublecheck	minTokenLen.	Set
ResetDoublecheck	minTokenLen.	Re-Set to default

Correct Use

Use representative test queries or documents. Ranking, analysis, and AI settings are meaningful only when their effect can be compared. Keep notes about changed weights, model choices, fields, or thresholds.

Access And Safety

Administrator access is required. YaCy protects _p pages as administration pages.

Protected related endpoint(s): /ContentAnalysis_p.html.

Automation And API

Page backend: source/net/yacy/htroot/ContentAnalysis_p.java.

Endpoint	Method	Access	Backend
/ContentAnalysis_p.html	POST	admin	source/net/yacy/htroot/ContentAnalysis_p.java

Parameter Guide

The table explains values that an agent or script must set deliberately. Parameters not relevant to a task should be omitted or left at the page default.

Parameter	Meaning and valid values	Care
minTokenLen	minTokenLen.	Set only when this option is part of the intended request; otherwise omit it and let YaCy use the page default.
quantRate	quantRate.	Set only when this option is part of the intended request; otherwise omit it and let YaCy use the page default.
EnterDoublecheck	minTokenLen.	Set only when this option is part of the intended request; otherwise omit it and let YaCy use the page default.
ResetDoublecheck	minTokenLen.	Changes stored data, configuration, or a running job. Use the authenticated action flow where required and verify the result.

Example request shape:

POST /ContentAnalysis_p.html
Content-Type: application/x-www-form-urlencoded

minTokenLen=...&quantRate=...&EnterDoublecheck=...&ResetDoublecheck=...&ResetRanking=...

What To Expect

Expect configuration values, diagnostics, or changed result behavior. The effect may only become visible after running the same query again, re-indexing fields, or using the configured model/RAG workflow.

Related Pages

• https://lucene.apache.org/solr/5_5_2/solr-core/org/apache/solr/update/processor/TextProfileSignature.html