yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-08 00:06:13 -05:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#721

#722

#730

#734

#737

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

0d32a766ed relax verify attribute for search widget to make it faster: set to "cacheonly" Michael Peter Christen 2012-05-20 00:50:54 +02:00
ae335a4190 bugfix Tables_p for edit and delete selected row (correction to use "pk_" html prefex) reger 2012-05-19 23:15:29 +02:00
ee553d971e correct typo in scripts_txt comment reger 2012-05-19 02:09:16 +02:00
f294f2e295 bugfix to http://bugs.yacy.net/view.php?id=181 tried to make a bit less 'noise' to dns server Michael Peter Christen 2012-05-19 01:06:33 +02:00
acf8d521a2 fix for http://bugs.yacy.net/view.php?id=126 Michael Peter Christen 2012-05-19 00:21:03 +02:00
1473e2258e fix for http://bugs.yacy.net/view.php?id=154 Michael Peter Christen 2012-05-18 23:56:40 +02:00
ca7de1dbd0 moved files to defaults Michael Peter Christen 2012-05-18 22:33:41 +02:00
bb88878b4d the last commit was incomplete.. Michael Peter Christen 2012-05-18 22:33:16 +02:00
d320a31ae1 bugfix for http://bugs.yacy.net/view.php?id=186 Michael Peter Christen 2012-05-18 22:18:47 +02:00
fa735f4f04 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-05-17 23:40:08 +02:00
3e1bc9477f Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-05-17 13:58:09 +02:00
6f8a2fef1f small speed enhancement using a column factory Michael Peter Christen 2012-05-17 11:08:48 +02:00
d10627d591 More sync in close() methods Roland 'Quix0r' Haeder 2012-05-17 06:03:18 +02:00
b3ae2aa41f With or without 'final'? At least please try it in other methods Roland 'Quix0r' Haeder 2012-05-17 06:00:49 +02:00
fbb946f913 Made a method static (Eclipse suggested it), removed unused import, pk=null check does now output a warning in logfile Roland 'Quix0r' Haeder 2012-05-15 20:57:38 +02:00
5f983faef9 No & in JavaScript-embeded URLs, added ability to stop focus in ConfigPortal.html preview (is this not secured with _p????) Roland 'Quix0r' Haeder 2012-05-17 05:49:25 +02:00
52d307c735 prevent that the snippet fectch process removes catchall entries Michael Peter Christen 2012-05-17 05:18:52 +02:00
7eece0256f moved yacy.logging to defaults according to request in http://bugs.yacy.net/view.php?id=55 Michael Peter Christen 2012-05-17 04:26:03 +02:00
5b3acc12cd Pattern.quote() replaces \\Q and \\E according to publication in http://www.cs.washington.edu/homes/mernst/pubs/regex-types-ftfjp2012.pdf Michael Peter Christen 2012-05-17 03:55:10 +02:00
89142d1e8d removed (not all) warnings Michael Peter Christen 2012-05-16 13:42:32 +02:00
ffa4553229 typo Michael Peter Christen 2012-05-16 10:14:44 +02:00
db9d81cb7a ups Michael Peter Christen 2012-05-16 01:04:08 +02:00
5deebd02ea added serialization Michael Peter Christen 2012-05-15 23:10:47 +02:00
b2175ea4ef Add possibility to set custom Solr field names for the YaCy default Solr attributes. - Changing the format of YaCy's solr.key.list while maintainig backward compatibility Federated index config screens adjusted accordingly - modified the Solr update request to use a 3 min Solr autocommit intervall reger 2012-05-15 22:34:02 +02:00
a48f37bf70 Merge branch 'master' of git://gitorious.org/yacy/rc1.git reger 2012-05-15 19:53:30 +02:00
15db703808 added missing serialization to remove all warnings Michael Peter Christen 2012-05-15 13:13:07 +02:00
1795a7325b made HandleSet serializable Michael Peter Christen 2012-05-15 12:55:15 +02:00
e7e381d110 added configuration to switch off redirection following in crawler Michael Peter Christen 2012-05-15 12:25:46 +02:00
2717c1b749 fixed bug in solr interface Michael Peter Christen 2012-05-15 12:25:14 +02:00
70505107ca enhanced crawler/balancer: better remaining waiting-time guessing Michael Peter Christen 2012-05-15 12:24:54 +02:00
f150bc218b fixed bug in solr error document Michael Peter Christen 2012-05-14 14:56:21 +02:00
cb54c1737b solrj connector bugfix Michael Peter Christen 2012-05-14 11:56:04 +02:00
a093ccf5eb Now used synchronization in all close() methods to make sure all objects are 'closed' in an ordered way Roland 'Quix0r' Haeder 2012-05-14 07:41:55 +02:00
49cab2b85f Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-05-13 09:51:06 +02:00
49867fcc8f Merge branch 'master' of git://gitorious.org/yacy/rc1.git reger 2012-05-12 21:30:15 +02:00
0d58fea210 made multiple connector default Michael Peter Christen 2012-05-12 10:39:01 +02:00
7740c02c56 - enhanced the solr connector - added new multiple connector (to replace singleConnector) Michael Peter Christen 2012-05-12 10:32:42 +02:00
0cf3d36eae more tolerance in case of corrupted file Michael Peter Christen 2012-05-11 20:46:50 +02:00
7e6cdb5893 moved debian dependency to openjdk-7 Michael Peter Christen 2012-05-11 11:33:05 +02:00
d23bacd19b Adjust NetBeans config to use lib/solr-3.6.jar reger 2012-05-11 00:40:56 +02:00
acc6db28ff added missing classes for solr interface Michael Peter Christen 2012-05-09 23:43:12 +02:00
adeb33bb36 better abstraction for solr objects Michael Peter Christen 2012-05-09 17:21:19 +02:00
8864141872 more abstraction in solr connection classes Michael Peter Christen 2012-05-09 17:00:56 +02:00
c00efc2717 made the solr connection more generic Michael Peter Christen 2012-05-09 16:46:45 +02:00
ea2bd43b28 patch for broken configurations Michael Peter Christen 2012-05-09 12:29:07 +02:00
e5ca7f22b1 enhancement in circle drawing Michael Peter Christen 2012-05-09 12:28:43 +02:00
34f4225d7e less 'wellformed' calls without asserts Michael Peter Christen 2012-05-08 23:24:39 +02:00
f130ab39e8 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-05-08 22:55:52 +02:00
a691023d04 *) better formatting for network QPM *) refactoring Marc Nause 2012-05-08 20:07:34 +02:00
dcccbe0be8 removed superfluous column Michael Peter Christen 2012-05-07 00:54:00 +02:00
77f8e9fb9b Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-05-04 17:29:16 +02:00
ba6aaabc51 refactoring + parser bugfixes Michael Peter Christen 2012-05-04 17:28:27 +02:00
6c4f8fdc44 removed superfluous files Michael Peter Christen 2012-04-30 11:09:54 +02:00
a18b6dee04 Merge remote branch 'bbyacy-rc1/master' Michael Peter Christen 2012-04-29 21:22:23 +02:00
2a0434efa4 Merge commit 'c1f6b4fb5226d3d2f8b2bec9e361f6b3476e03ff' Michael Peter Christen 2012-04-29 21:21:49 +02:00
ea932f841c changed link to opensearchdescription document to a absolute uri (in yacysearch.html and yacysearch.rss) see http://www.opensearch.org/Specifications/OpenSearch/1.1/Draft_5#The_.22Description.22_element reger 2012-04-29 05:50:56 +02:00
942896fe46 removed methods not supported by new solrj connector for httpclient 4 Error was: java.lang.UnsupportedOperationException: Client was created outside of HttpSolrServer at org.apache.solr.client.solrj.impl.HttpSolrServer.setDefaultMaxConnectionsPerHost(HttpSolrServer.java:614) at net.yacy.cora.services.federated.solr.SolrSingleConnector.<init>(SolrSingleConnector.java:128) at net.yacy.cora.services.federated.solr.SolrShardingConnector.<init>(SolrShardingConnector.java:55) at net.yacy.search.Switchboard.<init>(Switchboard.java:657) at net.yacy.yacy.startup(yacy.java:222) at net.yacy.yacy.main(yacy.java:1018) Michael Peter Christen 2012-04-27 18:26:36 +02:00
22e1f68c0b solrj user authentication patch Michael Peter Christen 2012-04-27 17:53:45 +02:00
09484955dc added new entry class for embed tags Michael Peter Christen 2012-04-27 17:48:51 +02:00
62f2554a01 - fixed build problems (deprecated methods using httpclient 3.1) - removed httpclient 3.1 lib which was used by solrj (solrj now uses httpclient 4) Michael Peter Christen 2012-04-27 17:46:08 +02:00
a6d60fc21f concurrency enhancement in ConfigurationSet Michael Peter Christen 2012-04-27 17:20:18 +02:00
453010bd68 - solved problems with backpath normalization - redesigned in/outbound link handover - removed iframe links from inbound/outbound in solr scheme Michael Peter Christen 2012-04-27 16:48:51 +02:00
5f5ed33ed8 patch for media search (audio, video apps) Michael Peter Christen 2012-04-27 14:18:02 +02:00
7860c1df80 fix needed for new solrj library Michael Peter Christen 2012-04-27 14:13:59 +02:00
248299d10f updated solrj lib Michael Peter Christen 2012-04-27 11:22:34 +02:00
0e13022147 - enhanced solr field documentation - added xml api button to IndexFederated_p - the solr schema.xml file can be generated by YaCy Michael Peter Christen 2012-04-26 15:25:07 +02:00
08dcf3e5d1 hack to get all results if the actual number is between 10 and 64 Michael Peter Christen 2012-04-26 00:27:21 +02:00
19efbf1b0f - apply directDocByURL to NOLOAD Queue - choose pushing to NOLOAD as default for site crawl Michael Peter Christen 2012-04-26 00:23:18 +02:00
5c66880be2 fix for search result selection in case that contentdom is not set Michael Peter Christen 2012-04-26 00:04:23 +02:00
659178942f - Redesigned crawler and parser to accept embedded links from the NOLOAD queue and not from virtual documents generated by the parser. - The parser now generates nice description texts for NOLOAD entries which shall make it possible to find media content using the search index and not using the media prefetch algorithm during search (which was costly) - Removed the media-search prefetch process from image search Michael Peter Christen 2012-04-24 16:07:03 +02:00
3bea25c513 increased image preview size Michael Peter Christen 2012-04-24 16:04:13 +02:00
a3badd3205 changed search process for images: no more media snippet load process, show only links from index which had been on the text search page before. This creates a superfast search process for images! Michael Peter Christen 2012-04-24 12:55:58 +02:00
f5efdb21fd refactoring Michael Peter Christen 2012-04-24 12:54:41 +02:00
4aa0eedead one more scroogle... Michael Peter Christen 2012-04-24 12:05:37 +02:00
347612ddd4 removed scroogle parser Michael Peter Christen 2012-04-24 12:04:44 +02:00
c1f6b4fb52 lookupByIP: prevent comparing of port parameter if called with port -1 (=unknown) reger 2012-04-24 00:05:01 +02:00
f8cd57c92f new indexing strategy: ALL links that appear anywhere are indexed, not only links where the content can be parsed. All non-parseable links are placed into the noload queue. The search process must therefore be able to filter out non-text search results. - This fixes the problem that image search results appeared in the text search. - The interactive search can retrieve now ALL types of links - The p2p interface is now extended to retrieve only certain types of links (text, image, video, apps) - The search process has an extension to filter the right document type according to the search query Michael Peter Christen 2012-04-22 02:05:17 +02:00
14f67f217c refactoring of ContentDomain: now subclass of Classification Michael Peter Christen 2012-04-22 00:04:36 +02:00
8a08c96a82 removed dependency from logging Michael Peter Christen 2012-04-21 21:32:31 +02:00
a1a5b015d8 refactoring: moved document Classification to cora package Michael Peter Christen 2012-04-21 21:31:13 +02:00
a5d7da68a0 refactoring: removed dependency from switchboard in Balancer/CrawlQueues Michael Peter Christen 2012-04-21 13:47:48 +02:00
33d1062c79 refactoring: the cache belongs to the crawler Michael Peter Christen 2012-04-21 13:34:07 +02:00
8429967ea7 no more SVN Michael Peter Christen 2012-04-19 13:29:08 +02:00
0466bb0ddf no more SVN.. Michael Peter Christen 2012-04-19 13:28:12 +02:00
4844e124b1 one more warning in case that crawling is paused because of low disk space Michael Peter Christen 2012-04-19 12:35:11 +02:00
0ec2713af8 'download' Michael Peter Christen 2012-04-19 11:50:24 +02:00
2be327b5ab update location update Michael Peter Christen 2012-04-19 11:49:43 +02:00
f30c577fdb add hint to speed up search results Michael Peter Christen 2012-04-19 11:11:14 +02:00
6b133de3e9 add hint for consulting support Michael Peter Christen 2012-04-19 11:10:48 +02:00
4d5da75814 fix for parser problem if a <a>-tag is 'within' html tags with unclosed tags. That prevented the <a> tags from beeing recognized. This is a fix for http://forum.yacy-websuche.de/viewtopic.php?p=25516#p25516 Michael Peter Christen 2012-04-18 10:30:04 +02:00
eb2c8ffa62 display is not used any more Michael Peter Christen 2012-04-17 12:30:14 +02:00
91a86f0b06 fixed to network graph testing Michael Peter Christen 2012-04-17 11:46:14 +02:00
f31ad84d98 automatic generation of blacklist pattern, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2685&p=25305#p25305 Michael Peter Christen 2012-04-17 11:22:19 +02:00
7b5b9baee0 added citation rank to ranking profile Michael Peter Christen 2012-04-16 23:43:50 +02:00
046f3a7e8d check if httpc has decompressed the release file and rename the file from .tar.gz to .tar if that happened Michael Peter Christen 2012-04-16 09:50:55 +02:00
06951ef751 remove heuristic scroogle from search option help text in index.html reger 2012-04-16 04:00:04 +02:00
e377092198 fix to xml output format Michael Peter Christen 2012-04-13 09:02:18 +02:00
41be98dc9d extended webstructure api to show together with incoming links also outgoing links Michael Christen 2012-04-13 11:53:34 +02:00
02e4dedff2 fix to url citation collection Michael Christen 2012-04-13 11:52:59 +02:00
e32055aa15 added stub classes for - a new database for url reference data ('seen links') - a new database extending the references to the full url metadata attributes set which shall replace the old metadata database if it is finished - migration help classes stub to use old and new metadata databases simultanously Michael Christen 2012-04-13 07:09:15 +02:00