yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-17 08:26:08 -04:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

7a4dab6d1d - removed unused variables - do not replace malformed or invalid URLs in urlproxy cominch 2012-06-10 23:33:09 +02:00
ca93835713 removed usage of deprecated methods Michael Peter Christen 2012-06-10 23:17:21 +02:00
23e38bd918 do not load the "_triplestore.rdf" files which are of special use in sciencenet Michael Peter Christen 2012-06-10 21:54:30 +02:00
90c6fc4b63 load all - but not the persistent local.rdf - triples from DATA/TRIPLESTORE at startup time. The local.rdf is loaded only if the persistent switch is on (as before). Michael Peter Christen 2012-06-10 21:49:02 +02:00
a9eb40c160 fix for autocomplete in index.html Michael Peter Christen 2012-06-10 14:44:37 +02:00
dd020a1a8a removed autocrawler and feedback servlet link since that was not cherry-picked Michael Peter Christen 2012-06-10 13:17:23 +02:00
bbfc53b663 bugfix cominch 2012-06-08 10:11:48 +02:00
65c5826d93 bugfix cominch 2012-06-10 13:11:54 +02:00
aa0295917c augmentation cominch 2012-06-10 13:10:21 +02:00
87a3fbb3c2 interaction javascript cominch 2012-05-30 17:11:31 +02:00
ed2ea0f08e augmented browsing modification cominch 2012-06-10 13:07:57 +02:00
6b32f7c1f6 re-enable augmented proxy cominch 2012-05-16 15:05:17 +02:00
3b08edec2e bugfix cominch 2012-06-10 13:03:56 +02:00
d4802dc8d5 small change cominch 2012-05-16 09:23:44 +02:00
a120ef660b RDF demo servlet cominch 2012-05-16 09:22:55 +02:00
5f8ba7f4f2 small changes cominch 2012-06-10 13:02:00 +02:00
09a34cfe1b prepare RDF dump routines cominch 2012-03-12 11:45:27 +01:00
300b235ce8 Updated Demo Servlet cominch 2012-06-10 12:58:29 +02:00
90512640bf Added config switches for custom parser cominch 2012-06-10 12:49:36 +02:00
b5a8fb5fd8 Catch malformed URL when submitted in encoded style cominch 2012-02-24 17:02:57 +01:00
a12cbcba36 Add a global value store cominch 2012-02-24 16:09:44 +01:00
df47f31235 interaction: add special table interaction cominch 2012-06-10 12:43:01 +02:00
e14f2881ae interaction: add special table interaction cominch 2012-06-10 12:41:16 +02:00
d7326079a8 interaction: add global variable store cominch 2012-06-10 12:39:27 +02:00
4e4e7a99f8 interaction: add global variable store cominch 2012-06-10 12:34:36 +02:00
8e80894812 create virtual web folder /currentyacypeer/ which always points to local peer, even when using the urlproxy cominch 2012-06-10 12:31:49 +02:00
bde07ed7a8 Add tagging overlay element cominch 2012-06-10 12:28:50 +02:00
bee3bee8f3 Small fix - return value of JSON should be empty cominch 2012-02-15 15:30:53 +01:00
ff4ba3ee05 Small fix cominch 2012-06-10 10:56:39 +02:00
f05e3968f7 Quick fix cominch 2012-02-15 14:13:15 +01:00
e859481889 Add Triplestore settings functionality cominch 2012-06-10 10:55:00 +02:00
b0bc0b4572 Add new demonstration module for client-side key-value store (backend: triplestore): /DemoServletInteraction.html cominch 2012-06-10 10:53:30 +02:00
c9dc6cda02 Demonstration: include value from interaction in search results cominch 2012-06-10 10:51:53 +02:00
ae8adb0e58 Small changes cominch 2012-02-14 15:51:20 +01:00
bcbd8eee33 Add several parsers, for RDFa and rdf files. cominch 2012-06-10 10:42:33 +02:00
9ef5a80f4e add interaction for triples and selector for augmented browsing cominch 2012-06-10 10:38:54 +02:00
282c1620d6 Allow TripleStore to be persistent after reboot cominch 2012-02-13 18:04:22 +01:00
5d20cd324a Add Triplestore and RDF query interface cominch 2012-06-10 10:35:59 +02:00
bc9a618e0a augmented browsing: ignore js and css, integrate more user interaction cominch 2012-06-10 10:29:15 +02:00
b21048892b augmentedParser add features and integrate external html parser to modify existing web pages cominch 2012-06-10 10:23:35 +02:00
9cbfc1a1c0 augmentedProxy, which forwards every proxy request to a rewrite engine to customize existing webpages. originally implemented by Florian Richter. cominch 2012-06-10 10:15:34 +02:00
1626be7916 Add menu entries for urlproxy / augmented browsing cominch 2012-01-19 14:24:17 +01:00
a32943b382 add json mimetype cominch 2012-01-18 10:14:33 +01:00
3b992e6b00 using utf8 String compression in Webstructure database Michael Peter Christen 2012-06-09 11:00:33 +02:00
26301a538d bugfix in Domains - dns-lookup Michael Peter Christen 2012-06-09 10:59:45 +02:00
cde20911bb saved a bit more ram using UTF8 String compression for OpenGeoDB and Geonames data files. Michael Peter Christen 2012-06-09 10:07:11 +02:00
225ee42879 made the GeoLocation into an interface with the current integer implementation as accuracy implementation of 1.863cm Michael Peter Christen 2012-06-09 09:46:27 +02:00
5b25272f40 added location search to main menu Michael Peter Christen 2012-06-09 09:10:54 +02:00
2280a7b276 - changed initialization order to prefer allocation of memory for table files first - bugfixes in memory amount calculation Michael Peter Christen 2012-06-09 09:05:47 +02:00
0746308bc2 only the metadata tables shall be able to use the tail cache Michael Peter Christen 2012-06-08 18:36:11 +02:00
7ec9bef0c3 fix for OOM Michael Peter Christen 2012-06-08 17:14:09 +02:00
41c02cb10e - less restrictions for usage of Table RAM copy - new limit to use the table copy (instead of flag): 400MB available. If less is available, then a copy is never used. If more is available, then it can be used if there is a remaining space of at least 200MB - flush caches more often: flush the Digest cache Michael Peter Christen 2012-06-08 12:48:25 +02:00
b8f56a9803 npe bugfix Michael Peter Christen 2012-06-08 10:20:43 +02:00
ea0dceb55d bugfix: do not switch off standard memory strategy when performing a forced GC PLEASE CHECK if your peer has standard memory switched on! Michael Peter Christen 2012-06-08 09:48:46 +02:00
dd14b19c26 lazy initialization of block rank table ... only normal web search uses this. When interactive search or location search is used, the block rank is switched off Michael Peter Christen 2012-06-08 09:41:29 +02:00
ba10caf89a lazy initialization of database tables Michael Peter Christen 2012-06-08 09:30:51 +02:00
701b9a28a0 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-06-08 09:16:16 +02:00
ab7107b34b fixed RWIProcess queue limits: now discovering hidden results for mass result retrieval Michael Peter Christen 2012-06-08 09:14:54 +02:00
10c9c17d51 fixed handlemap spread factor and null iterator handling Michael Peter Christen 2012-06-08 09:13:41 +02:00
b0095c8d3c flush the compressor cache when a cleanup is done Michael Peter Christen 2012-06-07 19:42:33 +02:00
a61f44f9e4 lazy initialization of block rank table. this causes that the table is not initialized when there is no search is done. the effect is most strong if YaCy is started headless which causes no browser pop-up which otherwise would load the search page and therefore trigger the initialization of the table. Michael Peter Christen 2012-06-07 13:16:38 +02:00
c8bbd180e4 enhanced hint for debian package automatic update Michael Peter Christen 2012-06-07 12:36:26 +02:00
9ad84c5e9f fix for NPE in PerformanceMemory Michael Peter Christen 2012-06-07 12:36:05 +02:00
96e9d77270 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-06-06 20:13:28 +02:00
00f2df1120 a variety of possible memory leak fixes Michael Peter Christen 2012-06-06 18:23:18 +02:00
d7eb18cdf2 accept also file names beginning with "file://" for crawl start from file. Michael Peter Christen 2012-06-06 14:27:18 +02:00
8002fd2578 use less cache space since a large cache would cause more memory usage in index files. Michael Peter Christen 2012-06-06 14:17:42 +02:00
3dd8376825 added automatic cleaning of cache if metadata and file database size is not equal. It might happen that these data is different because one of that caches is cleaned after a while or when it is too big. The metadata is then not cleaned, but now wiped after a checkup process at every application start. This should cause a bit less memory usage. Michael Peter Christen 2012-06-06 14:15:24 +02:00
d0ec8018f5 fixes for bad long computation Michael Peter Christen 2012-06-06 14:13:31 +02:00
6bb07afcc3 accept also files with other file prefix; used to read 'foreign' cache files Michael Peter Christen 2012-06-06 13:36:10 +02:00
96c8119b50 added GeoLocation / GeoPoint classes which uses less memory than Location/Coordinates and has initializers with correct order of lat,lon coordinates Michael Peter Christen 2012-06-06 12:57:42 +02:00
461a0ce052 removed warnings Michael Peter Christen 2012-06-05 20:03:43 +02:00
62ae9bbfda allow more POIs, get more at once Michael Peter Christen 2012-06-05 18:29:54 +02:00
407fdf6968 more bug fixes and performance hacks for search process Michael Peter Christen 2012-06-05 15:04:23 +02:00
a1fe65b115 performance hacks Michael Peter Christen 2012-06-05 12:06:26 +02:00
2fe207f813 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-06-04 23:44:38 +02:00
5aee19daa4 added show from cache in search results (not yet finished) Michael Peter Christen 2012-06-04 23:44:26 +02:00
5e562dcdb7 adopted vocabulary usage within anotation/naviagtion feature of search to new SimpleVocabulary class Michael Peter Christen 2012-06-04 23:43:30 +02:00
514700291a moved Vocabulary to cora package (added in git 964406ad17) Michael Peter Christen 2012-06-04 23:41:36 +02:00
0284a4d88f more fixes for double precision of coordinates Michael Peter Christen 2012-06-04 23:37:41 +02:00
964406ad17 added concurrency enhancement to xml parser Michael Peter Christen 2012-06-04 23:35:56 +02:00
240045cf7c fix for bad distance computation Michael Peter Christen 2012-06-04 16:33:16 +02:00
e0d8643226 - performance hacks - added log warnings in case that search processes run into time-out situations - better concurrency for Integer formatter (used a non-synchronized formatter before) - bugfix for search termination (a poison pill was missing) - added timeout parameters for search (again) -> target is, that they are never reached. Michael Peter Christen 2012-06-04 15:37:39 +02:00
7a329465b3 using pre-compile pattern in blacklist; should enhance search speed Michael Peter Christen 2012-06-04 15:34:53 +02:00
cf79b6cee3 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2012-06-01 08:32:26 +02:00
6e83b02b83 - bugfix for surrogate file reader - bugfix for location search: suppress empty search Michael Peter Christen 2012-06-01 00:08:31 +02:00
9b4c699526 ehanced location search: - search request are now made using a map boundary - search results are only computed for the map boundary - the number of results is adopted to the results in the visible range - added a double-buffering for the search result markers - added a search query option for the search results: /radius/<lat>/<lon>/<radius> Michael Peter Christen 2012-05-31 22:39:53 +02:00
434af404c1 - added double-buffering for search layers - added automatic zooming to search result to location search Michael Peter Christen 2012-05-31 14:05:36 +02:00
4d9b2dc487 automatically zoom to result layer bounds Michael Peter Christen 2012-05-31 01:12:06 +02:00
6b40803adf - show number of results in map search interface - transfer view radius within query Michael Peter Christen 2012-05-31 00:47:52 +02:00
834dc6b263 store more data from interface access Michael Peter Christen 2012-05-31 00:47:07 +02:00
1f48d1528b performance hacks Michael Peter Christen 2012-05-31 00:46:30 +02:00
c70aaccdc9 better location to generate a guid for rss messages Michael Peter Christen 2012-05-30 17:14:25 +02:00
10da7335ea performance hack: use a hash cache for all hashes that are computed by a byte array. If this hash is used in a HashMap (which is very often the case) then this hack eliminates a lot of re-computations of the same hash. Michael Peter Christen 2012-05-30 16:59:13 +02:00
f8a0cf6d7c RSSMessages do not need a concurrent hash map -> removed overhead Michael Peter Christen 2012-05-30 16:44:03 +02:00
07ca7e4dd1 enhanced RSS parsing by ensuring that it is parsed with a buffered input stream Michael Peter Christen 2012-05-30 16:40:37 +02:00
7c1feefb28 introduced a default 10 second time-out in rwi normalization time uring search process to prevent endless deadlocks after a very long running search Michael Peter Christen 2012-05-30 16:26:05 +02:00
8d997d55b6 better logging Michael Peter Christen 2012-05-30 15:47:35 +02:00
65d37e6a20 only ASCII needed in seed bitflags Michael Peter Christen 2012-05-30 15:42:28 +02:00
a8778e9c47 npe fix Michael Peter Christen 2012-05-30 15:28:45 +02:00