yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-06-20 03:56:07 -04:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

c4e922885a replaced indexURLEntry by new class that uses a kelondroRow.Entry object to store the index entry. This is another step to move to the new database structure. A side effect of this change is, that index storage uses much less RAM space, which affects the index RAM cache. orbiter 2006-08-02 19:59:28 +00:00
0b7112f8b2 fix for missing topLevelClone in indexRAMCacheRI.wordContainerIterator orbiter 2006-08-02 00:43:03 +00:00
e357599f92 * fixed problem with indexContainer iteration from RAM: indexContainers from RAM must be cloned explicitely to prevent side-effects on stored indexContainer objects in Cache * changed behaviour of urlReference deletion from indexContainers: deletion does not user retrieval of all Elements from the assortments * added textual configuration of kelondroRow and kelondroColumn definition * update of kelondroRow usage in yacyNews * modified kelondroAttrSeq to use modified kelondroColumn parser orbiter 2006-08-01 10:30:55 +00:00
57fe5cc671 *) code cleanup theli 2006-07-30 06:25:40 +00:00
4e9f02c8ec integration of Michaels string-extraction. allo 2006-07-26 23:11:15 +00:00
8b77afd72c some fixes to new container merger and some code cleanup orbiter 2006-07-26 22:40:11 +00:00
d7e8e7da1e more flexible classpath in linuxscript allo 2006-07-26 20:21:24 +00:00
4435d916d4 print-only option for use in other scripts. allo 2006-07-26 18:22:14 +00:00
830167596a bugfix for http://www.yacy-forum.de/viewtopic.php?p=24127#24127 orbiter 2006-07-26 18:16:33 +00:00
839806a775 *) serverPortForwardingUpnp.java: code cleanup, license header added theli 2006-07-26 15:32:35 +00:00
523e80445f *) adding libs to eclipse classpath file theli 2006-07-26 15:25:44 +00:00
03230cd887 *) removing old port forwarding classes theli 2006-07-26 14:42:12 +00:00
4fd8449918 *) adding some license files theli 2006-07-26 14:37:02 +00:00
6e676224d0 *) adding support for upnp A new port forwarding method for upnp was added. If this method is enabled, yacy automatically determines an UPnP capable internet gateway and configures the gateway port forwarding settings properly. theli 2006-07-26 14:26:45 +00:00
417ed5102e redesign of database iterators: an iteration of key elements in kelondroTree databases is no longer supported. this is now replaced by an iteration of kelondroRow.Entry objects from the database Iteration of keys from the database was mostly followed by retrieval of the row from the database, whcih caused unnecessary database load. The index selection was also redesigned to use the new row iteration methods. This affects many funktions, most important is the DHT selection routine which is now much faster. orbiter 2006-07-26 11:21:51 +00:00
0db237467f *) bugfix for URL generation from file see: http://www.yacy-forum.de/viewtopic.php?p=24116 theli 2006-07-25 16:18:45 +00:00
ad692fc6c7 implemented option to extract nurls from the database (plus some iteration enhancements for nurls) orbiter 2006-07-24 16:40:59 +00:00
7fd90ca7c8 * strict handling of NURL entry element generation, storage and stacking * more space for EURL reason strings (you must delete the EURL db to use this) orbiter 2006-07-24 16:04:14 +00:00
5f72be2a95 some redesign of EURL storage * store() is now called explicitely * more urls are written to the EURL table * the EURL stack does not store the complete entry any more, now only the URL hash orbiter 2006-07-24 15:25:47 +00:00
1ed3e2daef added option to extract domains and/or urls from the eurl database when extracting from eurl, the html output format is recommended, since this format adds also the fail reason to the domain/url. The complete syntax for domain extraction is now java -Xmx<megabytes>m -classpath classes yacy -domlist [ -source { lurl | eurl } ] [ -format { text | zip | gzip | html } ] [ <path to DATA folder> ] orbiter 2006-07-24 08:08:33 +00:00
7e0a130fb5 new indexURLEntry class 'indexURLEntryNew', to replace old class orbiter 2006-07-23 22:43:36 +00:00
58df8b7bbf a large collection of different changes * mainly for the transition to the new indexing database structure * a bugfix for an endless loop inside kelondroTree iteration * a bugfix for bulk read inside a kelondroTree iteration; the bug caused that some elements had been iterated twice * very strong speed enhancement for url/domain extraction orbiter 2006-07-23 22:39:41 +00:00
493b1cd2bf better logging for domain extraction orbiter 2006-07-22 11:43:56 +00:00
e20ff77c10 another bugfix in new url class orbiter 2006-07-22 11:37:22 +00:00
685430a1b5 bugfix in new URL class, better loggin for domain extraction orbiter 2006-07-22 11:33:01 +00:00
c57b78722b added some more logging to domain extraction orbiter 2006-07-22 10:56:40 +00:00
79af283f6c better debugging in new URL class for wrong port numbers orbiter 2006-07-22 10:21:24 +00:00
cc2be7fb43 fix for genurllist in case of bad urls orbiter 2006-07-22 10:00:21 +00:00
1b2ea58ee9 wrong substring invocation. allo 2006-07-20 13:49:38 +00:00
e4f1820b58 protection against too long authentication strings in switchboard see also: http://www.yacy-forum.de/viewtopic.php?p=23943#23943 orbiter 2006-07-20 11:30:10 +00:00
b3f7e62e03 better handling of whitespace orbiter 2006-07-19 23:53:27 +00:00
4149939c02 better handling of whitespace for gettext quotation orbiter 2006-07-19 23:18:06 +00:00
97fa6788a1 added gettext support: automatic replacement of string appearances in html files by gettext quotes. see also: http://www.yacy-forum.de/viewtopic.php?p=23901#23901 orbiter 2006-07-19 22:35:36 +00:00
b3c569f706 *) renaming of function getTransferedEntitySpeed to getTransferedEntrySpeed to avoid confusion theli 2006-07-19 13:52:33 +00:00
01363bc7f6 missing file for the supertemplate demonstration. allo 2006-07-19 11:59:55 +00:00
ff3f174a2d case insentive commandline options allo 2006-07-19 11:20:22 +00:00
67edd80884 removed tabs orbiter 2006-07-19 11:13:14 +00:00
67c486a023 some example Code, how supertemplates can be used. allo 2006-07-19 07:08:15 +00:00
5214f571cd simplified method call in balancer orbiter 2006-07-19 00:42:20 +00:00
7b0e2521bb Support for a supertemplate, which can do all thing, a normal template can do. Its a layer under the servlets, this means, #[page]# will be replaced by serverletcode, the rest can be set by you. (TODO: if we use this for layout, we need to read "TITLE" from the servlet's tp, to set it outside of the servlet.) allo 2006-07-18 15:51:19 +00:00
4bd626572b added hashCode and compareTo to new URL class orbiter 2006-07-18 12:00:54 +00:00
abb5264929 fix for http://www.yacy-forum.de/viewtopic.php?p=23868#23868 orbiter 2006-07-18 11:52:56 +00:00
ff39a7a0d1 Overlay for welcome.* allo 2006-07-18 11:07:30 +00:00
a70cbd959b *) further improvements for the anomic.net.url class - relpath starting with javascript: are ignored now - bugfix for concatenation of relpath starting with # or ? in this case no slash should be added to the baseURL, otherwise we get URLs of the form http://test.de/index.html/?param=value theli 2006-07-18 05:12:08 +00:00
8a1f1d96b3 *) Bugfix for url concatenation. Relative urls with / or http:// at the beginning were not handled correctly on url concatenation via new URL(URL,relPath). See: http://www.yacy-forum.de/viewtopic.php?t=2623 theli 2006-07-18 04:48:18 +00:00
b5ec7de936 Correction to last commit + spelling rramthun 2006-07-17 16:23:47 +00:00
ca33eaa442 - Some spelling - Removed unused init value - Set default upload value to "none", which avoids an warning which says, upload method '' would be unknown, on new installations rramthun 2006-07-17 16:16:41 +00:00
8795875800 dirlisting for all empty directories. no problem to update dir.java anymore, because its only in htroot/htdocsdefault needed. migration to delete old dir.* files in the fileshare allo 2006-07-17 15:49:42 +00:00
45cefedd35 *) removed outdated seedlist low012 2006-07-14 21:49:50 +00:00
8e08125657 security fix (known path on yacy host / known path on remote ftp server) allo 2006-07-13 19:15:28 +00:00
7935f27038 enhanced synchronization in balancer orbiter 2006-07-13 01:31:00 +00:00
3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL This shall be seen as an experiment to exclude all cases where there could be a DNS lookup during URL comparisment. orbiter 2006-07-13 01:21:53 +00:00
07900366ac deactivated cache-initialization for file-indexes (files in WORDS) see also: http://www.yacy-forum.de/viewtopic.php?p=23801#23801 orbiter 2006-07-12 09:45:31 +00:00
40aa735520 fixe timing problem causing too long delay during initialization of kelondroTree objects orbiter 2006-07-11 23:44:44 +00:00
d2bb3f442e fixed timing problem causing a division by zero exception orbiter 2006-07-11 23:43:25 +00:00
379acb4915 -show stats command -statusbar for irssi (use /statusbar window add yacy(Links, Words, PPM) to insert the items) allo 2006-07-11 17:35:20 +00:00
6acb6a4d8f tiny performance optimization allo 2006-07-09 15:37:45 +00:00
933a9e02ab fix for broken build allo 2006-07-09 14:35:20 +00:00
360056b30c fix ajax bug (no valid xml) allo 2006-07-09 10:59:55 +00:00
2bdf1fc360 totalPPM allo 2006-07-08 22:41:48 +00:00
f4d200ffa2 typo allo 2006-07-07 20:44:45 +00:00
24a02cbeef *) Bugfix for not parsable application/xhtml+xml resources if an URL has no extension See: http://www.yacy-forum.de/viewtopic.php?p=23687 theli 2006-07-07 05:36:19 +00:00
b0ca5fa784 some correction algorithm for preload time computation during assortment open orbiter 2006-07-05 09:20:59 +00:00
e22cbaee97 - extended logging for preload - reduced preload-time for IndexImport_p.java orbiter 2006-07-05 09:02:58 +00:00
671fd9a5c9 work towards new indexing database structure (no effect on current functionality yet) orbiter 2006-07-04 14:47:27 +00:00
92f4cb4d73 added option to configure the start-up delay time for kelondro database files. the start-up delay is used to pre-load the database node cache orbiter 2006-07-03 23:57:33 +00:00
ce9dd3e76d some work in the index construction zone (no effect yet) orbiter 2006-07-03 15:14:54 +00:00
fe617d7e54 *) adding function to return the protocol type of a ssl connection theli 2006-07-03 14:16:46 +00:00
675d1081a4 code clean-up: switched off unused variables (bitte solche Variablen die nicht benutzt werden vermeiden. Ich habe hier ein strafferes Warning an, da bekommt man die immer angezeigt) orbiter 2006-07-03 13:39:08 +00:00
018b3e0832 added pause option to server threads. The pause is started by calling intermission(Long.MAX_VALUE) and can be stopped by calling intermission(0) orbiter 2006-07-03 13:20:14 +00:00
e1a52bea22 added a class stub for the new database structure: a reverse word index based on a a collection index, which is an index for a set of array files containing row collections. orbiter 2006-07-02 22:24:13 +00:00
3b69b35bf2 added pre-load of node cache entries to kelondroRecords this gives the kelondroTree data structure a similar start-up behaviour like the kelondroFlexTable: the cache is filled with routing data in such a way that is more performant than reading node records during normal operation. The pre-load phase stops automatically after a time-out of 500 milliseconds of if the cache is full. orbiter 2006-07-02 22:20:55 +00:00
31b5d8980e *) Bugfix for basic config redirection bug see: http://www.yacy-forum.de/viewtopic.php?p=23503 theli 2006-07-02 13:03:01 +00:00
85d575e928 enhancements to kelondroRow and kelondroColumn these are changes towards a better indexURLEntry implementation which are needed for the new database structures orbiter 2006-07-02 01:26:06 +00:00
ab1ed053f5 another small correction orbiter 2006-07-02 00:57:20 +00:00
b92561fb67 removed unused code orbiter 2006-07-02 00:44:38 +00:00
eadbd56fc5 small adjustment to last commit orbiter 2006-07-02 00:39:23 +00:00
e9765ac4e6 introduced bulk read for node iterator in kelondroRecords this speeds up the iterator by factor 2 orbiter 2006-07-02 00:31:20 +00:00
6643da3fbd bugfix for http://www.yacy-forum.de/viewtopic.php?p=23463#23463 (affected URL DB Cleaner) orbiter 2006-07-01 09:51:00 +00:00
866d53ed70 fix for DNS block bug see http://www.yacy-forum.de/viewtopic.php?p=23458#23458 orbiter 2006-06-30 22:39:33 +00:00
6af70febef - added kelondroTree index option to kelondroFlexTable - automatic generation of index file when index is too large for RAM orbiter 2006-06-30 12:54:19 +00:00
dd2865178a major bugfix (searched a whole week for the bug) for the kelondroRowBuffer, which has effect mostly to the kelondroFlexTable but also to all other database functions orbiter 2006-06-30 08:52:39 +00:00
f9b9d085c4 just changed testing code orbiter 2006-06-29 23:01:42 +00:00
068d82c4c2 Important update of YPStats rramthun 2006-06-29 20:30:50 +00:00
b594ee9a5a *) Adding possibility to configure if the http proxy should send the X-forwarded-for header (requested by TeeSee) See: http://www.yacy-forum.de/viewtopic.php?t=2577 theli 2006-06-29 16:01:03 +00:00
ef84fc4956 added IOException to size() and row() orbiter 2006-06-29 07:56:27 +00:00
7646849241 *) implementation of size() for mysql theli 2006-06-29 05:36:37 +00:00
84dfd76a6a kelondroFlex bugfix orbiter 2006-06-28 16:14:47 +00:00
0e9192a622 Updated YPStats_p.html rramthun 2006-06-28 09:51:38 +00:00
53077f5835 *)fixed paths to yacy.logging hydrox 2006-06-28 09:04:53 +00:00
8ba8e2b7d9 *) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache. hydrox 2006-06-28 08:51:34 +00:00
9f55973fe2 *) added some OpenDocument extentions to httpd.mime hydrox 2006-06-28 08:08:20 +00:00
db2405533a New YPstats possibility. Users can enter the details of their system configuration and we are able do work-out profiles for special uses and hardware-configurations. Default DB running on yacy-forum.de, but URL can be changed. User can see all data, which will be submitted. rramthun 2006-06-27 15:45:38 +00:00
53cbcc6d6e Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit See: http://www.yacy-forum.de/viewtopic.php?p=22911#22911 hermens 2006-06-27 11:14:30 +00:00
e40987ecab removed default memory reservation for testing orbiter 2006-06-27 09:16:07 +00:00
6e9efca5f5 old version, but not broken allo 2006-06-26 20:03:51 +00:00
4cc6e6551f bugfix orbiter 2006-06-26 09:52:23 +00:00
66964dc015 removed high/med/low from kelondroRecords cache control. this was done because testing showed that cache-delete operations slowed down record access most, even more that actual IO operations. Cache-delete operations appeared when entries were shifted from low-priority positions to high-priority positions. During a fill of x entries to a database, x/2 delete situation happen which caused two or more delete operations. removing the cache control means that these delete operations are not necessary any more, but it is more difficult to decide which cache elements shall be removed in case that the cache is full. There is not yet a stable solution for this case, but the advantage of a faster cache is more important that the flush problem. orbiter 2006-06-25 10:31:38 +00:00
6866bc2758 be quiet! allo 2006-06-24 17:40:55 +00:00
4c6083b264 network picture; back to old version borg-0300 2006-06-24 02:52:24 +00:00