yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-24 09:34:38 -04:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

84e37387a2 fix for last commit and more testing stub orbiter 2009-03-11 09:16:46 +00:00
ca006c506d stub for performance enhancements for RowSet (no functional change yet) orbiter 2009-03-11 08:55:43 +00:00
d988204875 better shutdown of tools orbiter 2009-03-10 23:17:13 +00:00
100247bdda added also an export and delete-feature to the URLAnalysis. This completes the clean-up feature for URLs. To do a complete clean-up of the url database, start the following: java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -incollection DATA/INDEX/freeworld/TEXT/RICOLLECTION used.dump java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -diffurlcol DATA/INDEX/freeworld/TEXT used.dump diffurlcol.dump java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -export DATA/INDEX/freeworld/TEXT xml urls.xml diffurlcol.dump java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -delete DATA/INDEX/freeworld/TEXT diffurlcol.dump orbiter 2009-03-10 20:52:10 +00:00
8c60d6d117 In DHT selection delete only those references that were actually selected hermens 2009-03-10 13:56:30 +00:00
60078cf322 added next tool for url analysis: check for references, that occur in the URL-DB but not in the RICOLLECTIONS to use this, you must user the -incollection command before (see SVN 5687) and you need a used.dump file that has been produced with that process. orbiter 2009-03-10 13:38:40 +00:00
b1ddc4a83f do not merge collections if ram == false orbiter 2009-03-09 23:38:29 +00:00
dbdd10da84 better logging and startup behaviour for referenceHash computation orbiter 2009-03-09 22:32:04 +00:00
d612430fce copy paste mistake borg-0300 2009-03-09 19:05:36 +00:00
acbdac1b67 corrected examples borg-0300 2009-03-09 18:37:50 +00:00
d64836c34f added statistical analysis of URL reference use that with the following command on a linux shell: java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -incollection DATA/INDEX/freeworld/TEXT/RICOLLECTION used.dump for freeworld indexes. For more details please see discussion below: http://forum.yacy-websuche.de/viewtopic.php?p=13204#p13204 orbiter 2009-03-09 10:43:28 +00:00
3b28daab40 code-beautification (to be consistent with external documentation paper) orbiter 2009-03-09 10:24:15 +00:00
396a4451be increased timeout in ViewFile orbiter 2009-03-09 10:16:37 +00:00
485c9406e5 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1915&hilit=&p=13249#p13249 orbiter 2009-03-09 10:14:49 +00:00
858f800a07 more logging in httpd to detect shutdown cause. See also: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1914&hilit=&p=13246#p13246 orbiter 2009-03-09 09:56:26 +00:00
b80db04667 - refactoring of IntegerHandleIndex and LongHandleIndex (better method names) - fix for problem in httpdFileHandler: mising close of open Files if tempate cache was disabled - more memory for DHT selection required - stub for URL reference hash statistics in index collections orbiter 2009-03-08 21:37:17 +00:00
9b6fac4a82 RichClient: better handling for small screens/windows apfelmaennchen 2009-03-08 08:55:04 +00:00
92375cfaa3 translation update lotus 2009-03-07 15:34:54 +00:00
8ee946bf1d show upnp status lotus 2009-03-07 15:31:24 +00:00
f0947a20a8 - RichClient: increased ajax timeout to 10 sek. apfelmaennchen 2009-03-07 11:01:13 +00:00
e73ac67f7e - for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient apfelmaennchen 2009-03-07 10:51:24 +00:00
16f5c6a85e fixed merge method initialization in ReferenceContainer orbiter 2009-03-07 10:45:14 +00:00
f7fd3d30c2 - various changes to RichClient - improved search stability apfelmaennchen 2009-03-07 10:20:34 +00:00
4f3bdc64b5 - added ?callback= parameter for JsonP support - this is needed for json ajax cross domain calls - see: http://bob.pythonmac.org/archives/2005/12/05/remote-json-jsonp/ apfelmaennchen 2009-03-07 10:18:47 +00:00
d84264946b - Randspalte für Navigatoren in Suchergebnissen (display=3) - http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p13195 apfelmaennchen 2009-03-06 17:51:04 +00:00
d7a493b4f5 added experimental timeline api orbiter 2009-03-06 16:01:29 +00:00
efcd95dc37 simplification of (internal) query process / refactoring orbiter 2009-03-06 15:53:20 +00:00
f1b712c29a small corrections to image loading methods in result presentation especially loading of favicons in search results. This is a fix that affects only searches in intranet/repository configurations. orbiter 2009-03-06 15:39:02 +00:00
98f36a801a - small update to search result layout - some more mime types orbiter 2009-03-06 10:16:14 +00:00
4f6658b115 * non-sliding api icon * regex doc links update lotus 2009-03-05 20:41:30 +00:00
d4b56d5819 added more asserts to BLOBHeap.flushBuffer() to fix the problem described in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1679&hilit=&p=13109#p13109 orbiter 2009-03-03 23:24:19 +00:00
c545fcb9fa * add class to handle keys and signatures * fix bug in serverCharBuffer * add build-target to sign tar.gz (run ant dist sign) f1ori 2009-03-02 13:29:50 +00:00
aa44d9bad9 more refactoring of kelondro.text / deleted de.anomic.index orbiter 2009-03-02 11:04:13 +00:00
6ffc6e3389 more refactoring of indexer and kelondro classes; - integrating the indexer into kelondro as package 'text' - renaming of classes in kelondro.index orbiter 2009-03-02 10:00:32 +00:00
404bc21da9 simplification of (internal) query process / refactoring orbiter 2009-03-02 08:48:27 +00:00
76ef5f0f14 refactoring of index package: better names for the classes (to be continued) orbiter 2009-03-01 23:58:14 +00:00
2df57b1fd1 refactoring of index collection class orbiter 2009-03-01 23:07:45 +00:00
39a177649b * added upnp listener for devices that do not respond to discovery but advertise themselves * moved package lotus 2009-02-28 14:36:23 +00:00
d1d9fbae5c enabling the URLAnalysis to operate on multime input files, just use a wild card when calling the class from the command line orbiter 2009-02-26 23:47:41 +00:00
c728879ab8 fixes to yacyURL - more exceptions in case that urls are strange orbiter 2009-02-26 22:33:47 +00:00
7542336ae5 performance enhancement to yacyURL: omit second processing of resolveBackpath. This method is already applied during initialization of the object and was called a second time when the url was exportet. orbiter 2009-02-26 21:52:32 +00:00
7ea53fe47b added another url list transformation option: - check the list and kick out entries with lines that contain not valid urls - normalize the urls - remove doubles - sort the list - split the list in smaller chunks This is all done in one process which can be called with a new -sort option orbiter 2009-02-26 21:51:23 +00:00
e521e81148 bugfix in yacyURL (for latest performance hack) orbiter 2009-02-26 07:46:47 +00:00
54625360f7 performance update orbiter 2009-02-25 23:27:21 +00:00
d884c4718a added gzip support for URLAnalysis: url lists can also be compressed with gzip If such a file is handed over to URLAnalysis, the output will also be written as .gz-file orbiter 2009-02-25 13:40:51 +00:00
46632f4385 performance update to yacyURL orbiter 2009-02-25 00:17:34 +00:00
cf9b74e6e3 added another method to process url lists: extract hosts only This can be used like java -Xmx2000m -cp classes de.anomic.data.URLAnalysis -host DATA/EXPORT/20090224213823.txt orbiter 2009-02-24 22:51:07 +00:00
89d8e824ed memory protection for URLAnalysis orbiter 2009-02-24 22:05:09 +00:00
0f6fa804ff performance update to URLAnalysis orbiter 2009-02-24 21:35:33 +00:00
8444357291 added new row interator in kelondro tables files that enumerates rows without an order by the primary key. The result is a very fast enumeration of the Eco table data structure. Other table data types are not affected. The new enumerator is used for the url export function that can be accessed from the online interface (Index Administration -> URL References -> Export). This export should now be much faster, if all url database files are from type Eco The new enumeration is also used at other functions in YaCy, i.e. the initialization of the crawl balancer and the initialization of YaCy News. orbiter 2009-02-24 10:40:20 +00:00
e8f5f2f612 added tool to analyse url strings and to generate statistics about words occurring in urls orbiter 2009-02-24 10:00:35 +00:00
72cc1d3a6c YaCy-UI: fix for query string handling in yacyuisearch.html: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1869#p12878 apfelmaennchen 2009-02-24 07:48:23 +00:00
784a7bb7fd YaCy-UI: small fix apfelmaennchen 2009-02-24 07:03:55 +00:00
aa13d03b99 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914 apfelmaennchen 2009-02-23 23:08:58 +00:00
6117e083e5 option to customize tray label (tooltip) with tray.label lotus 2009-02-23 21:07:08 +00:00
b8c3803bfc don't panic when canceling server sessions orbiter 2009-02-23 17:15:52 +00:00
1df1fd91b0 small update daburna 2009-02-23 17:02:15 +00:00
de714783b1 - added host, path, filename to search result - modified yacyinteractive, shows now also date - added size attribut to export file in xml format orbiter 2009-02-23 11:39:20 +00:00
7cfab2ee9a added a size field to the search results. The file size is now shown in the html search page and the yacyinteractive. The field is presen in the rss and json orbiter 2009-02-23 07:59:11 +00:00
4693495bbe added sru-compatibility to yacyuisearch ('query' instead of 'search') orbiter 2009-02-22 23:43:05 +00:00
9519d84372 changed "dooble" variable to "browserintegration" to be less specific lotus 2009-02-22 17:32:17 +00:00
54c7698219 YaCy-UI: some clean up of base.css apfelmaennchen 2009-02-22 16:00:24 +00:00
5d806623d5 YaCy-UI: - fix for folders - first experiments with topwords - first experiments with bookmark tag folder apfelmaennchen 2009-02-22 15:59:24 +00:00
8429083972 adjusted tray for dooble: you can now set dooble=true in yacy.init to disable the menu and browser popups by default lotus 2009-02-22 15:11:44 +00:00
bd6a3083c5 YaCy-UI Widget: added a target='_blank' to search results apfelmaennchen 2009-02-21 22:35:41 +00:00
b6b39e9556 YaCy-UI Widget: - added parameters fontsize=[small,normal,big], height and width - e.g. http://localhost:8080/yacy/ui/yacyui-widget.html?style=darkness&fontsize=small&height=400&width=300 apfelmaennchen 2009-02-21 22:25:07 +00:00
be29ece9d0 - added a new YaCy-UI Widget: /yacy/ui/yacyui-widget.html?style=xyz - http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1127#p12781 apfelmaennchen 2009-02-21 13:30:47 +00:00
ef62ec635e removed overwriting of logging config orbiter 2009-02-21 00:43:38 +00:00
c852d2d70e - reject too old seeds - do not store the complete seed in the reverse name cache, only the hash of the peer orbiter 2009-02-21 00:39:44 +00:00
aca973e2d9 catch more exceptions orbiter 2009-02-20 23:24:49 +00:00
9559bc23fd automatic clean-up of dead connections (hope that works well..) orbiter 2009-02-20 22:27:02 +00:00
02dfd6183b Fix logging in serverCore Prevent NPEs from keeping stopped Sessions in the pool and blocking slots hermens 2009-02-20 18:54:01 +00:00
d30456e2c8 Fix logging in serverCore Prevent NPE: I 2009/02/20 15:15:56 PLASMA check for Session_77.37.19.225:38812#0: 86515 ms alive, stopping thread I 2009/02/20 15:15:56 PLASMA Closing main socket of thread 'Session_77.37.19.225:38812#0' E 2009/02/20 15:15:56 SERVER receive interrupted - exception 2 = Socket closed Exception in thread "Session_77.37.19.225:38812#0" java.lang.NullPointerException at de.anomic.server.serverCore$Session.run(serverCore.java:623) hermens 2009-02-20 15:12:00 +00:00
4f9dae2571 remove reference in crawl entries orbiter 2009-02-19 22:58:00 +00:00
1ba4301920 automated interruption of dead incoming connections, if they are there for more than one minute orbiter 2009-02-19 22:27:24 +00:00
c12bb8a6d0 - refactoring of the http client - added a protection against memory leaks for the access tracker orbiter 2009-02-19 16:24:46 +00:00
5d3983faae the soLinger parameter was wrong. With soLinger=true the httpd looses connections The effect can be seen when crawling the internal repository: lost connections filled the client process queue until it was full and no more connections were possible. orbiter 2009-02-17 16:22:15 +00:00
62505bb3cb more bugfixes as recommendet by findbugs orbiter 2009-02-17 09:12:47 +00:00
6b450d09ca some fixes recommended by findbugs orbiter 2009-02-16 23:31:54 +00:00
4db80065ac select more orbiter 2009-02-16 21:53:37 +00:00
94c42691d8 - reject less transmissions as transmission receiver - do not flag too much receiver when something goes wrong during transmission as sender orbiter 2009-02-16 21:28:48 +00:00
f887fc159f try to reduce the large number of unclosed incoming connections orbiter 2009-02-16 16:26:57 +00:00
e04a0e05c3 fix for last commit orbiter 2009-02-16 16:21:12 +00:00
a9ad863686 second part of 'doubles' fix - better handling of doubles in RAMIndex. More logging. still missing: deletion of double entries in collections orbiter 2009-02-16 16:13:48 +00:00
59427064fb first part of 'doubles' fix (not fully ready yet) orbiter 2009-02-16 00:47:48 +00:00
26978b2a25 - better memory protection in kelondro caches: computation of needed memory for cache grow - removed excessive gc calls - step to 16 vertical DHT partitions orbiter 2009-02-15 23:35:59 +00:00
e9e2fff47a better scaling on performance graph lotus 2009-02-15 17:36:13 +00:00
4aad461100 added UPnP support YaCy can now automatically forward ports on home routers off by default lotus 2009-02-14 13:12:08 +00:00
62762ba81a fix for thread dump orbiter 2009-02-14 01:08:20 +00:00
99b9788e54 fix for possible 100% CPU caused by concurrent access of HashMap orbiter 2009-02-14 00:39:53 +00:00
be0c492ae5 fix for memory leak bug in new dht transmissions orbiter 2009-02-14 00:01:05 +00:00
2173865f92 Prevent race condition when switching timezones. hermens 2009-02-13 11:59:50 +00:00
40ab13c886 YaCy-Ui: small bug fixes apfelmaennchen 2009-02-13 11:00:34 +00:00
40d9849aa4 - better control of chunk size in dht selection - more restrict values in selection - step to 4 vertical partitions orbiter 2009-02-12 14:47:32 +00:00
5d3233ca6c some updates for german translation daburna 2009-02-12 14:24:14 +00:00
e4597bd780 YaCy-UI: small bugfix apfelmaennchen 2009-02-11 17:28:51 +00:00
30a1de41b3 disabled the BufferedIOChunks, because I consider it as broken. I will try to fix that, but it is better to not use a buffer than using a broken buffer. orbiter 2009-02-11 15:21:48 +00:00
411f2212f2 more memory leak fixing hacks orbiter 2009-02-11 13:31:10 +00:00
8aafbe234b YaCy-UI: - some themes to get started apfelmaennchen 2009-02-11 12:58:04 +00:00
222c97b798 YaCy-UI: - updated to jquery 1.3.1 - updated to jquery-ui 1.6rc6 - added support for themes (not yet persistent but otherwise working well) - deleted some obsolete files apfelmaennchen 2009-02-11 12:50:42 +00:00