yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-21 09:04:37 -04:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

fd7b348973 some fixes for the network switch orbiter 2010-01-17 22:07:08 +00:00
7d400b17d0 html parser support for .cfm files orbiter 2010-01-17 16:29:49 +00:00
f6731c6240 more logging etc. orbiter 2010-01-17 00:41:50 +00:00
007f8297de added php3 as extension type for html orbiter 2010-01-16 15:53:18 +00:00
4f1f4863c4 fix for deadlock when initializing a SplitTable with a file of size 0, see also: http://forum.yacy-websuche.de/viewtopic.php?p=18594#p18594 orbiter 2010-01-14 23:03:48 +00:00
763e0d447c removed unnecessary cast orbiter 2010-01-14 14:23:26 +00:00
cc5dcf69ff missing change for last commit orbiter 2010-01-14 14:20:18 +00:00
ca1ef9a079 fix for http://forum.yacy-websuche.de/viewtopic.php?p=18584#p18584 orbiter 2010-01-14 13:38:14 +00:00
d9169cc6c3 increased proxy load time-out from 30000 to 60000 milliseconds according to http://forum.yacy-websuche.de/viewtopic.php?p=17782#p17782 orbiter 2010-01-14 10:42:05 +00:00
34354cf9b2 added a servlet that has been removed in SVN 4881; this servlet is now splitted and will be used for a simple crawl start and a remote crawl monitor (not yet integrated into the interface) orbiter 2010-01-13 23:19:45 +00:00
938e806182 tried to fix date problem that may have prevented that foreign peers stay in the network - removed unused code - removed possibly wrong utc difference correction orbiter 2010-01-13 20:01:46 +00:00
bd05e57d3b fix for http://forum.yacy-websuche.de/viewtopic.php?p=18563#p18563 orbiter 2010-01-13 18:41:33 +00:00
5df628a2a4 - added BEncoder class - added BEncodedHeap class that encodes B data structures and stores that to a heap - refactoring of MapView, this is now named MapHeap to fit into the naming scheme of the BEncodedHeap orbiter 2010-01-13 16:21:37 +00:00
81035e7080 moved a sub-menu entry orbiter 2010-01-13 16:18:23 +00:00
5f1565cc95 Fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2540&sid=507e4dd9e234af001ba60c0d8adf45be, and small Layout Changes. suessthomas 2010-01-13 07:57:36 +00:00
82f57f79e5 more PMD enhancements orbiter 2010-01-13 00:23:07 +00:00
5d930c96f0 more fixes to search result page navigation orbiter 2010-01-13 00:04:37 +00:00
1375d0214d minor changes on the de language File - Thanks Copro suessthomas 2010-01-12 21:28:16 +00:00
8c520f128d reverted a change in ranking process committed this afternoon orbiter 2010-01-12 20:56:37 +00:00
a06f7ddb33 more PMD recommendations orbiter 2010-01-12 20:53:19 +00:00
eb79ceb3ff update to kelondro data structures orbiter 2010-01-12 15:37:34 +00:00
9bbd546e64 in live search, show at least 20 entries instead of only 10 this is a work-around for the problem that the search widget does not load a second page if the first page did not fill up the window with enough lines such that a scrollbar ist visible. Because the scrollbar triggers loading of following pages, this must be enforced with the trick that more result lines must be shown after the first search. orbiter 2010-01-12 15:23:01 +00:00
18172451a0 better search computation: - increased sort limit, now 3000 entries, before: 1000 this should cause that more results can be shown in case of strong limitating constraints, like domain navigation - enhanced the sort process - check against domain navigator bugs - fix in sort stack - showing now all naviagtion pages at first search (not only next page) orbiter 2010-01-12 15:01:44 +00:00
d126d6c1b5 renamed the servlet WatchCrawler_p to Crawler_p this was done because that servlet may be used for wget/cronjob triggered crawl starts and it appears to be confusing that the name of the crawl start servlet looks like a pure monitoring tool. orbiter 2010-01-12 10:05:28 +00:00
66c0a8e849 more PMD recommendations orbiter 2010-01-11 22:18:38 +00:00
909a4f91c7 added a logging output for crawl starts that shows the URL that can be used to start the crawl again orbiter 2010-01-11 18:10:39 +00:00
bc96d74813 - clean-up of robots.txt parser - added 'yacybot' as key to recognize robots.txt entries for YaCy - removed unused method to get robots.txt from database orbiter 2010-01-11 16:36:30 +00:00
2113fcd7e5 - fixed usage of isEmpty() which is not available in java 1.5 - increased visibility of some methods orbiter 2010-01-11 12:33:40 +00:00
dd459281c8 applied code changes that are recommended by PMD orbiter 2010-01-10 23:09:48 +00:00
eac2daf2e8 * reenable DHT if yet enough memory is available * reset treshold on reconfiguratoin (thanks to sixcooler) lotus 2010-01-10 19:04:43 +00:00
0752634b8b log YaCy version on startup lotus 2010-01-10 16:10:11 +00:00
d77a8f3b3e added some modifications recommended by PMD for better performance orbiter 2010-01-10 01:40:26 +00:00
d1973bae2a code cleanup: removed unused code and unused methods orbiter 2010-01-10 00:42:49 +00:00
a3b8b7b5c5 some redesign of the main menu structure: - moved all index generation servlets to it's own main menu item, including proxy indexing - removed external index import because this operation is not recommended any more. Joining an index can simply be done by moving the index files from one peer to the other peer; they will be merged automatically - fix to prevent endless loops when disconnecting http sessions - fix to prevent application of bad blacklist entries that can cause a 'Dangling meta character' exception orbiter 2010-01-10 00:10:43 +00:00
ab3cf60dbe fix for npe lotus 2010-01-09 14:10:27 +00:00
7f20963b41 add-on to last commit orbiter 2010-01-09 00:17:39 +00:00
eeca2ded92 fix for http://forum.yacy-websuche.de/viewtopic.php?p=18500#p18500 - catch uncatched OOM - less wasting of memory orbiter 2010-01-09 00:08:16 +00:00
32972139af added nice configuration for the resource observer lotus 2010-01-07 17:19:50 +00:00
bb2e03761c - fix for deadlock with 100% CPU during search - fix for failure of ranking because of a ConcurrentModificationException orbiter 2010-01-07 12:41:43 +00:00
3f771d2a16 fix for rss parser: be lazy when rss is not well-formed orbiter 2010-01-07 01:02:23 +00:00
dff4f95c78 some patches to get the torrent parser working orbiter 2010-01-07 00:42:12 +00:00
75dfe4098c Clean up the de.language File, removed all unused Blocks. All unused Blocks copied in a new File and archived this on my Homepage (http://tokeek.de). The Cleanup de.language File is easy readable, is the basic for more improvements. suessthomas 2010-01-05 21:24:36 +00:00
574f49903e Prevent blob merge from possibly losing the last container hermens 2010-01-05 01:34:46 +00:00
83d05e9176 added sixcoolers hack with some modifications: http://forum.yacy-websuche.de/viewtopic.php?p=15004#p15004 old index blobs where deletions have been made because of DHT transmission should be melted down to new blobs. This uses sixcoolers methods from the forum thread but modifies the process in such a way that the blobs are not merged with themselves but simply rewritten to smaller files. orbiter 2010-01-04 18:12:03 +00:00
fbd24c2d84 integrated the torrent parser orbiter 2010-01-04 16:07:31 +00:00
bd32f8b8cb added a torrent metadata file parser orbiter 2010-01-03 23:26:15 +00:00
610e3ffffb Added new classes for the implementation of concurrent greedy algorithms. These classes can be used to produce an abstract worker process that can be used for common problems in artificial intelligence, such as game playing and problem solving. These classes will be used as abstraction layer for a new search process in YaCy. These classes had been created while searching for an abstraction of the current search process. It turned out that the abstraction of the YaCy search process is also an abstraction for problems in artificial intelligence and therefore the classes had been designed in such a way that it covers not only the YaCy-specific problem but also the more generic problems in ai. To test the classes they had been used in a ConnectFour implementation (game playing). orbiter 2010-01-03 22:51:14 +00:00
d0b7bf9ca2 added a decoder class for Bencoding orbiter 2010-01-03 22:44:09 +00:00
04d91c67d6 *) added message if unrestricted access from localhost is possible *) added link to admin access config page low012 2009-12-28 14:01:41 +00:00
028657f019 *) adding more SVN properties *) minor changes low012 2009-12-28 13:11:07 +00:00
82d740050f *) adding more SVN properties *) minor changes low012 2009-12-28 12:26:50 +00:00
e04cb8cef0 *) adding more SVN properties *) minor changes low012 2009-12-28 12:16:40 +00:00
dcb1096fb0 *) adding more SVN properties low012 2009-12-28 11:22:32 +00:00
7d610e0063 *) minor changes low012 2009-12-28 11:20:34 +00:00
82198acc06 *) minor changes low012 2009-12-28 11:06:49 +00:00
b75547fc60 *) minor changes low012 2009-12-28 11:05:50 +00:00
e8fb332567 *) script does not allow empty passwords anymore low012 2009-12-28 10:16:39 +00:00
d933763b12 Small Changes on the de. language File and small correction to the ConfigAppearance_p.html page. Please test and report bugs to me (th-suess@gmx.de). suessthomas 2009-12-26 21:18:20 +00:00
9bee0ac780 more logging for DHTrule lotus 2009-12-21 14:02:00 +00:00
57d729e377 fix for negative numbers in network statistic orbiter 2009-12-21 11:36:48 +00:00
f8dc1dfabe include query in document title lotus 2009-12-19 21:26:19 +00:00
4ac4fe952c patch for npe in bookmarks orbiter 2009-12-18 10:14:05 +00:00
c14233a933 fix for a OOM in MapView that can cause unavailability of - seed list - bookmarks during very low memory configuration orbiter 2009-12-15 12:23:37 +00:00
d548bd41ad fix for a npe during search orbiter 2009-12-15 12:15:39 +00:00
37245430c3 fix for NPE during DHT RWI selection orbiter 2009-12-15 00:02:10 +00:00
959b38b61b fix for memory tracker orbiter 2009-12-14 20:23:11 +00:00
bf08e59334 Conversion of the de. Language File into UTF-8 format. Please test and report bugs to me (th-suess@gmx.de). Small Changes on the de. language File. The old Language File archived on http://tokeek.de suessthomas 2009-12-13 22:11:03 +00:00
a37878b7d5 url parser regex performance hack orbiter 2009-12-10 14:40:32 +00:00
2126dffea2 fix for rss/xml output for image search from AndreasB orbiter 2009-12-09 23:58:56 +00:00
b527d2ebfa fix for media search orbiter 2009-12-09 23:47:37 +00:00
362b7a929b added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function orbiter 2009-12-09 23:27:26 +00:00
8281e29963 - more configuration for profiling graph (number of events) - more logging for a shutdown: print reason and accessing IP into log orbiter 2009-12-08 14:25:51 +00:00
5f0f6b71b4 * revert last commit, something is more broken than before * UTC timestamps and lastseen-properteries still needs some debugging f1ori 2009-12-06 21:54:32 +00:00
8c8b642eba * fix timezone problem f1ori 2009-12-06 21:03:12 +00:00
713cb26a27 update for memory observer algorithm disable dht if memory is less than treshold after 4 times, maximum 11 minutes between each detection lotus 2009-12-06 17:45:48 +00:00
a44112b562 - moved index cleaner to blacklist submenu, because the index cleaner cleans the index with the blacklist - version switch to 0.93 to reflect advancements orbiter 2009-12-03 14:26:30 +00:00
4782d2c438 fix for search bug that appeared when looking at page 3 of results or further orbiter 2009-12-03 12:25:03 +00:00
29fde9ed49 better control of ranking order in sort stack orbiter 2009-12-03 00:36:07 +00:00
93caa38d55 fix for bug in SortStack (did not appear to shrink according to required size) - caused bad and unsufficient search results orbiter 2009-12-03 00:20:53 +00:00
66923ebc6c - modified method in RequestHeader that delivers the host name of requester: no more reverse domain lookup (may have killed interface performance in some cases) - added logging output for shutdown servlet: show ip of requester of the shutdown orbiter 2009-12-02 22:56:28 +00:00
e34e63a039 preset of proper HashMap dimensions: should prevent re-hashing and increase performance orbiter 2009-12-02 14:01:19 +00:00
4a5100789f replaced _all_ size() == 0 with isEmpty() and all size() > 0 with !isEmpty(). The isEmpty() method is much faster in some cases, especially when used to access badly balanced hashtables where an size() operation becomes a large iteration. orbiter 2009-12-02 00:37:59 +00:00
f4946eaf27 - better thread dump - suppressed one server exception orbiter 2009-12-01 22:53:36 +00:00
9743b70d1c disabled keep-alive of server, not really needed for speed but a cause for much trouble and memory occupancy orbiter 2009-12-01 19:14:16 +00:00
a4e72928ad classpath correction lotus 2009-11-29 19:56:25 +00:00
173aa84611 *) Ooops! low012 2009-11-29 19:37:49 +00:00
e47e8a8bfe *) corrected classpath settings low012 2009-11-29 19:36:15 +00:00
491ba6a1ba - some refactoring in workflow - some refactoring in search process - fixed image search for json and rss output - search navigation on bottom of search result page in cases where there are more than 6 results on page - fixes for number of displayed documents - disabled pseudostemming orbiter 2009-11-24 11:13:11 +00:00
969123385b added json and rss output for image search orbiter 2009-11-23 16:10:50 +00:00
016fdfa310 stub for json image search (not yet ready) orbiter 2009-11-23 00:43:51 +00:00
82258b2882 default skin: rounded fieldsets lotus 2009-11-21 12:42:59 +00:00
40900eebb4 *) better comment *) r6500! low012 2009-11-20 21:53:43 +00:00
19fd5a3c33 *) script is much more userfriendly now low012 2009-11-20 21:49:39 +00:00
d183f8d980 refactoring (moved code from ContentTransformer to TemplateEngine) orbiter 2009-11-20 14:57:00 +00:00
23aef43786 - better synchronization in SortStack - better ThreadGroup organization - less worker threads for media search (64 was too much...) orbiter 2009-11-20 14:35:33 +00:00
7b1f5b0430 - better media search ranking - better concurrency with enhanced synchronization in sort stack orbiter 2009-11-20 13:19:12 +00:00
4df88a4e7a - fixes for missing or bad hashCode computation - fixes for bad equals() methods that had not been used by hash maps and therefore some classes did not work as objects in hash maps. - this may also affect some cases where double-checks should have been, but did not work. orbiter 2009-11-20 12:11:56 +00:00
dbdf2570ba added comparator and more fixes for SortStack/SortStore orbiter 2009-11-20 03:30:48 +00:00
d2938c44a1 - added bmp parser to the document parsers - image parser that implement the document parser interface return itself in the list of images of the document which should cause that the parsed images contribute to the image search orbiter 2009-11-19 23:22:53 +00:00
1dff620181 Better implementation of SortStack and SortStore and adoptions in all using classes to implement the necessary Comparable interface and hash code computation. The better SortStack performance affects crawling and image search speed and quality. orbiter 2009-11-19 13:49:28 +00:00