yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-09 00:16:11 -05:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#721

#722

#730

#734

#737

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

59928a034f Updated German translation: - Cleaned up env/templates/header.template and added steering - Added translations for the new page Table_API_p.html mikeworks 2010-02-07 13:46:01 +00:00
bc9f32a7b4 Removes an unused CSS entry (.TableCellPassive ) suessthomas 2010-02-06 21:36:29 +00:00
11188cd7eb resource observer now uses the Java 6 method to check for free space. thus, disk observing now needs Java 6 installed. lotus 2010-02-06 18:48:06 +00:00
089877f32c my first commit - hopefully fix for merge problem - http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2652 sixcooler 2010-02-05 19:38:00 +00:00
9953155cb5 Updated German translation with missing parts in Bookmarks.html, CrawlResults.html and IndexControlRWIs_p.html, mikeworks 2010-02-05 06:25:45 +00:00
be18b5d8cd fix for 'cannot switch back to default language'-bug orbiter 2010-02-04 23:53:02 +00:00
d6391f2537 better handling of rewrite cases where the resulting rewrite blob entry is equal in size orbiter 2010-02-04 23:17:47 +00:00
ef9473d92c added another sixcooler suggestion: recycle corrupted records orbiter 2010-02-04 16:25:05 +00:00
fe78edac32 - view API calls in correct date-order - execute recorded API calls in date-order orbiter 2010-02-04 15:51:54 +00:00
74e736c903 missing file for last commit orbiter 2010-02-04 14:52:58 +00:00
308a973503 refactoring of tables data organisation orbiter 2010-02-04 11:26:23 +00:00
85ca96227f fix for re-enable parser lotus 2010-02-03 19:33:59 +00:00
8a76f38d26 Added a new steering servlet that can be used to repeat actions that had been made on the yacy interface. This can be used to: - start again a previously started crawl - submit settings (again). This option will be used to transmit all settings of one peer to another peer if the remote-peer steering function is ready This steering framework will also be used for a 'schedule-everything' which will also include a new scheduler for crawling. orbiter 2010-02-03 09:31:12 +00:00
530b77d05a adapted loglevel for accepted urls lotus 2010-02-02 09:47:43 +00:00
5f661d9f5d fix receive of crawl receipt in private peer mode http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2655 lotus 2010-02-02 09:42:14 +00:00
840527689b more simplification of bookmark class orbiter 2010-02-01 23:04:52 +00:00
d77782a8d5 removed bookmark tags file, tags are now stored only in RAM orbiter 2010-02-01 22:44:59 +00:00
ada0ce9de3 refactoring of bookmarks: there is a big performance problem in the bookmarks code and furthermore the bookmarks will loose its leading role for the re-crawl funtion when the new api tables will work. To be prepared for a replacement of such functions the bookmark class is re-organised. orbiter 2010-02-01 22:18:56 +00:00
3751ab4ae2 added sixcoolers patch and more checks/removed unnecessary code orbiter 2010-02-01 16:11:00 +00:00
d8d8562c59 fill key with zeros during normalization orbiter 2010-02-01 15:40:16 +00:00
a131ebbcb5 one more fix for NPE, see http://forum.yacy-websuche.de/viewtopic.php?p=19010#p19010 orbiter 2010-02-01 11:28:37 +00:00
dcb7166594 Updated German translation: * Reversed translation of "all" and "admin" to not break funtionality in Wiki.html * Cleaned up translation and got rid of all unused strings * Added some translations for the Rich Client (New UI) - for some a modification of translator.java to include .js files is needed mikeworks 2010-01-31 13:50:28 +00:00
8926d824c6 small modification lotus 2010-01-31 12:09:42 +00:00
24060885b6 - added Tables abstraction in data.Tables.java fix for http://forum.yacy-websuche.de/viewtopic.php?p=18910#p18910 http://forum.yacy-websuche.de/viewtopic.php?p=18894#p18894 http://forum.yacy-websuche.de/viewtopic.php?p=18814#p18814 orbiter 2010-01-29 18:02:09 +00:00
7fdf59a77f misc NPE check orbiter 2010-01-29 15:59:24 +00:00
a512aef6ad fix for http://forum.yacy-websuche.de/viewtopic.php?p=18918#p18918 orbiter 2010-01-29 10:33:20 +00:00
1cb4506325 Updated German translation adding the following pages: * ConfigLiveSearch.html * ConfigPortal.html * ConfigSearchBox.html mikeworks 2010-01-28 06:22:50 +00:00
a29b17a2fd Minor HTML Changes, Images recompress. suessthomas 2010-01-27 21:38:54 +00:00
67dd376a33 *) hopefully solving ipv4/ipv6 issue described in http://www.yacy-forum.org/viewtopic.php?f=2&t=252&start=30#p1248 and http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2554 low012 2010-01-26 19:22:14 +00:00
67b8d5149e Small Changes on Network.html - Specifying image dimension suessthomas 2010-01-26 14:56:27 +00:00
5cbef63c37 fixed bad ip pattern lotus 2010-01-26 14:25:15 +00:00
8e130ae426 Updated German translation: Filling PerformanceMemory_p.html section mikeworks 2010-01-25 00:04:39 +00:00
21624a423e Updated German translation: - translated free mem warning in Status and security localhost message mikeworks 2010-01-24 20:37:04 +00:00
38a3d55afd added more possible php extensions for html lotus 2010-01-24 20:04:31 +00:00
e87f0e83a2 Updated German translation: - Fixed a typo in ConfigPHPBB3Search.html - Added section for ConfigPHPBB3Search.html and translation mikeworks 2010-01-24 13:12:10 +00:00
5bffc58261 Updated German translation: - updated section for Performance_p.html - added section for Tables_p.html which is no longer present in current SVN version mikeworks 2010-01-24 12:32:28 +00:00
2be9021157 Updated German translation: - Covered Filter & Blacklists starting from Blacklist_p.html - Fixed some errors and missed lines mikeworks 2010-01-23 02:36:16 +00:00
d915deaa2b Fixed type in CrawlStart_p.html Changed to German language file: - Updated Crawl Start Page - Added section for indexing MediaWikis - Fixed some more start and end tags so that syntax highlighting works correctly mikeworks 2010-01-22 23:00:05 +00:00
4403304957 bugfix for list() orbiter 2010-01-22 16:00:56 +00:00
3889438db6 fix for bookmarks orbiter 2010-01-22 14:20:24 +00:00
feacf7294b removed unused folder xml; all classes that had been in xml had been moved to api orbiter 2010-01-22 13:36:09 +00:00
23bcca07a3 removed directly linked servlets that had been there to test memory failures that appeared in that servlets orbiter 2010-01-22 13:30:20 +00:00
69c29acb6e no exception thread dump if parser cannot parse becuase that mime-type/extension is in the deny-set orbiter 2010-01-22 13:21:37 +00:00
0098e6e859 bugfix for heap iterator orbiter 2010-01-22 10:26:50 +00:00
597a410f58 ups orbiter 2010-01-21 22:16:28 +00:00
db19a941cf added new image index storage classes (not integrated yet) orbiter 2010-01-21 22:12:05 +00:00
c8aece34a4 update to yacy/ai (just more testing) orbiter 2010-01-21 22:07:32 +00:00
8ce936bcdd added an api recording function: it shall be possible to record all operations on YaCy in a database that should make it possible 1) to re-create a setting on fresh peers 2) to transmit a setting from one peer to another 3) to re-create crawl starts after a complete deletion of the index This functionality will also support 4) scheduled re-crawls (new implementation) To implement this, a new database structure has been crated that stores maps into blob heaps. to encode maps the b-encoding technique was used (this is the same encoding that torrent files use) - added a b-encoder - enhanced the b-decoder - added a b-encoded map heap data structure - added a table organisation based on b-encoded heaps - added a servlet to maintain such tables (see Tables_p.html) - integrated the servlet into the Advanced Settings menu - added an api recording based on the new tables orbiter 2010-01-21 22:06:03 +00:00
8df1694288 - added options to switch on/off search domains (text, image, audio, video, app) - more memory by default orbiter 2010-01-21 22:03:02 +00:00
19ff7da2b4 German language file change: - Updated pages are Blog, Bookmarks, CookieMonitor*, CrawlResults, ProxyIndexingMonitor_p.htm, Wiki.html, yacyinteractive.html mikeworks 2010-01-21 01:44:29 +00:00
d4579377f8 Updated German language file - Fixed some end tags (#-----------------------------) for syntax highlighting to properly detect the end - Updated translation on pages in Search & Browse category mikeworks 2010-01-21 00:44:10 +00:00
3597dee3e3 Updated syntax highlighting support for YaCy lng (language) files in Notepad++ mikeworks 2010-01-20 20:34:40 +00:00
c5322dd3a7 Updated German language file - Updated changed lines in CrawlProfileEditor_p.html and WikiHelp.html - Updated new navigation menu structure and some submenus mikeworks 2010-01-20 07:37:03 +00:00
ee52634daa Updated french language file due to changes to CrawlProfileEditor_p.html and WikiHelp.html mikeworks 2010-01-20 07:34:54 +00:00
eac3b696ab Fixed typos in WikiHelp.html mikeworks 2010-01-20 07:34:43 +00:00
03fb4a1980 Fixed typos CrawlProfileEditor_p.html mikeworks 2010-01-20 07:33:10 +00:00
56e0d9bd01 - testings with image parser - added image size as part of parsed text in images - avoid unnecessary error messages if parsing of documents failed but one succeeded orbiter 2010-01-19 14:59:58 +00:00
e80e060ca6 - increased thread priority for server threads - decreased thread priority for crawler threads orbiter 2010-01-19 11:29:22 +00:00
78daea95c3 show more navigation pages if there are too less locally orbiter 2010-01-19 00:21:55 +00:00
25c545c4b0 first commit fixing two typos mikeworks 2010-01-18 07:25:41 +00:00
234f733a3d - relocation of seed db is better for network switch than re-initialization because of the embedding of the peers object in other objects - small refactoring of blacklist interface code to remove PMD warnings orbiter 2010-01-18 00:07:20 +00:00
473b11033d fixed network switch process - crawling did not work after a switch before this fix orbiter 2010-01-17 23:33:15 +00:00
fd7b348973 some fixes for the network switch orbiter 2010-01-17 22:07:08 +00:00
7d400b17d0 html parser support for .cfm files orbiter 2010-01-17 16:29:49 +00:00
f6731c6240 more logging etc. orbiter 2010-01-17 00:41:50 +00:00
007f8297de added php3 as extension type for html orbiter 2010-01-16 15:53:18 +00:00
4f1f4863c4 fix for deadlock when initializing a SplitTable with a file of size 0, see also: http://forum.yacy-websuche.de/viewtopic.php?p=18594#p18594 orbiter 2010-01-14 23:03:48 +00:00
763e0d447c removed unnecessary cast orbiter 2010-01-14 14:23:26 +00:00
cc5dcf69ff missing change for last commit orbiter 2010-01-14 14:20:18 +00:00
ca1ef9a079 fix for http://forum.yacy-websuche.de/viewtopic.php?p=18584#p18584 orbiter 2010-01-14 13:38:14 +00:00
d9169cc6c3 increased proxy load time-out from 30000 to 60000 milliseconds according to http://forum.yacy-websuche.de/viewtopic.php?p=17782#p17782 orbiter 2010-01-14 10:42:05 +00:00
34354cf9b2 added a servlet that has been removed in SVN 4881; this servlet is now splitted and will be used for a simple crawl start and a remote crawl monitor (not yet integrated into the interface) orbiter 2010-01-13 23:19:45 +00:00
938e806182 tried to fix date problem that may have prevented that foreign peers stay in the network - removed unused code - removed possibly wrong utc difference correction orbiter 2010-01-13 20:01:46 +00:00
bd05e57d3b fix for http://forum.yacy-websuche.de/viewtopic.php?p=18563#p18563 orbiter 2010-01-13 18:41:33 +00:00
5df628a2a4 - added BEncoder class - added BEncodedHeap class that encodes B data structures and stores that to a heap - refactoring of MapView, this is now named MapHeap to fit into the naming scheme of the BEncodedHeap orbiter 2010-01-13 16:21:37 +00:00
81035e7080 moved a sub-menu entry orbiter 2010-01-13 16:18:23 +00:00
5f1565cc95 Fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2540&sid=507e4dd9e234af001ba60c0d8adf45be, and small Layout Changes. suessthomas 2010-01-13 07:57:36 +00:00
82f57f79e5 more PMD enhancements orbiter 2010-01-13 00:23:07 +00:00
5d930c96f0 more fixes to search result page navigation orbiter 2010-01-13 00:04:37 +00:00
1375d0214d minor changes on the de language File - Thanks Copro suessthomas 2010-01-12 21:28:16 +00:00
8c520f128d reverted a change in ranking process committed this afternoon orbiter 2010-01-12 20:56:37 +00:00
a06f7ddb33 more PMD recommendations orbiter 2010-01-12 20:53:19 +00:00
eb79ceb3ff update to kelondro data structures orbiter 2010-01-12 15:37:34 +00:00
9bbd546e64 in live search, show at least 20 entries instead of only 10 this is a work-around for the problem that the search widget does not load a second page if the first page did not fill up the window with enough lines such that a scrollbar ist visible. Because the scrollbar triggers loading of following pages, this must be enforced with the trick that more result lines must be shown after the first search. orbiter 2010-01-12 15:23:01 +00:00
18172451a0 better search computation: - increased sort limit, now 3000 entries, before: 1000 this should cause that more results can be shown in case of strong limitating constraints, like domain navigation - enhanced the sort process - check against domain navigator bugs - fix in sort stack - showing now all naviagtion pages at first search (not only next page) orbiter 2010-01-12 15:01:44 +00:00
d126d6c1b5 renamed the servlet WatchCrawler_p to Crawler_p this was done because that servlet may be used for wget/cronjob triggered crawl starts and it appears to be confusing that the name of the crawl start servlet looks like a pure monitoring tool. orbiter 2010-01-12 10:05:28 +00:00
66c0a8e849 more PMD recommendations orbiter 2010-01-11 22:18:38 +00:00
909a4f91c7 added a logging output for crawl starts that shows the URL that can be used to start the crawl again orbiter 2010-01-11 18:10:39 +00:00
bc96d74813 - clean-up of robots.txt parser - added 'yacybot' as key to recognize robots.txt entries for YaCy - removed unused method to get robots.txt from database orbiter 2010-01-11 16:36:30 +00:00
2113fcd7e5 - fixed usage of isEmpty() which is not available in java 1.5 - increased visibility of some methods orbiter 2010-01-11 12:33:40 +00:00
dd459281c8 applied code changes that are recommended by PMD orbiter 2010-01-10 23:09:48 +00:00
eac2daf2e8 * reenable DHT if yet enough memory is available * reset treshold on reconfiguratoin (thanks to sixcooler) lotus 2010-01-10 19:04:43 +00:00
0752634b8b log YaCy version on startup lotus 2010-01-10 16:10:11 +00:00
d77a8f3b3e added some modifications recommended by PMD for better performance orbiter 2010-01-10 01:40:26 +00:00
d1973bae2a code cleanup: removed unused code and unused methods orbiter 2010-01-10 00:42:49 +00:00
a3b8b7b5c5 some redesign of the main menu structure: - moved all index generation servlets to it's own main menu item, including proxy indexing - removed external index import because this operation is not recommended any more. Joining an index can simply be done by moving the index files from one peer to the other peer; they will be merged automatically - fix to prevent endless loops when disconnecting http sessions - fix to prevent application of bad blacklist entries that can cause a 'Dangling meta character' exception orbiter 2010-01-10 00:10:43 +00:00
ab3cf60dbe fix for npe lotus 2010-01-09 14:10:27 +00:00
7f20963b41 add-on to last commit orbiter 2010-01-09 00:17:39 +00:00
eeca2ded92 fix for http://forum.yacy-websuche.de/viewtopic.php?p=18500#p18500 - catch uncatched OOM - less wasting of memory orbiter 2010-01-09 00:08:16 +00:00
32972139af added nice configuration for the resource observer lotus 2010-01-07 17:19:50 +00:00