yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-07-20 08:54:37 -04:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#718

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

83ae46902b *) removed link to LogStatistics *) removed translation of LogStatistics low012 2011-02-18 02:11:19 +00:00
ce012e11aa *) deleted LogStatistics since the page did not work anymore and it seemed to be obsolete, tell me if you miss it and I will add it again *) a few minor changes low012 2011-02-18 01:46:07 +00:00
c5051c4020 *) fixed bug which caused entries to not be deleted when deleting by URL on IndexCreateWWWLocalQueue_p.html (I hope this did not break anything else) *) cleaned up code a little bit low012 2011-02-18 01:25:46 +00:00
d58071947a maybe terminateOldSessions is too slow, removed sleep orbiter 2011-02-17 23:36:46 +00:00
fb8b046bb4 removed unused properties orbiter 2011-02-17 22:47:39 +00:00
b0bdf2d9ed *) Oops! low012 2011-02-17 20:42:35 +00:00
de065e594f *) make sure that only positive values are accepted as refresh interval on Crawler Monitor page low012 2011-02-17 20:40:34 +00:00
c69a4874b4 fix for non-valid json, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3179 orbiter 2011-02-17 16:47:05 +00:00
addbd5b482 moved the main update url - because of the many languages we support now on yacy.net orbiter 2011-02-17 01:22:22 +00:00
3e380c51b6 update to browser start with linux orbiter 2011-02-16 14:53:47 +00:00
4473cf8c61 replaced utf-8 with UTF-8 orbiter 2011-02-16 13:51:30 +00:00
6083f2f171 fix for (false) oom orbiter 2011-02-15 14:26:25 +00:00
d2eb2fe8d9 added patch from quix0r, see http://forum.yacy-websuche.de/viewtopic.php?p=21188#p21188 orbiter 2011-02-14 23:16:47 +00:00
abb35addb8 added accept-charset="UTF-8" to all forms this applies patches from http://forum.yacy-websuche.de/viewtopic.php?p=20891#p20891 orbiter 2011-02-14 22:57:43 +00:00
b35fda43ea more changes to headless mode; now non-headless mode is used when: - YaCy runs on Windows - YaCy is started with the -gui option in all other cases YaCy runs in headless mode orbiter 2011-02-14 22:17:59 +00:00
6c52e31993 new methods to open a browser - if YaCy is started with the option -gui, it is not in headless mode. Then the java 1.6 browse method is used if all other methods fail - in linux, the path /etc/alternatives/www-browser is used if no firefox is installed orbiter 2011-02-14 16:15:14 +00:00
5892fff51f introduction of dht-burst modes: this can expand the number of target peers in some cases where a better heuristic is needed. The problematic cases are either when a muti-word search is made (still a hard case for our term-oriented DHT) or when a network operator wants that all robinson peers are asked. We therefore introduced two new network steering values that switch on more peers during the peer selection. Because the number of peers can now be very large, the number of maximum httpc connections was also increased. Please see new coments in yacy.network.freeworld.unit for details of the new DHT selection methods. The number of maximum peers is now not fixed to a specific number but may increase with - the partition exponent - the number of redundant peers - the robinson burst percentage - the multiword burst percentage The maximum can then be the number of senior peers (all visible peers). orbiter 2011-02-13 17:37:28 +00:00
4588b5a291 - fixed document number limitation for crawls that restrict the number of documents per domain - some restructuring of the document counting and logging structures was necessary - better abstraction of CrawlProfiles - added deletion of logs to the index deletion option (if the index is deleted using the servlets) which is necessary to reset the domain counters for the page limitation - more refactoring to get the LibraryProvider more clean - some refactoring of the Condenser class orbiter 2011-02-12 00:01:40 +00:00
64f32e8f00 *) replaced all IPs in IP filters for proxy with the proper regular expression *) some cleanup low012 2011-02-11 23:37:13 +00:00
9f6e3f9793 fix: same number format display before and after get/post lotus 2011-02-10 09:08:44 +00:00
4716aa7d3a fix display of statistics link on network.html (caused by menu option) lotus 2011-02-09 21:32:45 +00:00
3e8b72be50 update to httpclient-4.1 - sorry forgot some sixcooler 2011-02-08 21:53:20 +00:00
45dcfa3460 update to httpclient-4.1 sixcooler 2011-02-08 21:46:24 +00:00
d38c739b31 * add ant-target deleteData, to simulate fresh yacy installation * useful in IDEs like eclipse f1ori 2011-02-08 09:12:48 +00:00
74b22dfa24 *) fixed bug which affected blacklist entries which consisted of domain _and_ path parts *) minor cleanup low012 2011-02-06 18:07:08 +00:00
4843f04247 *) more input from Moubai low012 2011-02-06 16:00:45 +00:00
b9990e722f *) updated French langugage file with input from Moubai (http://yacy-forum.org/viewtopic.php?p=1646) low012 2011-02-05 11:20:25 +00:00
93732d6773 increased number of target peers orbiter 2011-02-04 13:25:28 +00:00
70ca7cec8c fix for http://forum.yacy-websuche.de/viewtopic.php?p=21763#p21763 and another fix for non-working global search when search options are switched off orbiter 2011-02-03 10:43:09 +00:00
fe93caac5a added flags and administration options to show advanced search and to show search result attributes (for each search result) Administration can be done at ConfigPortal.html orbiter 2011-02-02 15:54:13 +00:00
01cb3bbaec * fix patchCharsetEncoding-test (patchCharsetEncoding now returns null on input null) f1ori 2011-02-02 15:28:41 +00:00
431f780f41 patch for bad data in url metadata orbiter 2011-02-02 01:19:25 +00:00
0dfb1ef7d2 added custom targets for media search orbiter 2011-02-02 00:50:06 +00:00
5905f912c5 replaced more double types with float orbiter 2011-02-02 00:22:00 +00:00
0cdfb82963 replaced more appearance of double values by float values orbiter 2011-02-02 00:06:29 +00:00
eb12e15738 moved all Double values to Float values because of http://www.exploringbinary.com/java-hangs-when-converting-2-2250738585072012e-308/ YaCy does not really need double-precision floating point computation anywhere, so this should not affect any feature orbiter 2011-02-01 23:49:11 +00:00
fe948abd84 added link on ViewProfile.html to EditProfile_p.html to make it easier to customize the peer the link appears only if the user has admin rights orbiter 2011-01-31 19:55:00 +00:00
982aa689ef * fix StringIndexOutOfBoundException in WebStructureGraph * add better escaping to saveMap and loadMap f1ori 2011-01-31 14:25:09 +00:00
77715c2b16 *) less HTML errors, but still several left low012 2011-01-28 17:26:47 +00:00
ae10ed5613 *) added a Set to which filter elements are written before mustmatch-filter is created to avoid huge lists of double elements in mustmatch-filter when starting a crawl from a "Link-List of URL" on CrawlStartSite_p.html low012 2011-01-28 16:24:33 +00:00
9a1e0158fa better servlet naming in index administration orbiter 2011-01-28 11:32:31 +00:00
88773e4daa changed the default port from 8080 to 8090 see also: http://forum.yacy-websuche.de/viewtopic.php?p=21683#p21683 orbiter 2011-01-28 10:54:13 +00:00
6c35b68f17 - removed 'peerName' property from the yacy settings file because this information is stored in the yacy seed file - the own seed file gets the lead for storage of the peer name - exchanged default peer name generation method with one that does not use the local ip - default peer names are now strings starting with '_anon' - added another switch to suppress forwarding to ConfigBasic if the name was already changed - replaced all usages of the yacy.conf peerName with access to the local seed - changes to the peer name are now applied directly and not after the next peer ping orbiter 2011-01-28 10:12:17 +00:00
8bc66b9e84 de.lng: Updated German translation and cleaned removed lines - no unused strings log entries mikeworks 2011-01-28 04:46:42 +00:00
786166041a - added recording of all accessed and submitted servlets - this recording is then used to redirect from the Status.html page to BasicConfig in case that servlet was never submitted - this acts as an addition to the new default pop-up page 'index.html' which offers an administration link to Status.html. For a first-time user this then redirects directly to the former start page BasicConfig.html orbiter 2011-01-27 11:17:11 +00:00
28f669bf0b - fixed/enhanced move to SD/16:9 images (network, web structure) - added logging in peer ping to analyse time-consuming elements which could be cause for disappearing peers orbiter 2011-01-27 10:16:14 +00:00
0376f73fdb extended seed list uploader: do not only upload all active peers but also some more peers that are passive but had been active in the last 24 hours orbiter 2011-01-26 23:21:33 +00:00
3fe03f153d - search page becomes default start page (new users are not forced to do configuration since this is not necessary) - adjusted top menu on search page (shows less stuff and now also the network graphics) - adjusted the network page (looks better in when showing no other navigation on top) orbiter 2011-01-26 14:58:28 +00:00
1bda9e7ed9 option in network servlet to show the servlet with simple or embed menus orbiter 2011-01-26 13:59:55 +00:00
991b92f4ae enhanced network graphic orbiter 2011-01-26 13:52:46 +00:00
30df013c2b de.lng: Added German translation to Network Scanner menu CrawlStartScanner_p.html: Modified HTML code to validate HTML 4.01 Strict, switched selectAll Javasript, added end tags to input, etc ... mikeworks 2011-01-23 18:36:44 +00:00
0887a1c86f better table layout in Network and API Administration orbiter 2011-01-22 10:53:36 +00:00
59d9fe1bd7 added more php mime types orbiter 2011-01-22 09:52:36 +00:00
3ae8f40fc8 removed yacy.network.group - this feature was never used orbiter 2011-01-22 09:50:36 +00:00
efb4ca8fa8 modified auto-delete of search failure-words: - words are now not deleted from the search index automatically if index receive is switched off - a flag in the network definition defines if this feature is switched on at all - the search filter for not-found word references is switched off for server-side remote searches orbiter 2011-01-22 09:46:00 +00:00
58346b9a76 *) added lock symbol to "API Action Steering" link in menu since the page is protected low012 2011-01-22 02:11:18 +00:00
79c5b35a6a fix bug in installer in case there was a 32 bit jre installed on a 64 bit windows. now the necessary 64 bit jre gets installed. danke PCA42! http://forum.yacy-websuche.de/viewtopic.php?p=21631#p21631 lotus 2011-01-21 18:09:24 +00:00
f1f03d8c90 more logging for strange network loading bug orbiter 2011-01-19 09:31:56 +00:00
4e29e9712a * create cleanupjob for cached failed urls f1ori 2011-01-17 15:04:00 +00:00
a321c7673d * adminAccountForLocalhost only for localhost * yacy crawls local domains also, if no password is set (the interface is already protected) * it's not required anymore, to set a password in intranet mode f1ori 2011-01-17 11:37:30 +00:00
c9cd03b532 adding convenient option for contacting peer on network page 4. can be used on creating new network. this page is hidden from the interface (not linked). lotus 2011-01-15 18:49:51 +00:00
930cb412dd Let SHORT_MILSEC_FORMATTER make a new formatted String every millisecond see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3103 hermens 2011-01-15 13:16:40 +00:00
090c73e32e catch a OOM in HeapReader iteration orbiter 2011-01-12 12:04:18 +00:00
48463c4507 *) General private License? ;-) *) minor code changes low012 2011-01-12 00:28:08 +00:00
c93f4dda72 - cleaned up yacy news - removed unused methods - avoid news generation in case that the peer runs in robinson mode orbiter 2011-01-12 00:00:14 +00:00
6c1b14c8e1 - more control in access tracker: count number of returned search results (not only info how much is in the index) - extended query params for this - enhanced cora orbiter 2011-01-11 22:58:14 +00:00
fafab7a8fe * provide option to delete cached snippet fetching failures f1ori 2011-01-10 21:40:56 +00:00
9f38c0023d *) Minor changes, mainly cleaning up a little bit, no functional changes. low012 2011-01-10 20:24:52 +00:00
809e643ab7 *) Fixed bug where a number followed by characters was allowed as a valid value for the amount of memory which YaCy is allowed to consume. low012 2011-01-10 17:47:23 +00:00
54e77e6255 refactoring orbiter 2011-01-10 08:40:41 +00:00
f5baf53391 fix for oob in snippet generation orbiter 2011-01-05 17:35:36 +00:00
feefe17568 npe assert fix orbiter 2011-01-04 12:24:41 +00:00
19711ff6d6 added target that compiles only the cora package orbiter 2011-01-04 00:44:03 +00:00
733903f2c9 fix for http://forum.yacy-websuche.de/viewtopic.php?p=21489#p21489 orbiter 2011-01-03 23:06:33 +00:00
24e4126eee added JSON parser code from json.org (added generics to it) orbiter 2011-01-03 22:53:15 +00:00
10ae8d961b - cora package has now no dependencies to other yacy packages and becomes a 'base' package (refactoring) - cleaned up (removed special code and documentation for 27c3) - added remote search functions to be used within cora orbiter 2011-01-03 20:52:54 +00:00
0e54233408 UPnP: map port again if we are not reachable (e.g. when router rebooted) lotus 2011-01-02 21:17:21 +00:00
b1484299b2 same units for memory observer configuration (MiB) old setting for DHT (RAM) will be lost after update can be set on /Performance_p.html lotus 2011-01-02 20:38:01 +00:00
621e176071 enhancement in table display of path names orbiter 2010-12-30 01:46:37 +00:00
bbd3d64cc2 * fix layout of yacyinteractive f1ori 2010-12-30 01:04:08 +00:00
2751c52617 layout orbiter 2010-12-30 00:49:51 +00:00
387db84087 maybe found bug in non-working index dumper orbiter 2010-12-30 00:02:42 +00:00
4bce2f9c20 added a (temporary) description for 27c3 search set-up that everyone can see if they use YaCy here. orbiter 2010-12-29 18:56:42 +00:00
89ae6101b9 fix for NPE and added comment in search result orbiter 2010-12-29 14:51:07 +00:00
0769f4caa6 added search suggestions for interactive search: is only shown if there are no search results orbiter 2010-12-29 14:30:25 +00:00
a4c9d27287 - moved some variables from Stwitchboard to new class AccessTracker - added a limitation in access tracking to delete queries which are older than 10 minutes orbiter 2010-12-29 01:54:27 +00:00
0c79789517 * labels for index delete checkboxes f1ori 2010-12-28 17:59:14 +00:00
e4aabaa1c3 * fix negative filelength for files >2G f1ori 2010-12-28 17:25:39 +00:00
cdfe8afe3f fix for really bad table iteration implementation: reduction of IO orbiter 2010-12-28 16:44:55 +00:00
9eae33f886 *) Ooops... low012 2010-12-28 13:04:48 +00:00
a001e8075c *) minor enhancements low012 2010-12-28 13:03:49 +00:00
ecfacabad0 no db lookup during search / avoid IO orbiter 2010-12-28 12:10:48 +00:00
11ea966f9e *) added SID file (Commodore 64) sound file parser *) minor changes low012 2010-12-28 12:06:04 +00:00
ee3cef91e8 * fix filesize in ftp crawls f1ori 2010-12-28 02:15:22 +00:00
b2ed4cfaf8 more small bugfixes and light refactoring orbiter 2010-12-28 01:57:05 +00:00
1b6702146f remove '*' from query string (people believe that this is a wild card) orbiter 2010-12-28 01:27:36 +00:00
3ca06d6290 patch for http://forum.yacy-websuche.de/viewtopic.php?p=21460#p21460 orbiter 2010-12-27 23:57:29 +00:00
903c824c2c - allow only scanned resourced with granted status - increased time-out when scanning an ip range orbiter 2010-12-27 23:11:56 +00:00
936e976c23 *) added FreeMind (http://freemind.sourceforge.net/) mindmap parser *) minor changes low012 2010-12-27 20:13:31 +00:00
3d95981f7d *) cleaning up the code a little bit *) minor changes low012 2010-12-27 17:07:21 +00:00