yacy_search_server

Mirrors/yacy_search_server

Fork 0

mirror of https://github.com/yacy/yacy_search_server.git synced 2025-06-22 04:16:09 -04:00

Commit Graph

Select branches

Hide Pull Requests

master

#1

#10

#100

#100

#101

#101

#104

#105

#108

#110

#114

#12

#122

#127

#127

#128

#135

#137

#137

#14

#144

#149

#151

#154

#155

#157

#159

#167

#167

#18

#183

#186

#188

#2

#21

#218

#219

#220

#226

#23

#238

#239

#240

#250

#258

#26

#260

#261

#27

#278

#28

#283

#29

#292

#3

#303

#32

#325

#327

#332

#333

#334

#338

#34

#355

#356

#357

#37

#38

#389

#39

#390

#4

#40

#402

#403

#404

#405

#408

#41

#41

#419

#42

#420

#436

#437

#439

#44

#440

#442

#443

#447

#448

#45

#45

#46

#461

#462

#463

#464

#47

#472

#478

#484

#485

#488

#489

#490

#495

#5

#5

#51

#52

#53

#533

#535

#54

#540

#541

#55

#553

#554

#556

#559

#56

#560

#562

#564

#567

#568

#575

#576

#58

#580

#583

#584

#585

#588

#589

#594

#596

#597

#598

#60

#600

#603

#605

#607

#61

#610

#612

#614

#615

#616

#617

#619

#62

#621

#628

#633

#642

#649

#65

#650

#651

#657

#66

#661

#661

#664

#666

#67

#670

#672

#678

#68

#682

#686

#688

#689

#69

#690

#692

#693

#694

#695

#696

#697

#698

#699

#700

#704

#71

#710

#710

#715

#72

#76

#77

#78

#8

#88

#9

#9

#91

#93

#93

#97

#97

#98

0.99

1.0

Release_1.0

Release_1.01

Release_1.02

Release_1.03

Release_1.04

Release_1.1

Release_1.2

Release_1.3

Release_1.4

Release_1.5

Release_1.6

Release_1.68

Release_1.7

Release_1.72

Release_1.80

Release_1.82

Release_1.90

Release_1.92

dbd7f77568 removed superfluous import of portalheader.template orbiter 2014-03-18 16:56:05 +01:00
6d57dff718 fixes to locale after renaming of some entities in online interface Michael Peter Christen 2014-03-18 14:08:52 +01:00
353d9c523f Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-03-18 13:42:44 +01:00
92655c7fd9 - added bootstrap css framework - adopted all YaCy administration pages to new framework - created new search page layout (working, but still work in progress) - old skin files are fully appliable! (and looking good) - target is a new style based on bootstrap examples, see /test.html - icons in YaCy may be replaced by glyphicons (to be done) Michael Peter Christen 2014-03-18 13:42:31 +01:00
e972b87a8a remove AugmentedBrowsingFilters_p.html as none of the settings are used currently config settings frome the page also removed from yacy.init augmentation.reflect augmentation.addDoctype augmentation.reparse interaction.overlayinteraction.enabled reger 2014-03-17 20:27:04 +01:00
05655d98df Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-03-17 11:57:01 +01:00
9f02d2c47b fix: remove link to triplestore in Vocabulary_p (triplestore does not longer exist) - should be investigated in more detail to look for additional implications Remove "yacyaction" from proxyservlet as it was only needed for removed interaction routines. reger 2014-03-16 22:11:19 +01:00
81a846ec33 fix: set YaCy CONNECTION_PROP_HOST Header in ProxyServlet to host incl. port reger 2014-03-16 20:51:32 +01:00
e9abb25b03 tried javascript hack to make statistic divs equal height orbiter 2014-03-16 14:56:30 +01:00
251be9ecfa remove unused ProxySettings ref. from loader clean unused whois test code reger 2014-03-16 05:19:01 +01:00
82dc815af9 cleanup: remove unrelated and unused code reger 2014-03-16 00:15:12 +01:00
923c9762cd upd pom to latest jars reger 2014-03-15 23:02:17 +01:00
d052bbdfe1 prevent exception on Site Crawl if no start url is given reger 2014-03-15 21:52:42 +01:00
85a427ec54 support for multiple sitemaps in robots.txt Michael Peter Christen 2014-03-14 13:33:23 +01:00
a373fb717d remove more unused from legacy server.http - triggerOnlineAction not used - useTemplateCache not used reger 2014-03-14 03:12:04 +01:00
749d020aeb remove redundant url string manipulation in HTTPDProxyHandler (still used by ProxyServlet) reger 2014-03-14 02:24:12 +01:00
612294cf84 use servletPath in ProxyServlet instead of fixed name to allow servlet-mapping via web.xml reger 2014-03-13 02:46:05 +01:00
1d01672bd3 fix DCEntry.getIdentifier on successful url parameter reger 2014-03-12 23:35:57 +01:00
b08375da33 fix for bad/missing values of size_i Michael Peter Christen 2014-03-11 09:51:04 +01:00
6306d28a6a OAI import get multivalued keywords (dc:subject) reger 2014-03-09 03:15:35 +01:00
0a8c8102de allow YaCy to start w/o ssl if JKS init fails reger 2014-03-07 20:06:14 +01:00
0b2101c59c Speed up the ProxyHandler: simplified cache-storing and make it concurrent in order to free the clientconnection asap let other prozesses wait on proxy-access like it was bevore sixcooler 2014-03-07 17:47:09 +01:00
8cf4d04ae0 fix for facets in search rss result: some facets had been missing, all had missing url properties Michael Peter Christen 2014-03-07 01:21:38 +01:00
516f8c2489 fix: to allow unix scripts (bin/*.sh) to allways submit http admin apicalls using auth via config hash (legacy requirement) reger 2014-03-07 00:16:57 +01:00
ea3aa30593 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-03-06 03:33:33 +01:00
dd5bf0b71b cleanup old reference to HTTPDemon.setAlternativeResolver optimize .yacyh check in AbstractRemoteHandler reger 2014-03-06 03:08:04 +01:00
51800007c4 - added concurrency to postprocessing of webgraph document - bundeled separate webgraph postprocesing steps into one Michael Peter Christen 2014-03-06 01:43:48 +01:00
5f4a6892c1 enhanced RowSet re-sort limit for small sets Michael Peter Christen 2014-03-05 23:28:19 +01:00
3c92c439ac Merge branch 'master' of ssh://gitorious.org/yacy/rc1 orbiter 2014-03-05 17:46:50 +01:00
5b3585da47 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 orbiter 2014-03-05 17:46:27 +01:00
b1db14b21f Update russian translation malykhin.dmitry 2014-03-05 18:58:15 +04:00
c97c9ac692 Update russian translation malykhin.dmitry 2014-03-05 18:53:23 +04:00
351c2be68d fix: make sure adminAccount changes made via ConfigAccounts_p are effective immediately force to remove current credentials from knownuser cache reger 2014-03-05 02:59:27 +01:00
7c2dc3915f Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 orbiter 2014-03-04 19:51:34 +01:00
b964f36d90 Update russian translation malykhin.dmitry 2014-03-04 21:37:00 +04:00
f77afa9d1d add index on _val fields, this affects especially title length an index on fields make search facets on that field possible orbiter 2014-03-04 11:24:04 +01:00
c0c177e2bc Update russian translation malykhin.dmitry 2014-03-04 07:19:35 +04:00
5c9dcc269d improve OAI-PMH import identifier recognition - find best fittng identifier (url) by checking all given dc:identifier in record (many entries proviede several identifiers) as identifier is currently a multivalued field use "getParams" in preference of splitting the 1st string by ";" - add resolve DOI:... identifier via http://dx.doi.org/ reger 2014-03-04 03:08:37 +01:00
0e7d249a69 fixed another shutdown problem (only occurs if webgraph core is enabled) Michael Peter Christen 2014-03-04 01:36:38 +01:00
e485fbd0ce - let crawl loader jobs die after 10 seconds without new jobs - corrected shutdown order t prevent a deadlock during shutdown Michael Peter Christen 2014-03-04 00:33:13 +01:00
0792a4369c Added Index Deletion and Reindex Monitor to German translation Michael Benz 2014-03-03 22:44:55 +01:00
bcd9dd9e1d enhanced concurrent loading by using a fixed set of concurrent loader processes in favor of throwaway-processes. The control mechanism does less often report a 'queue full' message to the busy loop which then does not perform a long busy waiting; instead all requests are queued and new loader processes are started if necessary up to a given limit (as set before) Michael Peter Christen 2014-03-03 22:13:40 +01:00
d8f7f47eff Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 orbiter 2014-03-03 21:39:49 +01:00
aec3ab1315 Update russian translation malykhin.dmitry 2014-03-03 07:16:53 +04:00
c7ea0f123b Added German translation for Config Search and Ranking RWI and Solr Michael Benz 2014-03-02 23:46:24 +01:00
051328271c bugfix-bugfix orbiter 2014-03-02 21:13:38 +01:00
eedcbcd906 bugfix to proxy handler: recognize the own yacyh-host orbiter 2014-03-02 12:10:19 +01:00
d68e5ad0c4 NPE fix for Thread name (just commited yesterday, sorry) orbiter 2014-03-02 11:20:48 +01:00
a2e1f104f6 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 orbiter 2014-03-02 11:18:28 +01:00
6878c90f99 fix: IPv6 INTRANET_PATTERNS for local ip (see http://bugs.yacy.net/view.php?id=378) requiring following ":" for fc and fd prefix and made pattern match case insesitive - add some more ipv6 test cases to MultiProtocolURLTest.java reger 2014-03-02 06:13:21 +01:00
61e51d47a5 fix: unused / incorrect default username parameter (removed setting) reger 2014-03-01 23:50:35 +01:00
fed354c0e2 Update russian translation malykhin.dmitry 2014-03-01 20:28:36 +04:00
9dc0aa2b01 German translation for Augmented Browser, Parser, Content Control and Vocabulary Michael Benz 2014-03-01 13:37:17 +01:00
a87aef83b4 Improved Image Collage and WatchWebStructure page display with CSS changes Michael Benz 2014-03-01 11:32:14 +01:00
0813f5f82e Added German translation for AccessGrid_p.html, CrawlCheck_p.html, RegexTest.html and env/templates/submenuTargetAnalysis.template Michael Benz 2014-03-01 11:31:23 +01:00
a2e5ea2026 status panel link to set max mem +url proxy same error text as in transparent reger 2014-03-01 00:56:45 +01:00
e9877028c6 update russian translation malykhin.dmitry 2014-03-01 00:03:23 +04:00
6ed9c0164e attaching names to all Threads to get a better view in profiling tools like VisualVM Michael Peter Christen 2014-02-28 15:02:01 +01:00
fdaeac374a - enhanced postprocessing speed and memory footprint (by using HashMaps instead of TreeMaps) - enhanced memory footprint of database indexes (by introduction of optimize calls) - optimize calls shrink the amount of used memory for index sets if they are not changed afterwards any more Michael Peter Christen 2014-02-28 14:01:09 +01:00
1245cfeb43 small change to crawler monitor to fit in larger translations Michael Peter Christen 2014-02-28 13:58:05 +01:00
ba49ff81ed little more verbose proxy 403 error message reger 2014-02-28 03:14:07 +01:00
d325cb8912 fixes and enhancements for postprocessing Michael Peter Christen 2014-02-28 02:51:14 +01:00
7c1b968378 another fix for the shutdown exceptions Michael Peter Christen 2014-02-28 01:53:32 +01:00
133d41386c (again) full redesign of ConcurrentUpdateSolrConnector to remove out-of-order transactions regarding add and delete operations. Now all operations (add and delete) are executed concurrently in-order. orbiter 2014-02-28 00:19:30 +01:00
1960aafd6c better height for statistic windows orbiter 2014-02-28 00:17:50 +01:00
b0e3e2100d better width for Progress table orbiter 2014-02-28 00:11:20 +01:00
d2f7ce27a7 fix for switch back to localhost (why did this not work? it worked all the time) orbiter 2014-02-27 23:30:56 +01:00
c8d437b69a clean up test sources rename to current package names and move to default location reger 2014-02-27 22:48:17 +01:00
d346520ed6 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git sixcooler 2014-02-27 18:35:24 +01:00
9afd7db043 bump to httpclient-4.3.3 sixcooler 2014-02-27 18:33:45 +01:00
65170474a1 Updated German translation with translated submenu include env/templates/submenuComputation.template Michael Benz 2014-02-27 18:28:40 +01:00
003e9a4041 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-02-27 12:51:05 +01:00
a632b0d2a4 added a forced commit to index deletion to enable synchronized index updates Michael Peter Christen 2014-02-27 12:50:40 +01:00
1d069c5861 make sure that postprocessed documents are overwritten Michael Peter Christen 2014-02-27 12:27:15 +01:00
9c41527e9c Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 Michael Peter Christen 2014-02-27 10:14:07 +01:00
29a7598991 update russian lang-file and small improve web-interface malykhin.dmitry 2014-02-27 07:43:17 +04:00
ee732bdc03 fix: de translation of menu link reger 2014-02-27 02:14:46 +01:00
0d2342575e Merge branch 'master' of ssh://gitorious.org/yacy/rc1 Michael Peter Christen 2014-02-27 01:29:52 +01:00
3cc5c0ffdd a concurrency enhancement which was not used because tests showed worse indexing speed. I leave the code there since it may be useful in SolrCloud environments. Michael Peter Christen 2014-02-27 01:27:06 +01:00
e644981697 added one more postprocessing low memory check Michael Peter Christen 2014-02-27 00:34:13 +01:00
1bbc0fe6d2 added a properties file format for the status_p api to support reading of that information with the java Properties class (very easy for small clients) Michael Peter Christen 2014-02-27 00:32:39 +01:00
e40511f307 extended the status_p api with disk space information Michael Peter Christen 2014-02-27 00:31:13 +01:00
5e645f4449 Merge origin/master reger 2014-02-27 00:24:30 +01:00
3b89176b9f use config value htroot in Jetty init (was hardcoded) - move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler - use SwitchboardConstant.htroot where appropriate reger 2014-02-27 00:23:34 +01:00
e1bf65c892 added short memory protection during postprocessing Michael Peter Christen 2014-02-26 23:02:56 +01:00
90b47e83e6 fixed shutdown error when closing solr connectors Michael Peter Christen 2014-02-26 22:47:16 +01:00
7640834b37 removed double concurrency to put Solr documents into the index. The writings to the solr index are also buffered in ConcurrentUpdateSolrConnector Michael Peter Christen 2014-02-26 22:21:00 +01:00
99635e15b4 fix for switching 'simulate short memory status' and 'Memory Strategy' thx Thomas sixcooler 2014-02-26 17:12:53 +01:00
0f6b72f24b do not use luke requests for remote solr servers if the result is different from normal requests. This happens if the remote solr is actually a solrCloud; in such cases the luke request returns only the result of the single solr peer, not the whole cloud. also done: some refactoring. Michael Peter Christen 2014-02-26 14:30:48 +01:00
18a56446ce reorg URL test classes add isLocal test with some IPv6 examples - putting in default location and clean old package names - add some valid RFC IPv6 sample urls (which don't pass the isLocal test) reger 2014-02-26 02:01:40 +01:00
f1a395ed46 Merge branch 'master' of ssh://gitorious.org/yacy/rc1 orbiter 2014-02-25 16:46:25 +01:00
95ea6ebb18 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 orbiter 2014-02-25 16:45:55 +01:00
c89412af69 edit russian locale malykhin.dmitry 2014-02-25 19:35:11 +04:00
c57026e242 recover from OOM Michael Peter Christen 2014-02-25 15:23:45 +01:00
907db8b7a6 fix for bad query shortcut hack Michael Peter Christen 2014-02-25 15:19:04 +01:00
a2b66fe2eb Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git Michael Peter Christen 2014-02-25 14:37:39 +01:00
9f6be762a6 - better logging for postprocessing - fixed collection bug in postprocessing Michael Peter Christen 2014-02-25 14:37:30 +01:00
de8f7994ab as crawling has a low-cpu demand, we want it to run even if the CPU load is VERY high. This applies also if the CPU load is high because of in-cache crawling; in that case we want to experience a high-CPU load as much as possible Michael Peter Christen 2014-02-25 14:17:33 +01:00
d8e79731df fixed wrong used memory display Michael Peter Christen 2014-02-25 13:38:39 +01:00
da5d4128bf prevent npe orbiter 2014-02-25 03:26:20 +01:00