Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-05 23:46:12 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 2f8c180bec #updated language file daburna 2008-05-22 17:59:38 +00:00
  • eac62a6882 * ported restart on Windows to unix-style, works on _noconsole now * removed Win9x scripts from build for more tidiness and less decisions for newbies lotus 2008-05-22 15:48:51 +00:00
  • 03438ee977 added missing implementation of network-path reference orbiter 2008-05-22 00:08:14 +00:00
  • 2ba7914f0b fix for NPE exception while fetching remote crawl jobs orbiter 2008-05-21 23:07:37 +00:00
  • 4a48717017 * automatic update for windows pleas disable before release because 2nd update fails at the moment and commandline handling has to be improved for windows * update via new unTar class please review stream- and exceptionhandling because I'm fairly new to Java maybe it can be done concurrent * updated windows startscripts to values from yacy.init lotus 2008-05-21 15:23:56 +00:00
  • faed00d75d added use cases to basic configuration orbiter 2008-05-20 13:21:55 +00:00
  • 4229cd275c fixed several details about network switching, default password, random password and localhost authentification orbiter 2008-05-20 09:29:01 +00:00
  • d9d1c8de70 more protection against remote shutdown attacks: prevent loading using the crawler orbiter 2008-05-19 23:05:19 +00:00
  • c1d721dd2d fix for attacks on localhost-authorized peers from web pages with links to localhost addresses: checking of referer in access orbiter 2008-05-19 22:17:53 +00:00
  • 2ba6f4e92d fix for bad message about empty pw if localhost is allowed to access without pw orbiter 2008-05-19 20:58:11 +00:00
  • 6aa9bf43f9 fixed server port change orbiter 2008-05-19 20:51:09 +00:00
  • 53dfe9fe9a added RECENT command for search query: add RECENT (in uppercase letters) to the search words and results will be ordered by date (recent first) orbiter 2008-05-18 21:29:43 +00:00
  • a7dadf7f2f *) first version of a way to determine the language a text is written in (not perfect, but it works) *) statistical data of languages can be found in the *.lng files in the new directory called "langfiles" low012 2008-05-18 21:24:05 +00:00
  • 4f9b8a6ef8 /xml/util/getpageinfo_p.java: fixed problem with empty tags and added recognition of compound tags e.g. "DER SPIEGEL" apfelmaennchen 2008-05-18 12:48:57 +00:00
  • aa29a8c165 YaCy-UI: small optical changes apfelmaennchen 2008-05-18 08:59:21 +00:00
  • f494d944fd YaCy-UI: basic support for searching bookmark tags... apfelmaennchen 2008-05-18 08:53:13 +00:00
  • c8c93c198b ywidget: added img file apfelmaennchen 2008-05-17 20:26:00 +00:00
  • 9b686fed35 ywidget: added config form (currently not functinoal) apfelmaennchen 2008-05-17 19:29:21 +00:00
  • b5faea410b ywidget: added footer and small optical changes apfelmaennchen 2008-05-17 16:40:32 +00:00
  • ecc11da8ac moved styles to ywidget.css apfelmaennchen 2008-05-17 10:33:12 +00:00
  • 4e0f031722 small feature fix that limited ywidget to 5 rss items apfelmaennchen 2008-05-17 09:41:17 +00:00
  • 125b28622f needed for ywidget apfelmaennchen 2008-05-17 09:23:59 +00:00
  • 1019fd91c0 - added /yacy/ui/ywidget.html - it can be used with all yacy search parameters?search=yacy;contentdom=text;count=40;offset=0 apfelmaennchen 2008-05-17 09:17:20 +00:00
  • 3aa69dab94 prevent too high search request frequency submitted from the same peer orbiter 2008-05-17 00:11:35 +00:00
  • 1127d62b64 some enhancements to the access tracker (less synchronization) orbiter 2008-05-16 23:33:59 +00:00
  • 56a300f92a bugfix / local-search predicate orbiter 2008-05-16 21:17:55 +00:00
  • cafce41d8f temporary set default login behavior to not-login from localhost without password orbiter 2008-05-16 19:55:17 +00:00
  • 2f29ab8779 more target server access security orbiter 2008-05-16 19:50:28 +00:00
  • 90f085f0ef #updated language file daburna 2008-05-16 14:00:58 +00:00
  • 1a3b87baaa ... apfelmaennchen 2008-05-15 21:45:07 +00:00
  • 4a932194a9 adjusted license text and copyright apfelmaennchen 2008-05-15 21:43:04 +00:00
  • 30356ec980 The basic configuration is now very very easy! New users will not be confronted with account settings. - moved account definition from Basic Configuration into the User_p servlet which was renamed to ConficAccounts_p - moved and renamed submenu entries on Status page. orbiter 2008-05-15 20:13:43 +00:00
  • 3bd1db776a implemented switch for admin authorization from localhost: - access is granted for localhost users to administration pages by default - the default setting can be changed in the BasicConfig.html page - if the BasicConfig page was accessed with post and no password was submitted, a random password is generated - a headless installation MUST give a password upon first call of the configuration page, otherwise they will not be able to access it again - if no password is given within 10 minutes after start-up, a random password is generated orbiter 2008-05-15 11:26:43 +00:00
  • cfe6790498 - added option to switch between yacy networks, especially between the two default networks (freeworld and intranet), from the ConfigNetwork online interface - to make this possible, a large refactoring and reorganisation of data structures was necessary orbiter 2008-05-14 21:36:02 +00:00
  • 7429687601 small bug fix apfelmaennchen 2008-05-14 20:57:35 +00:00
  • c689d6f061 YaCy-UI now supports searching Sciencenet... apfelmaennchen 2008-05-14 20:47:45 +00:00
  • 37505c0665 implemented ynetSearch.java to allow ajax cross domain search (e.g. sciencenet) for YaCy-UI... apfelmaennchen 2008-05-14 20:37:50 +00:00
  • 78087da287 - changed seed file storage to clear text - fixed kill script - fixed saving of seed file (had been corrupted by latest changes) - some refactoring orbiter 2008-05-14 20:30:44 +00:00
  • 5fde679acb - fixed problem in performance configuration - extended rss fetch size for rssTerminal orbiter 2008-05-13 15:28:55 +00:00
  • db032fb6de - added RWI transmissions to the event terminal - fixed bug in Collage - added 'embedded mode' to collage - integrated Collage to terminal_p as iframe in embedded mode (Pictures now visible in terminal_p) orbiter 2008-05-13 11:46:20 +00:00
  • 239cc4428d - better domain graph, faster when more links exist, looks better - new authorization rule: localhost is always authorized for administration. This solves many problems with ajax, and also fixed a problem in rssTerminal - fix bug in RSSFeed which prevented that entries had been recognized as individual, new entries - added reloading/updating of status image on status page orbiter 2008-05-12 22:23:29 +00:00
  • 415b92bb07 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1148&hilit=&p=7711#p7711 orbiter 2008-05-12 15:06:04 +00:00
  • 2113672bf2 small fix on tag comporator functions apfelmaennchen 2008-05-12 15:05:27 +00:00
  • dd75b3cabc - patch for bad profiles - time-out when deleting profiles orbiter 2008-05-12 14:58:56 +00:00
  • 0f7449840e - minor changes on YaCy-UI apfelmaennchen 2008-05-12 09:42:26 +00:00
  • 5c6ff5ebea - added attributes to /xml/bookmarks/xbel/xbel.xml - tag=tagName returns only bookmarks which match tagName in a single XBEL-folder tagName - added metadata for public=true/false to XBEL output - added the attribute 'added' (date) to XBEL output apfelmaennchen 2008-05-12 09:36:21 +00:00
  • 6c79edcd56 - added attributes to /xml/bookmarks/tags/get.xml - top=number returns the number most frequent tags - sort=comporator lets you choose between "size" and "alpha" as comporator function - tag=tagName returns all tags associated with bookmarks tagged with tagName apfelmaennchen 2008-05-12 09:31:53 +00:00
  • 2080ff72b7 ftpc fix for npe danielr 2008-05-10 22:03:51 +00:00
  • e021278bf0 unescape link display in search results lotus 2008-05-10 11:25:54 +00:00
  • 3f1721b827 informational comment danielr 2008-05-10 11:21:51 +00:00
  • 04a51b775a changed .org/.net back to America danielr 2008-05-10 11:10:10 +00:00
  • bbda1a45a9 - added box800.png (quick resize of box600, needs to be fine tuned) apfelmaennchen 2008-05-10 08:55:57 +00:00
  • 74b1a60043 fixed "java.lang.NoClassDefFoundError: org/a" danielr 2008-05-10 08:42:31 +00:00
  • fa3ed2888d - bookmarks are now retrieved from /xml/bookmarks/xbel/xbel.xml and do no longer require a seperate servlet - minor bug fixes - refactoring (obsolete items) apfelmaennchen 2008-05-10 08:37:18 +00:00
  • f44d5d302b updated TLDs danielr 2008-05-09 12:46:10 +00:00
  • 5bfc02ccfb Repair publishThread hermens 2008-05-09 11:14:32 +00:00
  • f42c8cf69c updated terminal and dynamic webstructure applet: can now change when crawl is running orbiter 2008-05-09 00:01:47 +00:00
  • 906c144799 - design update to new terminal and rssTerminal - added terminal to main menu - removed transfer size limitation in server orbiter 2008-05-08 21:33:16 +00:00
  • 7ec01d444a fix for npe orbiter 2008-05-08 20:25:11 +00:00
  • ad0f905124 fix for npe in crawler orbiter 2008-05-08 20:16:19 +00:00
  • ae03a54d23 pdfParser: updated lib, fixed ClassNotFoundException: CMSError danielr 2008-05-08 16:55:45 +00:00
  • 0d3808bd9e minor refactoring danielr 2008-05-08 16:51:01 +00:00
  • 719f5defb1 updated some grafics at new terminal_p orbiter 2008-05-07 23:42:14 +00:00
  • 58830e9b28 added new terminal servlet using current visualization methods and a new one: a processing (processing.org) applet. the new servlet can be found at http://localhost:8080/terminal_p.html ..to be enhanced.. orbiter 2008-05-07 22:49:07 +00:00
  • 9bc56a9edc xss protection lotus 2008-05-07 16:37:13 +00:00
  • b32736762c enhanced rssTerminal - 3 lines possible - distinguishing of private and public data, if not authorized only public data is shown - shows now more events, including local searches in clear text if user is logged in - simplyfied peer events - better recognition of 'real' new peers - presentation of peer pings from other peers orbiter 2008-05-06 23:05:48 +00:00
  • fbb712c669 refactoring: moved importer classes to crawler and plasma package orbiter 2008-05-06 13:44:38 +00:00
  • ee81ff4ef4 added crawler target directory for build orbiter 2008-05-06 00:37:51 +00:00
  • 1689030ee8 refactoring: moved all crawler classes into their own package orbiter 2008-05-06 00:32:41 +00:00
  • fe4871ac02 removed empty package orbiter 2008-05-05 23:54:00 +00:00
  • 3082edfdbc ups orbiter 2008-05-05 23:19:49 +00:00
  • d2ba1fd2ab major step forward to network switching (target is easy switch to intranet or other networks .. and back) This change is inspired by the need to see a network connected to the index it creates in a indexing team. It is not possible to divide the network and the index. Therefore all control files for the network was moved to the network within the INDEX/<network-name> subfolder. The remaining YACYDB is superfluous and can be deleted. The yacyDB and yacyNews data structures are now part of plasmaWordIndex. Therefore all methods, using static access to yacySeedDB had to be rewritten. A special problem had been all the port forwarding methods which had been tightly mixed with seed construction. It was not possible to move the port forwarding functions to the place, meaning and usage of plasmaWordIndex. Therefore the port forwarding had been deleted (I guess nobody used it and it can be simulated by methods outside of YaCy). The mySeed.txt is automatically moved to the current network position. A new effect causes that every network will create a different local seed file, which is ok, since the seed identifies the peer only against the network (it is the purpose of the seed hash to give a peer a location within the DHT). No other functional change has been made. The next steps to enable network switcing are: - shift of crawler tables from PLASMADB into the network (crawls are also network-specific) - possibly shift of plasmaWordIndex code into yacy package (index management is network-specific) - servlet to switch networks orbiter 2008-05-05 23:13:47 +00:00
  • d70a472460 added file for previous commit danielr 2008-05-05 05:19:01 +00:00
  • d32fe84472 added default User-Agent danielr 2008-05-04 17:26:19 +00:00
  • 8c5f062e0b corrected YaCy version in HTTP User-Agent danielr 2008-05-04 12:18:00 +00:00
  • d7b21bc90c re-added gzip POST for transferRWI/URL (HTTP/1.1 compliant) danielr 2008-05-04 10:53:04 +00:00
  • a5a1f19368 * allow to force login for xbel, needed for yacybar f1ori 2008-05-03 11:13:27 +00:00
  • 8d83febb95 *) BlacklistCleaner_p.java reports exception to log instead of System.err *) changes in formatting for better readability in BlacklistCleaner_p.java *) replaced test for necessary Java version (was 1.4.2, is 1.5 now) low012 2008-05-03 10:16:04 +00:00
  • d4bce6affd refactoring (initialized static fields, removed empty if/else, serialized some fields in serializable classes) danielr 2008-05-03 09:06:00 +00:00
  • 19ca452666 updated language file daburna 2008-05-02 20:19:05 +00:00
  • be2c9c07ff escape some unescaped characers in URLs (fixes problems with proxy) danielr 2008-05-02 08:19:47 +00:00
  • d0678f7ab9 refactoring as result of http://forum.yacy-websuche.de/viewtopic.php?f=6&t=959&p=7560#p7560 orbiter 2008-05-01 22:40:42 +00:00
  • 483e9a2066 - shifted tld recognition methods from yacyURL to serverDomains - changed isLocal Property in such a way that it is possible to see if a domain is in the internet (and not intranet) orbiter 2008-04-30 23:06:42 +00:00
  • a3df23659c re-implementation of charset checking orbiter 2008-04-30 13:23:05 +00:00
  • 75a1702133 - fix for ConcurrentModificationException during shutdown - fix for Ranking distribution problem (suma-lab peer does not exist any more) orbiter 2008-04-30 11:19:52 +00:00
  • 27ab0a5f89 fixed XSS problem in ConfigProperties orbiter 2008-04-29 22:47:00 +00:00
  • 32b5b057b9 - modified, simplified old kelondroHTCache object; I believe it should be replaced by something completely new - removed tree data type in kelondroHTCache - added new class kelondroHeap; may be the core for a storage object that will once replace the many-files strategy of kelondroHTCache - removed compatibility mode in indexRAMRI orbiter 2008-04-29 22:31:05 +00:00
  • d3715e02ae removed double/redundant servlet Config_p orbiter 2008-04-29 19:19:14 +00:00
  • ec84a52adb change for problem with NPE (seen as "PROXY Unknown Error while processing request") danielr 2008-04-29 16:06:54 +00:00
  • 5813cc149f fix for bad rssTerminal behavior orbiter 2008-04-28 20:34:37 +00:00
  • 88216c1f1f fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1103&hilit=&p=7362#p7362 orbiter 2008-04-26 22:59:20 +00:00
  • d0b893523e - protection against RAM overflow caused by new peer rss news - more XSS protection orbiter 2008-04-26 22:53:04 +00:00
  • 685794e7e7 fix for parser/encoding Exception see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1111&hilit=&sid=55a320b54e1e3bda9410e7c50b5147f1&p=7431#p7431 orbiter 2008-04-26 22:14:45 +00:00
  • cf042e6957 reverted change by mistake in yacyVersion orbiter 2008-04-26 01:08:59 +00:00
  • 9935e83c86 added new news window into the status page. At this moment it is just a test. The news inside the window are about peer arrivals and departures, remote search accesses and crawls orbiter 2008-04-26 01:00:10 +00:00
  • bac38cfa18 added very rudimentary peer news as rss feed. An example can be retrieved with http://localhost:8080/xml/feed.rss?channel=PEERNEWS to be extended and integrated in interface ... orbiter 2008-04-24 23:30:13 +00:00
  • 6495227ad6 the class rssReader is replaced by RSSReader, RSSFeed and RSSMessage orbiter 2008-04-24 21:45:43 +00:00
  • 724bbdf9b2 refactoring of RSS reader orbiter 2008-04-24 21:31:07 +00:00
  • b9a2a2d287 more search performance hacks orbiter 2008-04-24 15:09:06 +00:00
  • ff755fb858 small corrections and enhancements after search timing profiling search should be a little bit faster now orbiter 2008-04-24 13:31:55 +00:00