Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-06-22 04:16:09 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • ecd7f8ba4e - added NEAR operator (must be written in UPPERCASE in search query) - more generics - removed unused commons classes orbiter 2008-01-08 20:12:31 +00:00
  • 3e3d2e39a4 - some refactoring and redesign of kelondroBytesIntMap (created new class kelondroRAMIndex) - more generics - preparation to extend the balancer for flexible forced delay times - set different random-access type, should now omit update of metadata in file and could be a bit faster (lets see) orbiter 2008-01-07 22:36:48 +00:00
  • 89f48bae55 *) if new tag is chosen, bookmark list will be updated automaticly if JavaScript is enabled (no click on "..." needed) low012 2008-01-07 20:48:08 +00:00
  • 214e37b6e3 added changes made by apfelmaennchen daburna 2008-01-07 20:01:53 +00:00
  • 1f199d688b *) Christmas is over! low012 2008-01-07 19:47:20 +00:00
  • 03e7782269 more generics orbiter 2008-01-06 19:23:38 +00:00
  • e9ceae77df french translation file is now correct matched daburna 2008-01-06 16:22:12 +00:00
  • 29b2b71646 translated sharedBlacklist_p.html (Orbiter, there is something wrong. There are no blacklist items listed - just -UNRESOLVED_PATTERN-) daburna 2008-01-06 14:19:23 +00:00
  • f7c5ccedc7 more generics orbiter 2008-01-06 00:31:26 +00:00
  • 88b2779787 added PerformanceMemory_p.xml lulabad 2008-01-05 21:04:30 +00:00
  • 7af60fb24d *) fixed bug in update script low012 2008-01-03 20:22:21 +00:00
  • ae6d07bdb8 *) "Did you mean:" will only be displayed if the list of suggested URLs is not empty. *) Removed <hr /> to make the "404 Unknown Host" error pag look like the other 404 error pages. low012 2008-01-01 23:03:02 +00:00
  • 408cb7a29b *) added check if archive for update is OK, install if OK, else just restart (http://forum.yacy-websuche.de/viewtopic.php?t=663) low012 2007-12-31 14:52:17 +00:00
  • 21b92e8e64 small grammar update daburna 2007-12-29 19:54:51 +00:00
  • df2a7a8ac8 more generics orbiter 2007-12-28 18:47:45 +00:00
  • 9d8b17188a more generics, bugfixes for wrong cast orbiter 2007-12-28 03:39:36 +00:00
  • b08f877e97 *) tried to get rid of warnings when compiling parsers (http://forum.yacy-websuche.de/viewtopic.php?t=660) low012 2007-12-27 22:37:02 +00:00
  • 4dc438f7e7 moved to Java 1.5: - changed build script to use java 1.5 compiler - first stept to resolve missing generics definition (about 400 from over 4100 'missing'-warnings) - added key-iterator to kelondro databases (for rapid from-memory enumerations, will be used for domain name collection, not used yet) orbiter 2007-12-27 17:56:59 +00:00
  • d8d955a7ff start of next development cycle towards 0.57 happy xmas! orbiter 2007-12-22 03:29:00 +00:00
  • db0d3d5e54 release 0.56 (and some last fixes) - fixed bad peer hash computation in case no peer list is avaiable upon first startup - security minimum waiting time in search result preparation - removed dead superseed link orbiter 2007-12-22 02:58:38 +00:00
  • d517e96714 last cleanup bits to serverDate before the release. only safe refactoring (method renaming) changes outside of serverDate. fuchsi 2007-12-21 00:53:46 +00:00
  • 4748d5c1ab Some enhancements to time management: - remove unnecessary generation of Calendar and Date objects - synchronized SimpleDateFormat objects in blog-, message- and wikiBoard - correct use of TimeZones and SimpleDateFormats hermens 2007-12-20 17:11:35 +00:00
  • 52dd015218 new release strategy: the standard release is now built the same way as the pro release a new release type was added: 'embedded' which is the same as the current standard release was this will not have any effect to the next release 0.56, which will still a pro-release on public download the transition the the new release strategy must be done now to enable automatic update by the updated in future releases orbiter 2007-12-20 02:46:41 +00:00
  • 1cb6e431a6 Replace the ISO8601 aka W3C datetime parser by one that supports every representation allowed by this standard, see http://www.w3.org/TR/NOTE-datetime - useful expecially for sitemaps parsing, where this date format is used fuchsi 2007-12-19 22:45:58 +00:00
  • 33ee6745f6 more cleanup in serverDate - remove direct accesses to SimpleDateFormat fields in serverDate and use the static parse... methods instead - remove nowDate() as a Date doesn't store timezone information and a new Date() is always faster - default formatter methods use a GMT timezone by default now, this is important for interchangability as some date formats we use don't include a timezone offset. - continued renaming and rearanging (formatter) methods. all should follow the general naming scheme formatWHAT(...) fuchsi 2007-12-19 19:39:19 +00:00
  • 3c30c2da75 more cleanup and API consistency changes, more to come... fuchsi 2007-12-19 13:29:50 +00:00
  • f41172f850 Merge httpDate into serverDate as suggested. Removed some unnecessary code and fixed a possible synchronization problem. fuchsi 2007-12-18 22:35:02 +00:00
  • 5aa8d72502 *) cleaned up code for better readability in Netbeans (tabs -> spaces)\n*) no functional changes low012 2007-12-18 20:57:02 +00:00
  • a52681dd49 add buffering for the performance graph to avoid ConcurrentModificationException closes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=628 fuchsi 2007-12-18 15:59:35 +00:00
  • 814aff60bd - (re-)activated ftp protocol. see discussion here: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=623&hilit=&p=3875#p3875 - set default-flushsize for pro to 500 orbiter 2007-12-18 00:14:44 +00:00
  • 6fbda9ef4f *) cleaned up code *) added new filter 'FILTER_INVERT' and new method ymageMatrix.invert() to use it (does not work where characters have been written with ymageToolPrint.print(), haven't found the reason yet) *) fixed a possible arrayOutOfBoundsExceptions in filter() if y-value of area to use filter in was larger than height of image filter is used with low012 2007-12-16 22:15:27 +00:00
  • b0aefcf2f3 #small update daburna 2007-12-16 15:23:33 +00:00
  • 21f7e13fa1 fix stupid tiny bug introduced in rev 4276 that broke request URL parsing almost completely fuchsi 2007-12-16 00:33:32 +00:00
  • 5d406d0094 - fixed url "file extension" parsing when there is no extension (like http://yacy.net/ would have extracted .net/) - removed unecessary code + minor cleanup fuchsi 2007-12-14 20:03:26 +00:00
  • 21b8d1b918 small cosmetic change for static fields in serverCore (special protocol ASCII entities) to improve readability fuchsi 2007-12-14 19:17:54 +00:00
  • 270d016d89 fix for missing anonymization in search profiling orbiter 2007-12-12 18:57:43 +00:00
  • e3e4f06be4 enhanced search result preparation in the case that no result is found (fast abandon of search) orbiter 2007-12-12 14:18:42 +00:00
  • 321553afc2 #updated German language file daburna 2007-12-12 12:15:37 +00:00
  • 59e83b2fb6 #updated french language file by translation out of the wiki. made by Mikayé daburna 2007-12-12 11:39:09 +00:00
  • 1bd02762de Improve HTTP/ICAP header processing. - workaround for illegal line endings (LF only), closes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=595 - fixed bug where we didn't break the processing immediately on EOS (the loop was run until the buffer was completely filled with -1) - further performance improvements (one simple loop, avoid double processing of every byte and unnecessary temporary buffers) fuchsi 2007-12-12 06:37:18 +00:00
  • 01554f4012 fixed bug with double-check in crawler orbiter 2007-12-12 01:32:25 +00:00
  • b1e08d354c repaired indexing after search snippet loading orbiter 2007-12-12 00:33:26 +00:00
  • 48138952ff added memory measurement for index recreation to avoid OOM during index RAM space extension orbiter 2007-12-11 15:07:03 +00:00
  • 5a80359b0e new default remote favicon for search results orbiter 2007-12-11 12:40:48 +00:00
  • 9e23acf2d6 introduced new 'authority' ranking property orbiter 2007-12-11 01:32:58 +00:00
  • a1b80017e0 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=594&p=3630#p3630 orbiter 2007-12-10 15:00:01 +00:00
  • a3bfd668aa opening of array files at startup time, not when first time the web index is accessed this speeds up the first search after startup orbiter 2007-12-10 02:40:16 +00:00
  • ca488e03f5 fixed authorization case orbiter 2007-12-10 02:04:48 +00:00
  • 6a3a292015 - smoothed ymage font - changed position of status banner orbiter 2007-12-10 01:47:04 +00:00
  • 7397152e04 *) quick hack for antialiasing, works only on borders now => less blurry image *) code is not finished, needs refactoring, still thinking about how to do it best low012 2007-12-09 19:17:24 +00:00
  • 4331e52d1c fixed too small peer number in banner orbiter 2007-12-08 02:48:19 +00:00
  • 515e1bde6d - fixed bug with constraint default - 0.556 - default RAM for pro releases now 120MB (because pro will become default) orbiter 2007-12-08 02:04:50 +00:00
  • 2954f96fae - removed public peer info box on status page, this info can now be seen in the status banner - added peer count to banner - added some values to protected status box orbiter 2007-12-08 01:39:59 +00:00
  • 4eb40c4f61 *) added 2 filters: blur and antialiasing (which in fact is nothing more than a mild blur) to ymageMatrix *) antialiasing is used for logo in banner low012 2007-12-07 22:51:13 +00:00
  • aeb1cf83a6 - corrected banner link (relative now) - changed color mode (replace) for banner - changed default color (fits to default skin) of banner in status orbiter 2007-12-07 21:25:36 +00:00
  • 5185acaf41 - reduced default search time - this can be configured using the network definition file orbiter 2007-12-07 03:25:57 +00:00
  • e22014dc83 some memory enhancements when generating and displaying ymage objects orbiter 2007-12-07 02:15:12 +00:00
  • f243e338cf implemented online caution also for local and remote search orbiter 2007-12-06 21:53:17 +00:00
  • 6680634703 removed unnecessary functions orbiter 2007-12-06 21:29:47 +00:00
  • 3ff09ad6b4 #updated french language file by translation out of the wiki. made by Marsupoil daburna 2007-12-06 18:20:46 +00:00
  • c57eb76b13 removed CMY color model from ymage classes and re-introduced RGB color model orbiter 2007-12-06 01:06:17 +00:00
  • b46bcaa5d8 changed method of profiling orbiter 2007-12-04 20:19:13 +00:00
  • 76cd6ed6f6 *) New methods to insert bitmaps that feature transparencies. *) Logo background is transparent now. (Using pixel at (0,0) to determine which color is transparent. Too dirty?) *) Logo is loaded through filesystem instead of HTTP now. low012 2007-12-04 19:45:50 +00:00
  • be214e594f - generalized ymage initialization options - auto-adoption of performance memory graph to needed dimension orbiter 2007-12-03 02:35:28 +00:00
  • ee8a177c26 *) Logo is in the middle of free space now. *) Fixed bugs in insertBitmap() low012 2007-12-02 21:20:11 +00:00
  • 72698fcd36 *) Banner features a logo now. It does not look nice, but at least it works. Banner is not finished yet. low012 2007-12-02 20:37:12 +00:00
  • 39d0f10ca1 Fix parsing oof dates in HTTP headers. RFC 2616 requires a client to support RFC 1123 (default), RFC 1036 and ANSI C formatted date strings (we only supported 1123 before). fuchsi 2007-11-30 20:47:27 +00:00
  • 3f848e282b PerformanceMemory_p now does a automatic update of memory graph every second orbiter 2007-11-30 11:28:26 +00:00
  • aefb3f7765 added memory graph picture to PerformanceMemory_p.html orbiter 2007-11-30 03:22:42 +00:00
  • ea81d97cfc fix for bad full domain crawl depth adoption (maximum depth is 8, because higher depth will cause that remote crawls do not work) orbiter 2007-11-30 00:37:58 +00:00
  • f645408ae9 added url retrieve option to uls.xml interface orbiter 2007-11-29 22:12:01 +00:00
  • cc20870267 fix for constraint handover problem: old yacy versions set a catchall-constraint if no constraint is given, but the new versions expect a null-constraint. see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=565&hilit= orbiter 2007-11-29 21:03:47 +00:00
  • 5ba415570e #updated German language file now the new IndexControlsites are complete translated daburna 2007-11-29 17:14:04 +00:00
  • 9b0ae4b989 added referrer to remote crawl url list orbiter 2007-11-29 13:58:00 +00:00
  • 18e516317d Fix problem with buggy HTTP-Servers which send illegal control characters in HTTP-Headers, they are ignored now. fuchsi 2007-11-29 06:02:45 +00:00
  • 7d5544e9b1 added some security checks to new remote crawl pull method to prevent that indexer is overloaded orbiter 2007-11-29 02:54:59 +00:00
  • d59c1a7936 removed test data orbiter 2007-11-29 02:11:48 +00:00
  • 89b9b2b02a redesigned remote crawl process: - instead of pushing urls to other peers, the urls are actively pulled by the peer that wants to do a remote crawl - the remote crawl push process had been removed - a process that adds urls from remote peers had been added - the server-side interface for providing 'limit'-urls exists since 0.55 and works with this version - the list-interface had been removed - servlets using the list-interface had been removed (this implementation did not properly manage double-check) - changes in configuration file to support new pull-process - fixed a bug in crawl balancer (status was not saved/closed properly) - the yacy/urls-protocol was extended to support different networks/clusters - many interface-adoptions to new stack counters orbiter 2007-11-29 02:07:37 +00:00
  • 69521d92e5 Add another external dependency from PDFBox package ("Bouncy Castle"). This is necessary for parsing of some encrypted PDF files. bcprov-jdk14-132.jar is the binary jar as it is provided in the PDFBox-0.7.3 package (same as our FontBox, PDFBox packages). fuchsi 2007-11-27 23:13:26 +00:00
  • 90a02990d2 NPE fix, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=549&hilit=&p=3383#p3383 orbiter 2007-11-23 09:26:35 +00:00
  • 2fcd18a972 - fixed bad behaviour of search event worker processes - fixed export of url lists in xml orbiter 2007-11-23 01:08:16 +00:00
  • 445c0b5333 added domain list extraction and html export format to URL administration menu http://localhost:8080/IndexControlURLs_p.html orbiter 2007-11-22 20:47:06 +00:00
  • d8d77fc4b2 fix for NPE, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=549&hilit=&p=3368#p3368 orbiter 2007-11-22 18:15:28 +00:00
  • bf6952abe7 - added url export to http://localhost:8080/IndexControlURLs_p.html - removed command-line option to export urls orbiter 2007-11-22 16:52:44 +00:00
  • af10f729df fixed image search and favicon loading orbiter 2007-11-22 01:34:29 +00:00
  • edba2b7bcc fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=543 orbiter 2007-11-21 23:26:51 +00:00
  • c48b73cda2 redesign of ranking data structure - the index administration now uses the same code base for url selection and collection as the search interface. The index administration is therefore a good test environment for ranking order control - removed old postsorting-algorithms, will be replaced with new one - fixed many bugs occurred before during ranking; especially the contraint filtering method removed too many links - fixed media search flags; had been attached to too many urls. The effect should be a better pre-sorting before media load within snippet fetch orbiter 2007-11-21 23:14:57 +00:00
  • 6f1308da2f - some enhancements to IndexControlURLs (shows more links, connects referrer to another query) - some refactoring to search process orbiter 2007-11-17 01:53:02 +00:00
  • bf9a9e4e5e fix for NPE in IndexControlRWIs_p.java orbiter 2007-11-16 16:37:45 +00:00
  • c527969185 - enhanced monitoring of ranking parameters for details, please try http://localhost:8080/IndexControlRWIs_p.html - fixed computation of ranking ordering in some cases orbiter 2007-11-16 14:48:09 +00:00
  • bd5673efbe added cleaning of search event before opening the index administration orbiter 2007-11-15 12:49:13 +00:00
  • 55da871211 preparations for better ranking: better debugging of index properties to do this, the index administration interface was extended. It is now possible to select parts of a index. See properties shown in interface after a word search for details. orbiter 2007-11-15 03:03:18 +00:00
  • 383dc815d2 *) fix for commit 4212 low012 2007-11-14 19:14:53 +00:00
  • 3491531cea - fixed 'appears in url' flag in index generation - extended index administration page, shows some properties to the web links now orbiter 2007-11-14 01:15:28 +00:00
  • 19176e12e2 -corrected typo made in 4213 -updated translation daburna 2007-11-13 10:13:04 +00:00
  • ec7ba0d3d0 - fixed problem with too small sort fields (sortbound was not set) - slightly changed handling of date in indexURLEntry orbiter 2007-11-13 02:24:10 +00:00
  • ca4ca79eba removed wrong hints to installation page. orbiter 2007-11-12 23:45:52 +00:00
  • a01c42575d *) 404 error pages will be displayed with correct CSS and favicon now (http://forum.yacy-websuche.de/viewtopic.php?t=482) low012 2007-11-12 20:18:47 +00:00
  • 2b57d64de3 *) typo (http://forum.yacy-websuche.de/viewtopic.php?t=428) low012 2007-11-12 19:18:51 +00:00
  • bc2368e907 fix for problem with remote crawl referrers orbiter 2007-11-12 16:32:50 +00:00