Mirrors/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2025-11-05 23:46:12 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • e0007b2764 fixed save button in confignetwork orbiter 2007-05-03 21:37:22 +00:00
  • abb63e3289 *) disabled system.exit() in case of YaCy shutdown as it kills the whole VM (including updater and other management threads) *) UpdateCheck-Thread now pauses for given interval correctly rramthun 2007-05-03 19:16:43 +00:00
  • 9c41132569 re-implemented gc-button (has been lost somewhere) orbiter 2007-05-03 08:49:37 +00:00
  • dd44a1394f disabled automatic performance setting change - during crawl start - each indexing cycle - for delay values - for short memory cycles orbiter 2007-05-02 15:39:27 +00:00
  • b9add5cf37 some bugfixes: - dht iterator start point - wordIndex synchronization - surftipps url check orbiter 2007-05-02 14:20:43 +00:00
  • 06b6e35484 fix for a null pointer exception if clusters are not defined orbiter 2007-05-02 12:26:29 +00:00
  • d4428947af fix for http://www.yacy-forum.de/viewtopic.php?p=34962#34962 orbiter 2007-04-30 23:21:13 +00:00
  • 35c660654d more debugging lines to fix bug for http://www.yacy-forum.de/viewtopic.php?p=34935#34935 orbiter 2007-04-30 23:05:19 +00:00
  • 47e90f31b2 fix for deadlock in plasmaWordIndex.addPageIndex synchronization for class method not necessary see also: http://www.yacy-forum.de/viewtopic.php?p=34959#34959 orbiter 2007-04-30 22:30:09 +00:00
  • 81844e85b2 - fixed more cluster routing problems - fixed a problem in remote search when balancer caused shift process to wait too long orbiter 2007-04-30 00:39:53 +00:00
  • 304ed3f4d2 fix for remote crawl requests in clusters orbiter 2007-04-29 22:52:07 +00:00
  • 1979a167d3 fixed problem with cast orbiter 2007-04-29 22:31:44 +00:00
  • e48189c710 enhanced cluster routing - cluster definitions can now contain an addition for local ip addresses - cluster-cluster communication uses the local ip address instead the global address, if one is given orbiter 2007-04-29 22:05:34 +00:00
  • 97d4ab2053 - handle null from iterator in IndexCreateWWWLocalQueue_p.java - fixed ETA to reach next peer in Network.java - added some <label>s and fxied minor XHTML errors in ConfigNetwork.html - try to avoid returning null in servlets as it is unexpected and causes a NPE in the file handler karlchenofhell 2007-04-29 21:45:01 +00:00
  • e9d87b2fce *) changes required for the uploader theli 2007-04-29 15:56:45 +00:00
  • b33cef421e better routing for public clusters orbiter 2007-04-29 00:08:38 +00:00
  • f5e6a5d8b2 Fixed media search: parameters were in the wrong order. michitux 2007-04-28 23:23:16 +00:00
  • 7c902996b5 *) changes required for the uploaderWrapper theli 2007-04-28 16:04:37 +00:00
  • 44fe8361ae *) re-enable popup configuration on status-page (no author) 2007-04-28 10:35:46 +00:00
  • d5b7eac6d7 *) aquirerelease should now work again (no author) 2007-04-28 06:31:45 +00:00
  • f73e1e3af9 fixed bugs in remote search setting for public clusters orbiter 2007-04-28 00:12:41 +00:00
  • 485bf1ea83 bugfix for robinson/remote crawl bug orbiter 2007-04-27 21:35:43 +00:00
  • d86a823822 *) re-enable commands on status page theli 2007-04-27 15:37:43 +00:00
  • e0d6d5bacf - release information retrieval only on demand of user. Must be admin. the option is only presented if it is known that there is somewhere another more recent version - removed some old code - disabled online-mode presentation. the code is not yet removed until decision about future usability is made. (not all countries have DSL for everyone) orbiter 2007-04-27 13:59:59 +00:00
  • 62c947b4aa next try to fix deadlock in plasmaWordIndex see also: http://www.yacy-forum.de/viewtopic.php?p=34821#34821 orbiter 2007-04-27 12:26:36 +00:00
  • 871ee1ce0f one step closer to automatic updates: automatically aquire release information from download archives web pages from latest.yacy-forum.net and yacy.net are retrieved, parsed, links wihin are analysed, sorted and the most recent developer and main releases are provided as direct download link on the status page, if it was discovered that a more recent version than the current version is available. This process is done only once during run-time of a peer, to protect our download archives from DoS by YaCy peers. orbiter 2007-04-27 09:23:44 +00:00
  • baa814df24 *) adding cluster pph and qph to network.xml theli 2007-04-27 05:15:46 +00:00
  • ec225f9ab6 *) SOAP: adding methods to get the comment and MD5 checksum of a single file theli 2007-04-27 05:10:31 +00:00
  • 2399ed817c *) robots.txt parser now extracts the sitemap-URL (will be used later) *) some javadoc added *) junit testclass for robots.txt parser added theli 2007-04-26 15:42:38 +00:00
  • fa012789b2 tried to fix a deadlock problem durin shutdown see also: http://www.yacy-forum.de/viewtopic.php?p=34753#34753 orbiter 2007-04-26 15:15:40 +00:00
  • e192f616a2 collection of small bugfixes orbiter 2007-04-26 14:28:57 +00:00
  • 64a6d6e5e6 added new set iterator (needed for last commit) orbiter 2007-04-26 09:52:37 +00:00
  • f8de19fb2f robinson cluster: added client-side protocol implementation - the network configuration page shows a new option: robinson clusters - when a global search is made, all robinson peers are excluded, but: - robinson peers/clusters that provide peer tags and where search words match such tags, they are included in global search. Therefore, robinson peers/clusters support the global yacy network with their indexes, without doin DHT-exchange orbiter 2007-04-26 09:51:51 +00:00
  • 794eefe5b1 added new favicon orbiter 2007-04-26 09:33:26 +00:00
  • 50e1e61fa5 *) SOAP: adding functions to rename and move files theli 2007-04-25 05:36:28 +00:00
  • 63a004abff *) bugfix for Nullpointerexception theli 2007-04-25 05:22:09 +00:00
  • 29fe2beac7 possibly fixed a deadlock cannot find forum link now for that orbiter 2007-04-24 21:55:57 +00:00
  • 4f4d3d71dd *) Faster appearance of ConfigBasic by bypassing UPNP-scan in case of existing external connects *) Marked two deprecated source-points *) Added possibility to dump words from indexing to file. Should not affect performance in the current form. (no author) 2007-04-24 16:33:31 +00:00
  • 657585fe0d network functions for robinson peers: server-side protection orbiter 2007-04-24 15:11:12 +00:00
  • 8253a5bf82 small interface correction orbiter 2007-04-23 20:55:58 +00:00
  • 89c1511738 - added new Network Configuration menu, can be found in basic settings - new cluster functions will be available in this menu, but currently not enabled, because corresponding interface methods are not ready yet - shifted remote crawl settings to new network configuration menu - shifted DHT distribution/receive to the new network configuration menu - adopted some string constants - added cluster configuration settings to yacy.init orbiter 2007-04-23 20:47:07 +00:00
  • c5c3ecc67e - fixed display of last entered value at IndexCreate_p plus minor usability/HTML adjustments - removed double XML-escaping from CacheAdmin_p karlchenofhell 2007-04-23 18:53:21 +00:00
  • 62b79aa0a9 bugfix for http://www.yacy-forum.de/viewtopic.php?p=34558#34558 orbiter 2007-04-20 21:38:12 +00:00
  • 2f3b518169 temporary patch for startup-problem: http://www.yacy-forum.de/viewtopic.php?t=3854 This is a serious problem that is caused by the database bug between 0.511 - 0.513 which produced a large number of double-entries in the RWI index. The uniq()-method tries to fix this, and it does not terminate when the index is large and the number of double-occurrences is also large. This patch does simply implement a time-controlled termination, which does not heal the inconsistency problem. The uniq-method itself is correct and does not need a bugfix, the non-termination is simply caused by the large number of data that is shifted during the process. It was possible to reproduce this behaviour in a test environment. A real fix would need to: - enhance the uniq()-method by using a recursive, binary segmentation of the array to be fixed - uniq() must report the entries that are double - the double-entries must be deleted from the collection index (from the index and the collections) to heal the problem orbiter 2007-04-20 07:53:58 +00:00
  • e6fb6426a3 *) Some cosmetical changes and corrections rramthun 2007-04-19 16:16:54 +00:00
  • eeb5d62bff fix for http://www.yacy-forum.de/viewtopic.php?p=34484#34484 orbiter 2007-04-19 15:35:23 +00:00
  • ba525ebf52 - re-enabled path optimization that was disabled during testing - re-implemented index load/extend optimization that was removed from kelondroFlexTable, this is now part of kelondroIntBytesIndex orbiter 2007-04-19 14:55:19 +00:00
  • 595ee10468 fixed datatabase inconsistency bugs inserted many debug lines added a huge number of asserts extended database test methods orbiter 2007-04-19 13:37:02 +00:00
  • ca79362b9d disabling auto-setting of remote crawl performance see also http://www.yacy-forum.de/viewtopic.php?t=3849 orbiter 2007-04-18 18:36:06 +00:00
  • 7a7a1c7c29 fight against problems with remove-methods and synchronization - some bugs may have been fixed with wrong removal operations - removed temporary storage of remove-positions and replaced by direct deletions - changed synchronization - added many assets - modified dbtest to also test remove during threaded stresstest orbiter 2007-04-17 15:15:47 +00:00
  • b6a5f53020 removed double synchronization from kelondroRecords.USAGE to prevent thread locking. The method synchronization should be sufficient orbiter 2007-04-15 21:13:54 +00:00
  • 6186185775 *) Moved some comments to javadoc (no author) 2007-04-14 10:11:37 +00:00
  • 56b30d6593 * fixed a bug in ie: class-names for image-snippets were set, but had no influence on ie, they have to be set with className = * fixed a bug in safari (hopefully, sorry that I removed the old fix, the divs): yacy-logo is now above the fieldset, the fieldset clears and has a margin-left set * fixed a bug with the dls: for example in ViewProfile.html the dt's (the terms/keys) had not the same height as the dd's, so the dt's were not in the same row with the coresponding dd's towards the bottom * moved my new css-classes to the right place in base.css michitux 2007-04-13 23:14:12 +00:00
  • e917bfcae3 * Bugfix: changed handling of the query-string to be independent from input-elements * removed unnecessary divs michitux 2007-04-13 18:01:02 +00:00
  • 063063aa0c fix for 100% cpu bug during dht selection see also: http://www.yacy-forum.de/viewtopic.php?p=34068#34068 orbiter 2007-04-13 13:40:19 +00:00
  • f15fa7c5b1 *) also visited menulinks hover correctly now auron_x 2007-04-13 10:03:57 +00:00
  • f88aea4869 reverted another bad idea orbiter 2007-04-12 21:28:31 +00:00
  • 58c7cd7885 reverted svn 3563 orbiter 2007-04-12 21:24:56 +00:00
  • 4990909178 Some bugfixes, new layout/style for image search results: * removed divide by zero bug when 20_dhtdistribution_busysleep is 0 * replaced German comment with wrong charset in source/de/anomic/plasma/plasmaCrawlBalancer.java by an English one * replaced the table-fix for floating behind snipped images by a br with clear * removed unnecessary old xhtml-files (were not in use, they were created when we weren't having xhtml for testing) * new layout for image-search results: replaced the old one with spans and tables inside (not valid) with new divs, now each image snippet container has the same size TODO: * the ids of the snippetLoading-divs aren't valid because ids must start with an alphabetic letter or an underscore, they have to be prefixed * in the returned snippet-xml is an unresolved pattern for status (the status is only set for text snippets) michitux 2007-04-12 18:21:17 +00:00
  • 2e052eb816 fixed a bug in remote search with remote search tracker orbiter 2007-04-12 13:49:50 +00:00
  • fb6b21bb6c force opening of found pages on same page, not same frame orbiter 2007-04-12 12:45:42 +00:00
  • 87fcefe1d9 white background color is default to support the kaskelix portal style orbiter 2007-04-12 10:22:48 +00:00
  • 78d04bcbcf fixed bug in search statistics orbiter 2007-04-12 09:24:56 +00:00
  • 45f4489f4b bugfix for broken media search orbiter 2007-04-12 08:58:19 +00:00
  • 3e5cd34229 update to search display options for kaskelix embedding orbiter 2007-04-12 07:31:26 +00:00
  • a922d9444d fixed search page (there had been some unresolved patterns) orbiter 2007-04-11 14:46:54 +00:00
  • d59b31ec0c better display of embedded search results (no more comment on global search, if local was choosen on purpose) orbiter 2007-04-10 14:37:34 +00:00
  • 4eecf0bb12 templates for embedded display. try: http://localhost:8080/yacysearch.html?display=2&input=0&search=yacy&resource=local orbiter 2007-04-10 14:28:04 +00:00
  • b79b4082e2 completed search exclusion: - exclusion on index-level (not only from search snippets) - exclusion hand-over at remote search protocol orbiter 2007-04-10 12:27:03 +00:00
  • 991c62387a just ignore wrong ports allo 2007-04-09 22:05:07 +00:00
  • d66b0276e3 *) removed log-output for PPM-calc auron_x 2007-04-07 10:03:12 +00:00
  • 4400acc27d *) created new 8 bit oldschool style font for possible future use *) main method is generalization of main method of ymageFontGenerator: it does not matter how many lines of how many bits a font is made of as long as the values stay the same within the font -> use this class as a template for your own font generators and be a happy camper *) main method checks if font is valid (96 characters, all letters must have same number of lines and same number of bits per line) *) ***** I have not checked if the result is really a valid font so far. ***** low012 2007-04-05 21:05:16 +00:00
  • 25070822a5 fix for http://www.yacy-forum.de/viewtopic.php?p=33925#33925 orbiter 2007-04-05 19:08:59 +00:00
  • 06a7978730 moved url pattern matching for search to better place orbiter 2007-04-05 15:08:14 +00:00
  • 159bd0cab5 diverses; b.o. fix for http://www.yacy-forum.de/viewtopic.php?p=33914#33914 orbiter 2007-04-05 14:58:29 +00:00
  • cdc7b77a62 fix for http://www.yacy-forum.de/viewtopic.php?p=33916#33916 orbiter 2007-04-05 14:47:45 +00:00
  • 40c14a4f0e - better implementation of search query properties - basic protection against start-up problems when database files are corrupted - auto-delete of not-critical databases during startup when load error occurs - on-the-fly reset option for all database tables - automatic on-the-fly reset for seed tables during enumeration exceptions orbiter 2007-04-05 10:14:48 +00:00
  • 0c8ff6729f *) adding function to delete single entries from the Global-Crawl-Trigger Queue theli 2007-04-05 04:37:40 +00:00
  • 1696606b7f *) changing loglevel of "PPM-Calculation" message theli 2007-04-04 13:09:59 +00:00
  • f30bf1683e *) corrected spelling of captcha auron_x 2007-04-04 10:13:58 +00:00
  • fcdf000fbc bugfix for http://www.yacy-forum.de/viewtopic.php?p=33838#33838 orbiter 2007-04-03 22:08:40 +00:00
  • d7edc9740b *) added correct (c) and Last*-data low012 2007-04-03 20:58:45 +00:00
  • ee241f32e6 *) very basic capcha class (see coding sections of forum for more details) low012 2007-04-03 20:54:14 +00:00
  • 6e7340ef52 added exclusion search (you can now search and exclude words from the result with '-') orbiter 2007-04-03 15:35:29 +00:00
  • e4734a8b6b fix for fix in SVN 3537 orbiter 2007-04-03 14:42:29 +00:00
  • c1dd6a674a erased stopwords. We need a different solution here. Stopwords must consider experiences from our new common words and it must distinguish different languages. orbiter 2007-04-03 12:43:40 +00:00
  • 356033aceb fixed bug with continuous reset of balancer file index orbiter 2007-04-03 12:36:24 +00:00
  • ba2c307ab3 optimized memory allocation in kelondroRow.Entry such an entry cannot be instantiated without allocation of new byte[]; instead it can re-use memory from other kelondroRow.Entry objects. during bugfixing also other bugs may have been solved, maybe the INCONSISTENCY problem could have been solved. One cause can be missing synchronization during bulk storage when a R/W-path optimization is done. To test this case, the optimization is currently switched off. More memory enhancements can be done after this initial change to the allocation scheme. orbiter 2007-04-03 12:10:12 +00:00
  • 24ea4ca631 *) adding first version of postscript parser theli 2007-04-01 15:02:07 +00:00
  • def0d6124e *) trying to solve SecurityManager problem during init of soap engine theli 2007-03-31 16:01:52 +00:00
  • 75eb65028a *) adding a test if a seucrity manager is active theli 2007-03-31 14:30:09 +00:00
  • 210ede8230 added a class for byte-array management. This was the result of a very large experiment to replace byte[] objects within kelondro. Frequent System.arraycopy are common when kelondroRow.Entry objects are handled. This class may be used to prevent this. However, experimental replacement of byte[] by kelondroByteArray in kelondroRow.Entry resulted in complete re-write of large parts of kelondro. This experiment did not completely lead to a result, because then the interface to kelondro had to be changed also from byte[] to kelondroByteArray, which may have caused a rewrite of large parts of YaCy. The experiment is therefore abanonded, but this class remains here without any function but possibly for future use. orbiter 2007-03-30 08:44:43 +00:00
  • bc37ac64b3 *) Fix for last commit. low012 2007-03-28 22:37:01 +00:00
  • f603b58f6c *) No stacktrace anymore if invalid regex is entered for URL mask or Prefer mask, insted an error message gets displayed. low012 2007-03-28 22:18:54 +00:00
  • 1b7fda12ee *) SOAP: separate function to get the active/passive/potential peer list theli 2007-03-28 07:34:44 +00:00
  • 6488ec8a80 no deletions in index in case that snippet-loading fails and there is no network connection orbiter 2007-03-27 08:21:45 +00:00
  • 847349358b less memory usage during collectionIndex-rebuild should also speed up that process a little bit orbiter 2007-03-27 08:21:03 +00:00
  • 8ef3ad12a7 *) fix for rare bug in PPM-calc auron_x 2007-03-25 21:46:03 +00:00
  • 00bc0c1b47 *) new logging for PPM-Calculation auron_x 2007-03-25 20:24:12 +00:00
  • 5941577076 *) added some logging to PPM-Calculation to find a rare bug auron_x 2007-03-25 14:56:42 +00:00