Commit Graph

  • 9f505af7aa preparations for bulk remote crawls orbiter 2005-07-19 00:26:31 +00:00
  • 0f663bcebf added global ppm computation orbiter 2005-07-18 15:22:14 +00:00
  • 9c72b4cdec replaced index dump stack by an dump array and limited url number in assortment ram (prevents too much RAM occupation) orbiter 2005-07-18 13:32:44 +00:00
  • 51962d55bf added 'PPM', page-per-minute statistics orbiter 2005-07-18 00:44:51 +00:00
  • 159f795f65 bugfix (null pointer exception in assortments) orbiter 2005-07-17 22:25:50 +00:00
  • 1d2155675b changed assortment memory cache flush orbiter 2005-07-17 21:22:18 +00:00
  • c47736a158 configuration of number of output lines in IndexMonitor orbiter 2005-07-12 15:55:25 +00:00
  • 19dbed7cc8 code clean-up orbiter 2005-07-12 15:09:35 +00:00
  • 00f63ea00d fail-save patch for pattern matching orbiter 2005-07-12 00:31:35 +00:00
  • 0a6be961ea added pattern organization orbiter 2005-07-12 00:21:46 +00:00
  • 40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search orbiter 2005-07-12 00:07:09 +00:00
  • 311e627363 blocking of blacklisted urls in indexReceive and small changes orbiter 2005-07-11 15:36:10 +00:00
  • 2f0d7ea8d3 removed htcache stati (superfluous now) orbiter 2005-07-09 00:33:34 +00:00
  • 277048501e bugfix orbiter 2005-07-08 16:24:07 +00:00
  • 8b89c46afe fixed problem with cache write orbiter 2005-07-08 16:06:35 +00:00
  • 455ae9f55f fixed htcache-store problem and due-time for remote crawls orbiter 2005-07-08 15:17:50 +00:00
  • 55d10b864c *) further improvements in shutdown behaviour theli 2005-07-07 22:03:52 +00:00
  • 96386d6fc6 *) further improvements in shutdown behaviour theli 2005-07-07 21:44:31 +00:00
  • 0b95c9c434 *) Bugfix for Thread.getID() usagage + PeerPing-Shutdown Deadlock See: - http://www.yacy-forum.de/viewtopic.php?p=4937 - http://www.yacy-forum.de/viewtopic.php?p=4939 theli 2005-07-07 21:00:11 +00:00
  • 13eeaa08f3 *) httpc.java: - Now it's possible to interrupt pending httpc-actions on server shutdown - this is possible because of a newly introduced registration mechanism for open sockets *) yacyCore.java - blocking peerPing threads can now be interrupted on server shutdown *) serverCore.java - restructuring shutdown code *) error.html - port number is now set correctly if port forwarding was enabled theli 2005-07-07 13:58:54 +00:00
  • 5c3822d5f4 *) adding experimental support for parsing of bookmarksfiles See: http://www.yacy-forum.de/viewtopic.php?t=177 theli 2005-07-07 13:41:56 +00:00
  • f57b60cd60 *) Correcting Problems with htmlFilterContentScraper.java Tag name comparison was case sensitive, therefore e.g. <A href="test.txt>test</A> was not parsed correctly. theli 2005-07-07 13:32:49 +00:00
  • 50d4c302c7 removed yacy.blue (not part of release) orbiter 2005-07-07 13:26:35 +00:00
  • b79070b471 fixed proxy/scraper orbiter 2005-07-07 13:25:41 +00:00
  • 419f8fb398 fixed bugs/missing code regarding new crawl stack orbiter 2005-07-07 01:38:49 +00:00
  • 9a7c4080d5 Fix for libx compression. See http://www.yacy-forum.de/viewtopic.php?p=4922#4922 rramthun 2005-07-06 17:46:52 +00:00
  • 112c5d3332 the new file-based indexing queue orbiter 2005-07-06 14:50:01 +00:00
  • 858cd94299 replaced indexing ram-queue by file-based stack-queue orbiter 2005-07-06 14:48:41 +00:00
  • 4851b432e1 nice Version display(without svn rev added) allo 2005-07-05 13:43:48 +00:00
  • 2d1ccae406 *) bugfix for svn revision number detection theli 2005-07-05 09:31:23 +00:00
  • b90f8e128a *) bugfix for svn revision number detection theli 2005-07-05 09:24:14 +00:00
  • 4e3a5db25b http://www.yacy-forum.de/viewtopic.php?p=4889#4889 Be carefull with short Strings... allo 2005-07-05 09:09:38 +00:00
  • 3cd9a1f4bd *) correcting problems with wrong svn revision number - if the .svn directory exists, the entries file will be parsed to determine the revision number of the corrent working copy - then the revision number in the build.properties file will be overwritten with this value - if the .svn directory does not exists the value from the build.properties file will be used theli 2005-07-05 09:00:35 +00:00
  • ea716b5010 more translation... rramthun 2005-07-04 19:02:29 +00:00
  • a31029c5de == as separator allo 2005-07-04 17:40:44 +00:00
  • 9f0f45bcae Warning: this is untested. I will need this for recursive Translation, and check it while extending the Translator. allo 2005-07-04 15:53:45 +00:00
  • 252c6e4869 added crawl queue monitor for global crawls orbiter 2005-07-04 15:07:33 +00:00
  • e2d8766fa7 Nearly finished translation of Status.html... rramthun 2005-07-04 13:08:17 +00:00
  • 9a3f80403e redesigned IndexCreate menu -- introduced submenues to enable more crawl queue control pages orbiter 2005-07-04 12:42:29 +00:00
  • 57c30f1d78 *) bugfix for usage of httpc without gzip content encoding theli 2005-07-04 11:25:25 +00:00
  • 0e2c33ee55 *) Network.html/Network.java: - Adding function to manually force peer ping to remote yacy peer See:Network.html?page=4 - for debugging purpose only! theli 2005-07-04 11:09:48 +00:00
  • 5159a090b0 fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/) orbiter 2005-07-03 23:33:25 +00:00
  • 377e94f30e The usual stuff... rramthun 2005-07-03 19:47:53 +00:00
  • 7f7cbc5019 fixed bug with snippets orbiter 2005-07-03 13:37:20 +00:00
  • 3607159a9a fixed connection of out-dated peers orbiter 2005-07-03 13:08:49 +00:00
  • fbef7fed81 adopted latestVersion to float handling orbiter 2005-07-03 12:40:36 +00:00
  • 374f4ccdb4 Fixed mistake made in earlier revision... rramthun 2005-07-02 20:28:02 +00:00
  • f32ce64789 Began translation of status-page... rramthun 2005-07-02 20:02:17 +00:00
  • 39080f77e6 Corrections to the translation... rramthun 2005-07-02 16:49:41 +00:00
  • eb74fa0c82 fixed a bug with snippet-length orbiter 2005-07-01 23:35:36 +00:00
  • 7a7099e9dc Translation rramthun 2005-07-01 13:07:48 +00:00
  • 1a75762897 Translation... rramthun 2005-07-01 12:29:31 +00:00
  • ec8a5ad060 fixed base implementation (verified with www.burningboard.net/archive/index.html) orbiter 2005-06-30 23:49:32 +00:00
  • 1d3cfb380a experimental implementation of base parsing in html parser orbiter 2005-06-30 23:28:35 +00:00
  • 86f2aa8478 fixed seed-load date bug (evaluating server date for age computation) orbiter 2005-06-30 23:19:08 +00:00
  • 8290969150 Automatic regeneration of Locales on Restart with a new (SVN) Version allo 2005-06-30 20:30:05 +00:00
  • 129929b396 Preparations for automatic Languagefile upgrade on new YaCy Version. allo 2005-06-30 19:39:19 +00:00
  • 664bceced5 removed debug-lines orbiter 2005-06-30 18:56:01 +00:00
  • 75ebdbc852 enhanced snippet-generation (case where snippet is too long) orbiter 2005-06-30 18:54:00 +00:00
  • 35c7a5883b First update of german language file + corresponding changes in HTML-file. Many will follow... rramthun 2005-06-30 18:26:10 +00:00
  • bef3aaec38 better Translationsystem. You only need to escape Chars, which have special meanings in regexps. some you have to escape: ()[]{} allo 2005-06-30 15:28:40 +00:00
  • 8a4f297324 fixed/enhanced snippet error-handling; suppression of results where no snippet exists orbiter 2005-06-30 00:01:53 +00:00
  • 712fe9ef18 bugfixed utf-8 decoding and parser orbiter 2005-06-29 22:55:37 +00:00
  • 63f9570d3a bbCode allo 2005-06-29 21:03:04 +00:00
  • 82d78fdab7 new Implementation and basic bbCode(Ok, opnly one Command ...) allo 2005-06-29 21:01:12 +00:00
  • a60f5efcd6 rename allo 2005-06-29 20:59:56 +00:00
  • 90573d9c88 Removed the bin from svn. If you want the current alpha version, i can release it as a second releasetree on Berlios. allo 2005-06-29 15:08:10 +00:00
  • ec397c343c *) Allowing longer forwarding commands theli 2005-06-29 13:07:05 +00:00
  • d50ad1521a *) correcting logging statement theli 2005-06-29 11:08:47 +00:00
  • 8718795c6d Using theli's anchors on Status.html rramthun 2005-06-29 10:53:34 +00:00
  • 6e97f70549 *) httpd.java: improved errorhandling theli 2005-06-29 10:05:38 +00:00
  • 9d8c66fb5e *) adding possibility to forward received yacy-messages (htroot/yacy/message.java) via a command-line email program (e.g. sendmail) to a configured email address - the configuration dialog is reachable via Settings_p.html#messageForwarding theli 2005-06-29 09:50:48 +00:00
  • 24d77b892f This changes eliminate a way to cripple Profile pages on other peers by sending special messages with HTML tags. low012 2005-06-29 08:22:04 +00:00
  • dbd06eace9 Used "id" tags instead of <a name="XXX">XXX</a>. This avoids links without target, which change colour on mouseover, but are not clickable. (<-- Das Wort gibt es bestimmt nicht...) rramthun 2005-06-28 18:28:37 +00:00
  • 08e4334c1d *) Status.java: showing amount of time since last upload of seed-file *) hello.java: adding additional output for principal-downgrade bug *) httpd.java, httpdFileHandler.java, httpdProxyHandler.java: improved errorhandling *) yacyCore.java: trying to fix principal-downgrade bug *) yacySeed.java: adding some constants theli 2005-06-28 11:27:31 +00:00
  • eee6322aaf *) Adding redirection support to plasmaCrawlWorker.java theli 2005-06-28 08:07:41 +00:00
  • cd279907c0 *) Adding redirection support to plasmaCrawlWorker.java theli 2005-06-28 08:01:26 +00:00
  • 6697d5e52e *) correcting fkt. mediaExtContains theli 2005-06-28 06:44:31 +00:00
  • a333715ffd This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.) low012 2005-06-27 19:52:40 +00:00
  • aad2268751 *) adding menue to top of configuration pages - IndexCreate_p.html - Settings_p.html theli 2005-06-27 09:59:58 +00:00
  • abba8fe61b fixed utf-8 decoding in htmlFilterAbstractScraper and removed httpd timing orbiter 2005-06-26 22:40:50 +00:00
  • 3addf58046 enhanced snippet-loading with threads orbiter 2005-06-24 07:41:07 +00:00
  • 4afcf10158 added kelondroHashtable (not finished yet) orbiter 2005-06-23 14:41:59 +00:00
  • 56d28a16f0 bugfixes orbiter 2005-06-23 14:40:39 +00:00
  • d6c85228a6 enhanced snippet computation orbiter 2005-06-23 12:12:12 +00:00
  • d53b2393e5 *) autoconfig.java: ip address was not reported correctly when port-forwardin is on *) hello.java: reportedip my be empty at peer startup *) httpc.java: adding method to determine if the connection was already closed or is broken *) httpdProxyHandler.java: trying to do a better errorhandling *) server/serverCore.java - setting myseed ip-address and port correctly if port-forwarding is on - doing a more failsafe close and adding some debugging output *) yacyClient.java: adding some logging statements to allow a better detection of "degraded to senior"-bug *) yacyCore.java: restructuring publishMySeed (@Orbiter: pleas take a look) - to avoid buzy waiting - to allow a gracefull shutdown on server shutdown - new seed count was not calculated correctly in the previous version *) yacySeedDB.java: host ip and port was not initialized correctly if port-forwarding was activated theli 2005-06-23 11:00:26 +00:00
  • 933256bbfc *) adding href's to allow direct access to the currently crawled website theli 2005-06-23 10:11:26 +00:00
  • fafda068f9 *) allowing crawler to process resources with statuscode 203 - this is needed if yacy is behind a second proxy theli 2005-06-23 10:00:31 +00:00
  • aae9a433a6 *) correcting usage of supportedFileExt-List theli 2005-06-23 07:43:59 +00:00
  • 83ceec3a63 *) Bugfix for wrong "Statusanzeige" See: http://www.yacy-forum.de/viewtopic.php?p=4560 theli 2005-06-23 07:23:40 +00:00
  • 1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets orbiter 2005-06-23 02:07:45 +00:00
  • dc1d707eb2 *) Deactivating "Port Forwarding Feature" for a while because of too many problems at the moment theli 2005-06-21 08:22:03 +00:00
  • 68dc2b0c6b added kelondroArray, the basis for upcoming kelondroHash and some bug fixes orbiter 2005-06-21 01:17:25 +00:00
  • afe7cbe4de just a typo... low012 2005-06-21 00:53:04 +00:00
  • 10f6f19c08 Fixed one typo and added a few options to handle messages when messages get displayed. low012 2005-06-20 23:35:42 +00:00
  • 5728cdf8b5 bugfix orbiter 2005-06-20 16:53:22 +00:00
  • a19541e563 code-enhancements after analysis with AppPerfect orbiter 2005-06-20 16:36:31 +00:00
  • cf171ca35d Some corrections to the webinterface... rramthun 2005-06-20 16:19:13 +00:00
  • 0e48177ad8 *) Bugfix of NullPointerException when sending Error Respond theli 2005-06-20 15:57:03 +00:00
  • bf78e0a6a4 *) Bugfix of Socket closed Exception See: http://www.yacy-forum.de/viewtopic.php?p=4437 theli 2005-06-20 13:33:23 +00:00