Some of our topics are hardly ever hit by real humans but robots hit these things occupying a noticeable amount of CPU time.

bots and spiders are easy to deal with. the overview:

  • make a simpler skin
  • publish a static version of the pages using PublishPlugin
  • use apache rewrites to send them to the published version

-- irc:pharvey, SvenDowideit, WillNorris (ed.)
( from http://irclogs.foswiki.org/bin/irclogger_log/foswiki?date=2009-06-03,Wed&sel=290#l286 )


so far everyone's resisted the urge to write docco on that. please help expand the details smile i can envision this setup information added to ApacheConfigGenerator at some point, as well wink
Topic revision: r1 - 06 Jun 2009, WillNorris
The copyright of the content on this website is held by the contributing authors, except where stated elsewhere. See Copyright Statement. Creative Commons License    Legal Imprint    Privacy Policy