[mythtv-users] After 7y5m running, time to start from scratch after update to .27?

Gary Buhrmaster gary.buhrmaster at gmail.com
Thu Nov 28 14:33:12 UTC 2013


On Thu, Nov 28, 2013 at 12:47 PM, Paul Clark <paul at aghast.co.uk> wrote:
....
> Just an idea (as someone who had this happen to them) but shouldn't a dev
> add a directive to mythweb to tell the bots not to crawl it?  Not sure how
> these things work but there's a page here that seems to explain it.

See ticket 11958.

However, robots.txt is a hint, not a rule.  It is the
equivalent of simply leaving a sign on the wide
open door which says "Please do not walk in".
While most major search spiders respect the
suggestion, not all spiders do.

Note that Mythweb, in the setup instructions
explicitly states that one is *STRONGLY*
encouraged to set a password.

Perhaps packagers should default to authentication
with an invalid password file, requiring users
to actually configure Mythweb before first use.

Gary


More information about the mythtv-users mailing list