[mythtv-users] visit from googlebot

Matthias Thyroff lists at Thyroff.net
Sat Sep 30 20:33:51 UTC 2006

> What happened? Did everything get deleted? Maybe mythweb should
> include a robots.txt to keep this from happeneing?

I am not sure if the googlebot is the worst thing that can happen if
you have a public mythweb page; don't leave your mythweb unprotected! 

Instead of a default robots.txt maybe better would be a
default .htaccess that disallows all access, so that you have to think
about that before you can use it. 

More information about the mythtv-users mailing list