[mythtv-users] mythtv-users Digest, Vol 43, Issue 122

[Matthew Piggott]

Message: 17
> Date: Tue, 24 Oct 2006 14:39:14 -0400
> From: "Michael T. Dean" <mtdean at thirdcontact.com>
> Subject: Re: [mythtv-users] Google ate my recordings
> To: Discussion about mythtv <mythtv-users at mythtv.org>
> Message-ID: <453E5DD2.30402 at thirdcontact.com>
> Content-Type: text/plain; charset=ISO-8859-1; format=flowed
>
> On 10/24/06 14:22, Carl Fongheiser wrote:
>
> >  On 10/24/06, Glenn Chubak <glenn at saskatoon.com> wrote:
> >
> > > I would have thought that mythweb "Are you sure?" dialogs would
> > > have stopped the googlebot but it doesn't seem so. If anyone is
> > > interested I can post the access logs from apache.
> >
> >  Those dialogs only happen if the browser is Javascript enabled.
> >  Needless to say, the robots don't execute the Javascript code. For
> >  the future, you'll probably want to password-protect MythWeb. It's
> >  also a good idea to put a robots.txt file at the top level of your
> >  web server's document tree. For details, look here:
> >  http://www.robotstxt.org/wc/robots.html
> >
> >  Finally, I strongly recommend not having your MythWeb installation
> >  exposed directly to the Internet. That invites all kinds of trouble.
>
> IMHO, the robots.txt is completely useless since no robot should ever be
> allowed into the web app (as you mentioned in the second point).  Once
> Google gets info about your site--even with a robots.txt in place--that
> allows Google users to identify it as a MythWeb site, some sociopathic
> netizens will follow the Google-bot into your site and do Bad Things
> (i.e. delete the recordings, delete channels, delete settings, set up
> user jobs to do evil things to your Myth box--are you starting to get
> the idea that deleting recordings is probably the least bad thing that
> could happen?).  So, make sure you keep your Myth box out of the search
> engines (with appropriate authentication settings) or you're inviting
> real trouble.
>
> Mike
>
>
Actually I would think if you've got a robots.txt which denies Googlebot
access then it won't index the site either.  That said, if Googlebot found
your site so too will RandomBot01 which doesn't obey the robots.txt file.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mythtv.org/pipermail/mythtv-users/attachments/20061024/7e5944a2/attachment.htm