[mythtv-users] After 7y5m running, time to start from scratch after update to .27?

[Stephen P. Villano]

On 11/28/13, 7:47 AM, Paul Clark wrote:
>
>
>
> On 27 November 2013 15:03, R. G. Newbury <newbury at mandamus.org
> <mailto:newbury at mandamus.org>> wrote:
>
>     On 11/27/2013 04:25 AM, Simon Hobson wrote:
>
>
>                 If you then want to charge into that part of the map
>                 marked 'Here be Dragons', you can add port forwarding
>                 to your router for external access for mythweb,
>
>
>         But you **MUST** protect MythWeb from bots - eg add passworded
>         access to Apache. If a bot crawls your recorded programs page,
>         there's a "Delete" link for every recorded program. Similarly,
>         there's a "Don't Record" and "Never Record" link against every
>         rule on your Recordings Rules page. Having those crawls is
>         likely to significantly reduce the WAF !
>
>
>     That's one of the Dragons. Well, more like a scorpion hiding in
>     the grass!
>
>
>
> Just an idea (as someone who had this happen to them) but shouldn't a
> dev add a directive to mythweb to tell the bots not to crawl it?  Not
> sure how these things work but there's a page here
> <http://en.wikipedia.org/wiki/Robots_exclusion_standard> that seems to
> explain it. 
>
>
>
The robots.txt file would stop a "law abiding" service like Google, it
wouldn't stop non-compliant spiders, malware or nefarious individuals.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mythtv.org/pipermail/mythtv-users/attachments/20131128/1ef2ce07/attachment.html>