<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<div class="moz-cite-prefix">On 11/28/13, 7:47 AM, Paul Clark wrote:<br>
</div>
<blockquote
cite="mid:CAP5ACz1qn9wHhrhA=0yUyEFCVxQp4eDhtzsTU87wU+vaH2EHtw@mail.gmail.com"
type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On 27 November 2013 15:03, R. G.
Newbury <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:newbury@mandamus.org" target="_blank">newbury@mandamus.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">On
11/27/2013 04:25 AM, Simon Hobson wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
If you then want to charge into that part of the map
marked 'Here be Dragons', you can add port
forwarding to your router for external access for
mythweb,<br>
</blockquote>
</blockquote>
</blockquote>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
But you **MUST** protect MythWeb from bots - eg add
passworded access to Apache. If a bot crawls your
recorded programs page, there's a "Delete" link for
every recorded program. Similarly, there's a "Don't
Record" and "Never Record" link against every rule on
your Recordings Rules page. Having those crawls is
likely to significantly reduce the WAF !<br>
</blockquote>
<br>
That's one of the Dragons. Well, more like a scorpion
hiding in the grass!<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
</blockquote>
</blockquote>
<div><br>
</div>
<div>Just an idea (as someone who had this happen to them)
but shouldn't a dev add a directive to mythweb to tell the
bots not to crawl it? Not sure how these things work but
there's a page <a moz-do-not-send="true"
href="http://en.wikipedia.org/wiki/Robots_exclusion_standard">here</a>
that seems to explain it. </div>
</div>
<br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
</blockquote>
The robots.txt file would stop a "law abiding" service like Google,
it wouldn't stop non-compliant spiders, malware or nefarious
individuals.<br>
</body>
</html>