[mythtv-users] Possible fix for tv_grab_au 2.11

[Philip Shead]

David Whyte wrote:
> On 7/14/06, Paul Andreassen <paulx at andreassen.com.au> wrote:
>> It appears that detail pages are limited to 21 pages for an unknown time
>> limit.

>> This is much better than all the obfuscation and cookie stuff.  Minimal server
>> load.  Limits copyright program data to less then 10%.  Beautiful.

>> So no more detail pages except for maybe 21 shows you specify.  Maybe you
>> could turn off "slow" and add shows to "~/.tv_grab_au-detailed" eg. House.


> Or, could we slow the scrape right down, so that it only looks up a
> detail page every minute or so (obviously, trial and error will
> enlighten us as to what is achievable).  That way, whilst the process
> will take forever, we still get the details.

  I tried putting a 10 second sleep between GET_DETAIL_PAGE
actions. It worked for a bit, it used to fail at 7:35am
on the first day but with the delay it failed near 5pm. It
might actually be necessary to flush the connection or something
occassionally as well as slow it down.