[mythtv] Mythfilldatabase and Shepherd (tv_grab_au)

[Michael T. Dean]

On 07/18/2011 04:01 PM, Michael T. Dean wrote:
> On 07/16/2011 05:17 PM, Max Barry wrote:
>>    Shepherd phones
>> home with stats, and our graphs were showing an order of magnitude spike
>> in usage at 2am, as a great many Shepherd users Australia-wide all hit
>> the datasources at once. Please bear in mind that each Shepherd user is
>> not simply downloading one XMLTV file, but rather compiling XMLTV by
>> scraping dozens or hundreds or thousands of different web pages.
>>
> http://code.mythtv.org/trac/ticket/2194#comment:7
>
> runs should be spread out within that window.
>
> That said, I'm all for changing the defaults for execution start and end
> to 0/23 (meaning it's allowed to run at any time of day--so runs would
> be spread out over the whole day, where each would be "seeded" by the
> time the user first ran mythbackend).

Oh, and I should probably mention:

Run mythfilldatabase at time suggested by the grabber.
If enabled, allow a DataDirect guide data provider to specify the next 
download time in order to distribute load on their servers. 
mythfilldatabase Execution Start/End times are also ignored.

which defaults to enabled.  Currently, it only works with Schedules 
Direct data, but if the XMLTV community wants to come up with a 
standardized approach for providing this data, I can add support for it 
into mythfilldatabase.  Then, each grabber can choose a time using 
whatever approach they want (random times, phone home to the Shepard 
server and ask it for the recommended next run time, ...).

Mike