[mythtv-users] (SOLVED) Mythfilldatabase returns incomplete schedule data (Patched)

Raymond Boettcher raymondboettcher at yahoo.com
Sun Jan 20 06:50:57 UTC 2013


Then MythTV should run mythfilldatabase once every 5 days then.  The only concern to download anything that would be for TBA Programs or Football Games, etc where they don't know who is playing who yet.  That's funny that you should say something like that though and it makes perfect sense.  Do you work on the development team for Schedules Direct?

The retry problem would be such an issue but the real problem comes down to once it fails that block, it never tries it again on continuing days.  The retry method wouldn't be needed at all if it always checked to make sure it had records in the database for that time period.  If it doesn't, refresh that time block.  Simple Query to your local database and then if "records returned" = 0 (DBGuide.rows() == 0??) then pull that block from SD.  I'm a little rusty on C++ with QT but it wouldn't take me more than a few days to write that modification.  I just make mythfilldatabase request full pull if the records from Schedules Direct if the database has less than 9 days worth of Guide Data.  Of course make that value changable via mythtv-setup and dump the setting in the config part of the DB or with command parm to mythfilldatabase.

Its not like my mythfilldatabase doesn't already run every day.  So I think it would be impossible that it missed that same time block 14 days in a row until it finally came up as the current day and something didn't record.  Then you thumb through the guide to find data at like 7pm and so on for the next 14 days.

I understand that each time mythfilldatabase tries to connect to SD, that SD has to run a CGI or PHP script to generate the needed XML code that is being requested for the specific lineup and user account.  So I understand how it would be easier to do a single pull of everything instead of a specific time range for 14 days in a row.  That results in 14 connections or 28 if each time block is half the day each causing its own load in resources and SQL Queries..

So they should redesign the code a little.  Make it do a full pull every 5 days and pull just tomorrow to refresh TBA, etc once a night.  The 5th day will also count for the next day refresh since that data is included in the full pull still creating only 1 request for the night.  So it would run a little differently but still result in 1 request a night while conserving a little bandwidth.

I may dig deeper into mythfilldatabase because when I finish my program I will be adding a full load of IPTV Channels to my Program Guide so I can Schedule Recordings from them.  Since I wrote my own Shoutcast TV Streaming Source, it already generates a HTML Guide based on what is coming on next.  Wouldn't be to hard to make it generate a compatible XML file for mythfilldatabase as well.  This will allow Shoutcast TV Stations that are running my "Source" Program for their Shoutcast Server to list their program guide in MythTV as well.

Raymond Boettcher

--- On Sat, 1/19/13, Raymond Wagner <raymond at wagnerrp.com> wrote:

From: Raymond Wagner <raymond at wagnerrp.com>
Subject: Re: [mythtv-users] (SOLVED) Mythfilldatabase returns incomplete schedule data (Patched)
To: "Discussion about MythTV" <mythtv-users at mythtv.org>
Date: Saturday, January 19, 2013, 1:40 PM

On 1/19/2013 07:29, Raymond Boettcher wrote:
> There is an inherent problem with telling the grabber to download the
> full workload of data at once every night.  This will eventually take up
> a lot more bandwidth on Schedules Direct side when you really just need
> a day or two worth of updates.  Everyone will eventually switch over to
> --dd-grab-all and then MythTV will eventually remove the option because
> of the excessive workload on Schedules Direct.

Schedules Direct does not use any bandwidth on guide data at current, as you are downloading it directly from Tribune's DataDirect servers. Additionally, they are more concerned about the server load from running multiple single-day queries than they are the bandwidth of pulling seven times the data. They actually prefer everything be pulled in one shot.
_______________________________________________
mythtv-users mailing list
mythtv-users at mythtv.org
http://www.mythtv.org/mailman/listinfo/mythtv-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mythtv.org/pipermail/mythtv-users/attachments/20130119/dd5766c0/attachment-0001.html>


More information about the mythtv-users mailing list