[mythtv-users] Caching behavior (was: Re: 1 CableDigital Lineup available to chose but need 2 sources from it)

[David Brodbeck]

On Oct 16, 2007, at 2:29 PM, Michael T. Dean wrote:
> It turns out that the message you're seeing is a bit misleading.  That
> message ("This DataDirect listings source is shared by 2 MythTV
> lineups") is printed out any time 2 separate video sources use SD with
> the same userid and password--regardless of whether the lineupid is
> identical.  It seems that some of the "setup" data (i.e. cookies,  
> lists
> of lineups available, etc.--that's necessary for downloading listings
> data from any/all lineups) is cached, so the message is still output.
> However, the program listings data is not being cached because there's
> no way to download partial lineups from SD/TMS, so doing so  
> wouldn't be
> of any benefit.

Hmm.  Maybe.  But I still think there's more going on than you  
think.  When the first lineup is updated, I see wget output as the  
data is downloaded.  When the second one is updated, I don't.  So if  
it's not reusing the data, it's being really sneaky about downloading  
it the second time.  Log snippets below:


2007-10-08 11:11:39.203 Updating source #1 (Comcast Digital) with  
grabber schedulesdirect1
2007-10-08 11:11:39.222 Found 228 channels for source 1 which use  
grabber
2007-10-08 11:11:39.241
2007-10-08 11:11:39.265 Checking day @ offset 0, date: Mon Oct 8 2007
2007-10-08 11:11:39.921 Data is already present for Mon Oct 8 2007,  
skipping
2007-10-08 11:11:39.939
2007-10-08 11:11:39.964 Checking day @ offset 1, date: Tue Oct 9 2007
2007-10-08 11:11:39.989 Data Refresh always needed for tomorrow
2007-10-08 11:11:40.014 Refreshing data for Tue Oct 9 2007
2007-10-08 11:11:40.060 This DataDirect listings source is shared by  
2 MythTV lineups
2007-10-08 11:11:40.083 We should keep data around after this one
2007-10-08 11:11:40.107 New DB DataDirect connection
2007-10-08 11:11:40.132 Connected to database 'mythconverg' at host:  
localhost
2007-10-08 11:11:40.194 Retrieving datadirect data.
2007-10-08 11:11:40.219 Grabbing data for Mon Oct 8 2007 offset 1
2007-10-08 11:11:40.248 From Tue Oct 9 07:00:00 2007 to Wed Oct 10  
07:00:00 2007 (UTC)
2007-10-08 11:11:40.273 Grabbing listing data
2007-10-08 11:11:40.307 DataDirect: Saving listings to DD cache
--11:11:40--  http://webservices.schedulesdirect.tmsdatadirect.com/ 
schedulesdirect/tvlistings/xtvdService
            => `-'
Resolving webservices.schedulesdirect.tmsdatadirect.com... 206.18.98.175
Connecting to webservices.schedulesdirect.tmsdatadirect.com| 
206.18.98.175|:80...
connected.
HTTP request sent, awaiting response... 401 Unauthorized
Reusing existing connection to  
webservices.schedulesdirect.tmsdatadirect.com:80.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/xml]

     0K .......... .......... .......... .......... ..........    
10.46 KB/s
    50K .......... .......... .......... .......... ..........    
36.39 KB/s
   100K .......... .......... .......... .......... ..........    
37.06 KB/s
   150K .......... .......... .......... .......... ..........    
36.17 KB/s
   200K .......... .......... .......... .......... ..........    
36.39 KB/s
   250K .......... .......... .......... .......... ..........    
23.73 KB/s
   300K .......... .......... .......... .......... ..........    
27.29 KB/s
   350K .......... ........                                       
29.17 KB/s

11:11:57 (24.84 KB/s) - `-' saved [377095]

2007-10-08 11:11:58.406 DataDirect: Your subscription expires on  
06/19/08 22:54:27
2007-10-08 11:11:58.780 New DB connection, total: 3
2007-10-08 11:11:58.795 Connected to database 'mythconverg' at host:  
localhost
2007-10-08 11:11:58.820 sourceid 2 has lineup type: Cable
2007-10-08 11:11:59.073 sourceid 1 has lineup type: CableDigital
2007-10-08 11:12:39.347 Grab complete.  Actual data from Tue Oct 9  
07:00:00 2007
to Wed Oct 10 07:00:00 2007 (UTC)

<snip>

2007-10-08 11:14:43.858 Updating source #2 (Comcast Analog) with  
grabber schedulesdirect1
2007-10-08 11:14:43.889 Found 76 channels for source 2 which use grabber
2007-10-08 11:14:43.920
2007-10-08 11:14:43.953 Checking day @ offset 0, date: Mon Oct 8 2007
2007-10-08 11:14:44.213 Data is already present for Mon Oct 8 2007,  
skipping
2007-10-08 11:14:44.228
2007-10-08 11:14:44.261 Checking day @ offset 1, date: Tue Oct 9 2007
2007-10-08 11:14:44.294 Data Refresh always needed for tomorrow
2007-10-08 11:14:44.327 Refreshing data for Tue Oct 9 2007
2007-10-08 11:14:44.361 This DataDirect listings source is shared by  
2 MythTV lineups
2007-10-08 11:14:44.394 We should use cached data for this one
2007-10-08 11:14:44.452 Retrieving datadirect data.
2007-10-08 11:14:44.480 Grabbing data for Mon Oct 8 2007 offset 1
2007-10-08 11:14:44.510 From Tue Oct 9 07:00:00 2007 to Wed Oct 10  
07:00:00 2007
(UTC)
2007-10-08 11:14:44.544 Grabbing listing data
2007-10-08 11:14:44.577 DataDirect: Copying from DD cache
2007-10-08 11:14:46.252 DataDirect: Your subscription expires on  
06/19/08 22:54:27
2007-10-08 11:15:27.209 Grab complete.  Actual data from Tue Oct 9  
07:00:00 2007
to Wed Oct 10 07:00:00 2007 (UTC)