[mythtv-users] Cant add channel linup on fresh installs
Krys Allen
allen.krys at gmail.com
Fri Oct 12 16:45:13 UTC 2012
On Fri, Oct 12, 2012 at 6:15 AM, Ronald Frazier <ron at ronfrazier.net> wrote:
> On Fri, Oct 12, 2012 at 1:27 AM, Chris Pinkham <cpinkham at bc2va.org> wrote:
> > * On Thu Oct 11, 2012 at 10:39:08PM -0400, Ronald Frazier wrote:
> >> 2012-10-11 22:02:42.595376 D DownloadManager: downloadProgress:
> >>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> >> to is at 53402 of -1 bytes downloaded
> >
> >> 2012-10-11 22:02:52.596673 D DownloadManager: Aborting download -
> >> lack of data transfer
> >
> >> You can see at 2012-10-11 22:02:52.596673 it seems to time out and
> >> abort. I will say that Krys seems to have 3 lineups that are all (at
> >> least to me) quite large in number of channels. Not sure if that has
> >> anything to do with it (maybe SD is taking longer to process some of
> >> the data or something.
> >
> > This is due to the 10-second idle timeout in mythdownloadmanager.cpp.
> >
> > I'm curious how long this is taking to see if it makes sense to bump the
> > timeout up or if we're going to allow specifying a timeout per download
> > to allow Schedules Direct / TMS downloads to take longer.
> >
> > If you compile from source, can you try something?
> >
> > Edit libs/libmythbase/mythdownloadmanager.cpp and look around line 816
> for this:
> >
> > (dlInfo->m_lastStat.secsTo(MythDate::current()) < 10)) ||
> >
> > Change that 10 to a 15 and try again. If that doesn't work, bump it up
> to 20
> > and try again, seeing how high you have to go to get it to work. Also,
> how
> > many channels are we talking about?
>
>
> I didn't have time this morning to give it multiple tries, so I just
> bumped it right to 120 seconds and it worked. The logs are below. It
> looks like we had about a 45 second pause. As for the reason why, I
> haven't looked at the SD output in a few years, but isn't it broken
> into multiple sections...like <list of channels><list of
> programs><list of descriptions><list of actors> or something? My guess
> is that their system streams each section as it is generated and there
> is a large pause at the beginning of generating one of the sections.
>
>
>
> 2012-10-12 07:04:03.349695 D MythSocketThread: Got data on select
> 2012-10-12 07:04:03.349715 D MythSocketThread: Processing ready reads
> 2012-10-12 07:04:03.349744 D MythSocketThread(sock
> 0x7fd8a000f860:64): socket is readable
> 2012-10-12 07:04:03.349759 D MythSocketThread(sock
> 0x7fd8a000f860:64): calling m_cb->readyRead()
> 2012-10-12 07:04:03.349787 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8a00bad48, 8) called
> 2012-10-12 07:04:03.349815 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8a09dde38, 82) called
> 2012-10-12 07:04:03.349847 I MythSocket(7fd8a000f860:64): read <- 64
> 82 BACKEND_MESSAGE[]:[]UPDATE_FILE_SIZE 6259 2012-10-12T10:52:38
> 1346305036[]:[]empty
> 2012-10-12 07:04:03.349870 I MythEvent: UPDATE_FILE_SIZE 6259
> 2012-10-12T10:52:38 1346305036
> 2012-10-12 07:04:03.349907 D MythSocketThread: Total read time: 0ms,
> on sockets {64,0ms}
> 2012-10-12 07:04:03.349919 D MythSocketThread: Reacquired ready read lock
> 2012-10-12 07:04:03.349948 D MythSocketThread: ProcessAddRemoveQueues
> 2012-10-12 07:04:03.349953 D MythSocketThread: Construct FD_SET
> 2012-10-12 07:04:03.349961 D MythSocketThread: Waiting on select..
> 2012-10-12 07:04:07.562482 I Fetching lineups from Schedules Direct...
> 2012-10-12 07:04:07.609753 I DataDirect: Grabbing channel data
> 2012-10-12 07:04:07.609839 I Downloading DataDirect feed
> 2012-10-12 07:04:07.670611 D DownloadManager:
> postAuth('
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> ',
> '140735795771536')
> 2012-10-12 07:04:07.671622 D Checking cache for
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> 2012-10-12 07:04:08.476154 D Calling auth callback
> 2012-10-12 07:04:08.476172 D DataDirect auth callback
> 2012-10-12 07:04:10.278472 D DownloadManager: downloadProgress(10,
> -1) (for reply 22743888)
> 2012-10-12 07:04:10.278518 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 10 of -1 bytes downloaded
> 2012-10-12 07:04:11.279312 D DownloadManager: downloadProgress(25520,
> -1) (for reply 22743888)
> 2012-10-12 07:04:11.279340 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 25520 of -1 bytes downloaded
> 2012-10-12 07:04:11.679727 D DownloadManager: downloadProgress(34280,
> -1) (for reply 22743888)
> 2012-10-12 07:04:11.679775 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 34280 of -1 bytes downloaded
> 2012-10-12 07:04:11.880015 D DownloadManager: downloadProgress(53402,
> -1) (for reply 22743888)
> 2012-10-12 07:04:11.880045 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 53402 of -1 bytes downloaded
> 2012-10-12 07:04:13.353145 D MythSocketThread: Got data on select
> 2012-10-12 07:04:13.353158 D MythSocketThread: Processing ready reads
> 2012-10-12 07:04:13.353183 D MythSocketThread(sock
> 0x7fd8a000f860:64): socket is readable
> 2012-10-12 07:04:13.353196 D MythSocketThread(sock
> 0x7fd8a000f860:64): calling m_cb->readyRead()
> 2012-10-12 07:04:13.353219 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac2d0828, 8) called
> 2012-10-12 07:04:13.353240 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac0a6e68, 82) called
> 2012-10-12 07:04:13.353262 I MythSocket(7fd8a000f860:64): read <- 64
> 82 BACKEND_MESSAGE[]:[]UPDATE_FILE_SIZE 6259 2012-10-12T10:52:38
> 1365753448[]:[]empty
> 2012-10-12 07:04:13.353280 I MythEvent: UPDATE_FILE_SIZE 6259
> 2012-10-12T10:52:38 1365753448
> 2012-10-12 07:04:13.353304 D MythSocketThread: Total read time: 0ms,
> on sockets {64,0ms}
> 2012-10-12 07:04:13.353310 D MythSocketThread: Reacquired ready read lock
> 2012-10-12 07:04:13.353315 D MythSocketThread: ProcessAddRemoveQueues
> 2012-10-12 07:04:13.353319 D MythSocketThread: Construct FD_SET
> 2012-10-12 07:04:13.353326 D MythSocketThread: Waiting on select..
> 2012-10-12 07:04:23.358183 D MythSocketThread: Got data on select
> 2012-10-12 07:04:23.358202 D MythSocketThread: Processing ready reads
> 2012-10-12 07:04:23.358255 D MythSocketThread(sock
> 0x7fd8a000f860:64): socket is readable
> 2012-10-12 07:04:23.358268 D MythSocketThread(sock
> 0x7fd8a000f860:64): calling m_cb->readyRead()
> 2012-10-12 07:04:23.358292 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac3b2668, 8) called
> 2012-10-12 07:04:23.358313 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac0a6e68, 82) called
> 2012-10-12 07:04:23.358334 I MythSocket(7fd8a000f860:64): read <- 64
> 82 BACKEND_MESSAGE[]:[]UPDATE_FILE_SIZE 6259 2012-10-12T10:52:38
> 1384674708[]:[]empty
> 2012-10-12 07:04:23.358351 I MythEvent: UPDATE_FILE_SIZE 6259
> 2012-10-12T10:52:38 1384674708
> 2012-10-12 07:04:23.358379 D MythSocketThread: Total read time: 0ms,
> on sockets {64,0ms}
> 2012-10-12 07:04:23.358384 D MythSocketThread: Reacquired ready read lock
> 2012-10-12 07:04:23.358390 D MythSocketThread: ProcessAddRemoveQueues
> 2012-10-12 07:04:23.358393 D MythSocketThread: Construct FD_SET
> 2012-10-12 07:04:23.358400 D MythSocketThread: Waiting on select..
> 2012-10-12 07:04:33.363553 D MythSocketThread: Got data on select
> 2012-10-12 07:04:33.363572 D MythSocketThread: Processing ready reads
> 2012-10-12 07:04:33.363596 D MythSocketThread(sock
> 0x7fd8a000f860:64): socket is readable
> 2012-10-12 07:04:33.363626 D MythSocketThread(sock
> 0x7fd8a000f860:64): calling m_cb->readyRead()
> 2012-10-12 07:04:33.363651 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac3b2668, 8) called
> 2012-10-12 07:04:33.363672 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac0a6e68, 82) called
> 2012-10-12 07:04:33.363694 I MythSocket(7fd8a000f860:64): read <- 64
> 82 BACKEND_MESSAGE[]:[]UPDATE_FILE_SIZE 6259 2012-10-12T10:52:38
> 1402962784[]:[]empty
> 2012-10-12 07:04:33.363712 I MythEvent: UPDATE_FILE_SIZE 6259
> 2012-10-12T10:52:38 1402962784
> 2012-10-12 07:04:33.363737 D MythSocketThread: Total read time: 0ms,
> on sockets {64,0ms}
> 2012-10-12 07:04:33.363743 D MythSocketThread: Reacquired ready read lock
> 2012-10-12 07:04:33.363749 D MythSocketThread: ProcessAddRemoveQueues
> 2012-10-12 07:04:33.363756 D MythSocketThread: Construct FD_SET
> 2012-10-12 07:04:33.363763 D MythSocketThread: Waiting on select..
> 2012-10-12 07:04:43.368358 D MythSocketThread: Got data on select
> 2012-10-12 07:04:43.368371 D MythSocketThread: Processing ready reads
> 2012-10-12 07:04:43.368393 D MythSocketThread(sock
> 0x7fd8a000f860:64): socket is readable
> 2012-10-12 07:04:43.368405 D MythSocketThread(sock
> 0x7fd8a000f860:64): calling m_cb->readyRead()
> 2012-10-12 07:04:43.368446 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac39f128, 8) called
> 2012-10-12 07:04:43.368470 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac6eb098, 82) called
> 2012-10-12 07:04:43.368491 I MythSocket(7fd8a000f860:64): read <- 64
> 82 BACKEND_MESSAGE[]:[]UPDATE_FILE_SIZE 6259 2012-10-12T10:52:38
> 1422676840[]:[]empty
> 2012-10-12 07:04:43.368509 I MythEvent: UPDATE_FILE_SIZE 6259
> 2012-10-12T10:52:38 1422676840
> 2012-10-12 07:04:43.368533 D MythSocketThread: Total read time: 0ms,
> on sockets {64,0ms}
> 2012-10-12 07:04:43.368538 D MythSocketThread: Reacquired ready read lock
> 2012-10-12 07:04:43.368544 D MythSocketThread: ProcessAddRemoveQueues
> 2012-10-12 07:04:43.368549 D MythSocketThread: Construct FD_SET
> 2012-10-12 07:04:43.368556 D MythSocketThread: Waiting on select..
> 2012-10-12 07:04:53.373195 D MythSocketThread: Got data on select
> 2012-10-12 07:04:53.373209 D MythSocketThread: Processing ready reads
> 2012-10-12 07:04:53.373231 D MythSocketThread(sock
> 0x7fd8a000f860:64): socket is readable
> 2012-10-12 07:04:53.373242 D MythSocketThread(sock
> 0x7fd8a000f860:64): calling m_cb->readyRead()
> 2012-10-12 07:04:53.373266 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac1d9c38, 8) called
> 2012-10-12 07:04:53.373286 D MythSocket(7fd8a000f860:64):
> readBlock(0x7fd8ac07f758, 82) called
> 2012-10-12 07:04:53.373306 I MythSocket(7fd8a000f860:64): read <- 64
> 82 BACKEND_MESSAGE[]:[]UPDATE_FILE_SIZE 6259 2012-10-12T10:52:38
> 1442569308[]:[]empty
> 2012-10-12 07:04:53.373324 I MythEvent: UPDATE_FILE_SIZE 6259
> 2012-10-12T10:52:38 1442569308
> 2012-10-12 07:04:53.373384 D MythSocketThread: Total read time: 0ms,
> on sockets {64,0ms}
> 2012-10-12 07:04:53.373392 D MythSocketThread: Reacquired ready read lock
> 2012-10-12 07:04:53.373398 D MythSocketThread: ProcessAddRemoveQueues
> 2012-10-12 07:04:53.373402 D MythSocketThread: Construct FD_SET
> 2012-10-12 07:04:53.373409 D MythSocketThread: Waiting on select..
> 2012-10-12 07:04:56.506536 D DownloadManager: downloadProgress(82416,
> -1) (for reply 22743888)
> 2012-10-12 07:04:56.506565 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 82416 of -1 bytes downloaded
> 2012-10-12 07:04:56.906929 D DownloadManager: downloadProgress(91176,
> -1) (for reply 22743888)
> 2012-10-12 07:04:56.906959 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 91176 of -1 bytes downloaded
> 2012-10-12 07:04:57.107181 D DownloadManager:
> downloadProgress(109308, -1) (for reply 22743888)
> 2012-10-12 07:04:57.107210 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 109308 of -1 bytes downloaded
> 2012-10-12 07:04:57.707630 D DownloadManager:
> downloadProgress(118068, -1) (for reply 22743888)
> 2012-10-12 07:04:57.707676 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 118068 of -1 bytes downloaded
> 2012-10-12 07:04:57.907954 D DownloadManager:
> downloadProgress(135636, -1) (for reply 22743888)
> 2012-10-12 07:04:57.907990 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 135636 of -1 bytes downloaded
> 2012-10-12 07:04:59.308945 D DownloadManager:
> downloadProgress(169890, -1) (for reply 22743888)
> 2012-10-12 07:04:59.308991 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 169890 of -1 bytes downloaded
> 2012-10-12 07:04:59.709494 D DownloadManager:
> downloadProgress(169890, 169890) (for reply 22743888)
> 2012-10-12 07:04:59.709520 D DownloadManager: downloadProgress:
>
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> to is at 169890 of 169890 bytes downloaded
> 2012-10-12 07:04:59.709554 D DownloadManager: downloadFinished(22743888)
> 2012-10-12 07:04:59.709585 D DownloadManager: redirectUrl()
> 2012-10-12 07:04:59.709603 D downloadFinished(140568576492288):
> COMPLETE:
> http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
> 2012-10-12 07:04:59.710171 I Downloaded 169890 bytes
>
>
>
> --
> Ron Frazier
> _______________________________________________
> mythtv-users mailing list
> mythtv-users at mythtv.org
> http://www.mythtv.org/mailman/listinfo/mythtv-users
>
I didn't have time to get real scientific, however I added and removed
channels manually from my lineup to try and see where the breaking point
was. It turns out that its real flaky and I don't know that there is a set
amount of channels that causes it to fail. One thing I did find was that if
I tried to create a new source with all of my channels it would fail, but
if I go into SD and remove most of my channels then the fetch would work.
Where it gets interesting is I can then go back to SD and add all of my
channels back in and the fetch would still work as long as I don't exit out
of the source screen.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mythtv.org/pipermail/mythtv-users/attachments/20121012/a4537afd/attachment-0001.html>
More information about the mythtv-users
mailing list