[mythtv-users] SchedulesDirect timing out during Mythfilldatabase

Sat Apr 16 18:50:09 UTC 2011

I've had a problem crop up where program listing information wasn't
showing up on my mythbox.  I ran mythfilldatabase from the command
line and the issue seems to be timeouts during the download from
Schedules Direct.

It starts off like this:

[root at mythbox ~]# mythfilldatabase
2011-04-16 11:33:13.524 Using runtime prefix = /usr
2011-04-16 11:33:13.524 Using configuration directory = /root/.mythtv
2011-04-16 11:33:13.525 Unable to read configuration file mysql.txt
2011-04-16 11:33:13.525 Empty LocalHostName.
2011-04-16 11:33:13.525 Using localhost value of mythbox
2011-04-16 11:33:13.537 New DB connection, total: 1
2011-04-16 11:33:13.542 Connected to database 'mythconverg' at host: localhost
2011-04-16 11:33:13.554 Closing DB connection named 'DBManager0'
2011-04-16 11:33:13.555 Connected to database 'mythconverg' at host: localhost
2011-04-16 11:33:13.558 Current locale EN_US
2011-04-16 11:33:13.558 Reading locale defaults from
/usr/share/mythtv//locales/en_us.xml
2011-04-16 11:33:13.578 Loading en_us translation for module mythfrontend
2011-04-16 11:33:13.582 Current MythTV Schema Version (DBSchemaVer): 1264
2011-04-16 11:33:13.587 New DB connection, total: 2
2011-04-16 11:33:13.588 Connected to database 'mythconverg' at host: localhost
2011-04-16 11:33:14.787 Updating source #1 (Zap2It) with grabber
schedulesdirect1
2011-04-16 11:33:14.790 Found 510 channels for source 1 which use grabber
2011-04-16 11:33:14.790
2011-04-16 11:33:14.790 Checking day @ offset 0, date: Sat Apr 16 2011
2011-04-16 11:33:15.711 Data refresh needed because only 0 out of 510
channels have at least one program listed for day @ offset 0 from 8PM
- midnight.  Previous day had 411 channels with data in that time
period.
2011-04-16 11:33:15.711 Refreshing data for Sat Apr 16 2011
2011-04-16 11:33:15.711 New DB DataDirect connection
2011-04-16 11:33:15.712 Connected to database 'mythconverg' at host: localhost
2011-04-16 11:33:15.713 Retrieving datadirect data.
2011-04-16 11:33:15.713 Grabbing data for Sat Apr 16 2011 offset 0
2011-04-16 11:33:15.714 From Sat Apr 16 06:00:00 2011 to Sun Apr 17
06:00:00 2011 (UTC)
2011-04-16 11:33:15.714 Grabbing listing data
--2011-04-16 11:33:15--
http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
Resolving webservices.schedulesdirect.tmsdatadirect.com... 144.142.232.53
Connecting to webservices.schedulesdirect.tmsdatadirect.com|144.142.232.53|:80...
connected.
HTTP request sent, awaiting response... 401 Unauthorized
Connecting to webservices.schedulesdirect.tmsdatadirect.com|144.142.232.53|:80...
connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/xml]
Saving to: “STDOUT”

The first two files seem to download OK.  Not fast, but at rates that
are sufficient.

    [     <=>     ] 54,394      14.5K/s
2011-04-16 11:33:21.142 New DB connection, total: 3
2011-04-16 11:33:21.143 Connected to database 'mythconverg' at host: localhost

2011-04-16 11:33:21.146 DataDirect: Your subscription expires on Sun
Jun 19 11:16 PM
    [     <=>     ] 62,892      11.5K/s

Then things get ugly.  The third file starts out slow...

2011-04-16 11:33:46.573 sourceid 1 has lineup type: Satellite
    [     <=>     ] 96,796      1.19K/s

And then gets slower yet...
2011-04-16 11:33:46.573 sourceid 1 has lineup type: Satellite
    [     <=>     ] 145,948      666B/s

And then gets so slow that wget doesn't even calculate the rate
2011-04-16 11:33:46.573 sourceid 1 has lineup type: Satellite
    [     <=>     ] 199,558     --.-K/s

Usually I get timeouts like this:

2011-04-16 12:22:41.721 sourceid 1 has lineup type: Satellite
    [     <=>     ] 199,558     --.-K/s   in 20m 15s

2011-04-16 12:42:27 (164 B/s) - Read error at byte 199558 (Connection
timed out).Retrying.

--2011-04-16 12:42:28--  (try: 2)
http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService

Here is what else I know.  Accessing the site below on a separate
computer is fast:
webservices.schedulesdirect.tmsdatadirect.com

But if I go here:
http://webservices.schedulesdirect.tmsdatadirect.com/document.jsp
and select Schedules Direct customer and give my user name and
password, it goes to get a file but is again extremely slow.

Other details
- wget to other sites maxes out my internet connection, so that isn't it
- I'm from Canada
- I have dd-wrt on my wireless router.  No weird firewall rules or
anything like that are set up.
- It worked fine a few months ago.  I haven't touched my router in that time.

No sign of a similar problem that I could see on the SD forums, and I
didn't see a spot on the SD site where I could raise an issue that
wasn't lineup related.

Ideas?  Any help would be appreciated.  Thanks in advance.