[mythtv-users] Listings problems early?
Fred Firestine
ffluvssg1 at gmail.com
Sun Jul 1 01:22:11 UTC 2007
On 6/30/07, Rich West <Rich.West at wesmo.com> wrote:
> Dewey Smolka wrote:
> > On 6/30/07, Anthony Veale <veale at fafnir.dyndns.org> wrote:
> >
> >> Hello,
> >>
> >> I'm getting an early taste of the post-zap2it labs world. After my
> >> successful mythfilldatabase run today, most of my data for tomorrow is
> >> gone and none of listings that it did load have categories for the
> >> programs. The same is true for the last day of data which was loaded
> >> today.
> >>
> >>
> >
> > I'm sort of seeing this. Categories are gone as of tomorrow. I have
> > program data through Thurs, July 12 but Fri, July 13 is empty. It
> > should have been populated today.
> >
> > I certainly hope that TMS hasn't decided to push forward their cutoff date.
>
> I was afraid that this might happen. I think that is why so much of the
> list was consumed with zap2it topics since the announcement, too..
> everyone had the general feeling that once they made the announcement,
> the service could disappear at any time. Ugh.
>
> So.. anyone have a good source for a starting point on some screen
> scraping code? I wonder if DirecTV could be convinced to export their
> programming data to their subscribers via XML...
>
> -Rich
> _______________________________________________
> mythtv-users mailing list
> mythtv-users at mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
After reading this thread, I decided to run mythfilldatabase manually.
The output is below. I run frontend and backend on the same machine,
and the frontend seems to have hung after mythfilldatabase was
complete. I rebooted the machine cleanly using ssh, restarted the
frontend, and looked at the Program Guide. I don't see anything wrong
at a glance, but maybe I am missing it? Maybe the automatic
mythfilldatabase uses different options?
Here is my mythfilldatabase output:
[root at mythtv ~]# mythfilldatabase
2007-06-30 21:04:12.934 Using runtime prefix = /usr
2007-06-30 21:04:13.263 New DB connection, total: 1
2007-06-30 21:04:13.321 Connected to database 'mythconverg' at host: localhost
2007-06-30 21:04:13.367 New DB connection, total: 2
2007-06-30 21:04:13.368 Connected to database 'mythconverg' at host: localhost
2007-06-30 21:04:15.412 Updating source #1 (Cable) with grabber datadirect
2007-06-30 21:04:15.412
2007-06-30 21:04:15.412 Checking day @ offset 0, date: Sat Jun 30 2007
2007-06-30 21:04:16.261 Data is already present for Sat Jun 30 2007, skipping
2007-06-30 21:04:16.261
2007-06-30 21:04:16.261 Checking day @ offset 1, date: Sun Jul 1 2007
2007-06-30 21:04:16.262 Refreshing data for Sun Jul 1 2007
2007-06-30 21:04:16.263 New DB DataDirect connection
2007-06-30 21:04:16.282 Connected to database 'mythconverg' at host: localhost
2007-06-30 21:04:16.324 Retrieving datadirect data.
2007-06-30 21:04:16.324 Grabbing data for Sat Jun 30 2007 offset 1
2007-06-30 21:04:16.324 From Sun Jul 1 04:00:00 2007 to Mon Jul 2
04:00:00 2007 (UTC)
2007-06-30 21:04:16.324 Grabbing listing data
--21:04:16-- http://datadirect.webservices.zap2it.com/tvlistings/xtvdService
Resolving datadirect.webservices.zap2it.com... 206.18.98.160
Connecting to datadirect.webservices.zap2it.com|206.18.98.160|:80... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Reusing existing connection to datadirect.webservices.zap2it.com:80.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/xml]
Saving to: `STDOUT'
[ <=> ] 181,709 67.1K/s in 2.6s
21:04:19 (67.1 KB/s) - `-' saved [181709]
2007-06-30 21:04:19.701 DataDirect: Your subscription expires on
09/04/2007 09:50:56 PM
2007-06-30 21:04:19.891 New DB connection, total: 3
2007-06-30 21:04:19.892 Connected to database 'mythconverg' at host: localhost
2007-06-30 21:04:19.893 sourceid 1 has lineup type: Cable
2007-06-30 21:04:35.688 Grab complete. Actual data from Sun Jul 1
04:00:00 2007 to Mon Jul 2 04:00:00 2007 (UTC)
2007-06-30 21:04:35.690 Main temp tables populated.
2007-06-30 21:04:35.691 Updating myth channels.
2007-06-30 21:04:35.780 Updating icons for sourceid: 1
2007-06-30 21:04:35.786 Channels updated.
2007-06-30 21:04:36.182 Clearing data for source.
2007-06-30 21:04:36.182 Clearing from Sun Jul 1 00:00:00 2007 to Mon
Jul 2 00:00:00 2007 (localtime)
2007-06-30 21:04:36.207 New DB connection, total: 4
2007-06-30 21:04:36.208 Connected to database 'mythconverg' at host: localhost
2007-06-30 21:05:51.119 Data for source cleared.
2007-06-30 21:05:51.119 Updating programs.
2007-06-30 21:06:16.080 Program table update complete.
2007-06-30 21:06:16.080
2007-06-30 21:06:16.080 Checking day @ offset 2, date: Mon Jul 2 2007
2007-06-30 21:06:16.350 Data is already present for Mon Jul 2 2007, skipping
2007-06-30 21:06:16.350
2007-06-30 21:06:16.350 Checking day @ offset 3, date: Tue Jul 3 2007
2007-06-30 21:06:16.700 Data is already present for Tue Jul 3 2007, skipping
2007-06-30 21:06:16.701
2007-06-30 21:06:16.701 Checking day @ offset 4, date: Wed Jul 4 2007
2007-06-30 21:06:16.953 Data is already present for Wed Jul 4 2007, skipping
2007-06-30 21:06:16.953
2007-06-30 21:06:16.953 Checking day @ offset 5, date: Thu Jul 5 2007
2007-06-30 21:06:17.207 Data is already present for Thu Jul 5 2007, skipping
2007-06-30 21:06:17.207
2007-06-30 21:06:17.207 Checking day @ offset 6, date: Fri Jul 6 2007
2007-06-30 21:06:17.474 Data is already present for Fri Jul 6 2007, skipping
2007-06-30 21:06:17.474
2007-06-30 21:06:17.475 Checking day @ offset 7, date: Sat Jul 7 2007
2007-06-30 21:06:17.775 Data is already present for Sat Jul 7 2007, skipping
2007-06-30 21:06:17.776
2007-06-30 21:06:17.776 Checking day @ offset 8, date: Sun Jul 8 2007
2007-06-30 21:06:18.052 Data is already present for Sun Jul 8 2007, skipping
2007-06-30 21:06:18.052
2007-06-30 21:06:18.052 Checking day @ offset 9, date: Mon Jul 9 2007
2007-06-30 21:06:18.307 Data is already present for Mon Jul 9 2007, skipping
2007-06-30 21:06:18.308
2007-06-30 21:06:18.308 Checking day @ offset 10, date: Tue Jul 10 2007
2007-06-30 21:06:18.554 Data is already present for Tue Jul 10 2007, skipping
2007-06-30 21:06:18.554
2007-06-30 21:06:18.554 Checking day @ offset 11, date: Wed Jul 11 2007
2007-06-30 21:06:18.813 Data is already present for Wed Jul 11 2007, skipping
2007-06-30 21:06:18.813
2007-06-30 21:06:18.814 Checking day @ offset 12, date: Thu Jul 12 2007
2007-06-30 21:06:19.071 Data is already present for Thu Jul 12 2007, skipping
2007-06-30 21:06:19.071
2007-06-30 21:06:19.071 Checking day @ offset 13, date: Fri Jul 13 2007
2007-06-30 21:06:19.354 Data refresh needed because no data exists for
day @ offset 13 from 6PM - midnight.
2007-06-30 21:06:19.354 Refreshing data for Fri Jul 13 2007
2007-06-30 21:06:19.869 Retrieving datadirect data.
2007-06-30 21:06:19.870 Grabbing data for Sat Jun 30 2007 offset 13
2007-06-30 21:06:19.870 From Fri Jul 13 04:00:00 2007 to Sat Jul 14
04:00:00 2007 (UTC)
2007-06-30 21:06:19.870 Grabbing listing data
--21:06:20-- http://datadirect.webservices.zap2it.com/tvlistings/xtvdService
Resolving datadirect.webservices.zap2it.com... 206.18.98.160
Connecting to datadirect.webservices.zap2it.com|206.18.98.160|:80... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Reusing existing connection to datadirect.webservices.zap2it.com:80.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/xml]
Saving to: `STDOUT'
[ <=> ] 196,683 53.2K/s in 3.6s
21:06:24 (53.2 KB/s) - `-' saved [196683]
2007-06-30 21:06:25.023 DataDirect: Your subscription expires on
09/04/2007 09:50:56 PM
2007-06-30 21:06:42.903 Grab complete. Actual data from Fri Jul 13
04:00:00 2007 to Sat Jul 14 04:00:00 2007 (UTC)
2007-06-30 21:06:42.905 Main temp tables populated.
2007-06-30 21:06:43.242 Clearing data for source.
2007-06-30 21:06:43.243 Clearing from Fri Jul 13 00:00:00 2007 to Sat
Jul 14 00:00:00 2007 (localtime)
2007-06-30 21:06:45.338 Data for source cleared.
2007-06-30 21:06:45.338 Updating programs.
2007-06-30 21:07:14.716 Program table update complete.
2007-06-30 21:07:36.585 New DB connection, total: 5
2007-06-30 21:07:36.623 Connected to database 'mythconverg' at host: localhost
2007-06-30 21:07:36.974 Data fetching complete.
2007-06-30 21:07:36.974 Adjusting program database end times.
2007-06-30 21:07:41.617 0 replacements made
2007-06-30 21:07:41.617 Marking generic episodes.
2007-06-30 21:07:52.752 Found 1297
2007-06-30 21:07:52.753 Marking repeats.
2007-06-30 21:07:54.310 Found 2803
2007-06-30 21:07:54.310 Unmarking new episode rebroadcast repeats.
2007-06-30 21:07:55.648 Found 12
2007-06-30 21:07:58.866 Marking episode first showings.
2007-06-30 21:08:43.902 Found 13373
2007-06-30 21:08:43.902 Marking episode last showings.
2007-06-30 21:09:23.826 Found 13373
2007-06-30 21:09:24.892 Grabbing next suggested grabbing time
2007-06-30 21:09:26.062 DataDirect: BlockedTime is: 2007-06-30T21:09:26
2007-06-30 21:09:26.063 DataDirect: NextSuggestedTime is: 2007-07-01T11:17:15
2007-06-30 21:09:26.171
===============================================================
| Attempting to contact the master backend for rescheduling. |
| If the master is not running, rescheduling will happen when |
| the master backend is restarted. |
===============================================================
2007-06-30 21:09:26.237 Connecting to backend server: 172.23.3.67:6543
(try 1 of 5)
2007-06-30 21:09:26.396 Using protocol version 31
2007-06-30 21:09:27.353 mythfilldatabase run complete.
[root at mythtv ~]#
More information about the mythtv-users
mailing list