[mythtv-users] Mythfilldatabase is REALLY slow.

linux guy linuxguy123 at gmail.com
Sat Oct 8 21:13:22 UTC 2011


Thanks for the tip.  Doing a --dd-grab-all was much faster.

Here is what # mythfilldatabase --help says about it.

-dd-grab-all
   The DataDirect grabber will grab all available data
   in a single pull. This will ensure you always have
   the most up-to-date data, but requires significantly
   more CPU and RAM. It is not expected to work on all
   backend systems and with all lineups, and may
   interfere with recording due to resource starvation.

# mythfilldatabase --dd-grab-all
2011-10-08 14:53:18.850 Using runtime prefix = /usr
2011-10-08 14:53:18.850 Using configuration directory = /root/.mythtv
2011-10-08 14:53:18.851 Empty LocalHostName.
2011-10-08 14:53:18.851 Using localhost value of server.localdomain
2011-10-08 14:53:18.873 New DB connection, total: 1
2011-10-08 14:53:18.877 Connected to database 'mythconverg' at host:
127.0.0.1
2011-10-08 14:53:18.881 Closing DB connection named 'DBManager0'
2011-10-08 14:53:18.881 Connected to database 'mythconverg' at host:
127.0.0.1
2011-10-08 14:53:18.883 Current locale en_CA
2011-10-08 14:53:18.883 Reading locale defaults from
/usr/share/mythtv//locales/en_ca.xml
2011-10-08 14:53:18.892 Loading en_ca translation for module mythfrontend
2011-10-08 14:53:18.894 Current MythTV Schema Version (DBSchemaVer): 1264
2011-10-08 14:53:18.896 New DB connection, total: 2
2011-10-08 14:53:18.897 Connected to database 'mythconverg' at host:
127.0.0.1
2011-10-08 14:53:19.022 Updating source #1 (Receiver1) with grabber
schedulesdirect1
2011-10-08 14:53:19.023 Found 539 channels for source 1 which use grabber
2011-10-08 14:53:19.023 New DB DataDirect connection
2011-10-08 14:53:19.024 Connected to database 'mythconverg' at host:
127.0.0.1
2011-10-08 14:53:19.150 Retrieving datadirect data.
2011-10-08 14:53:19.150 Grabbing ALL available data.
2011-10-08 14:53:19.150 Grabbing listing data
--2011-10-08 14:53:19--
http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService
Resolving webservices.schedulesdirect.tmsdatadirect.com... 144.142.232.53
Connecting to webservices.schedulesdirect.tmsdatadirect.com|144.142.232.53|:80...
connected.
HTTP request sent, awaiting response... 401 Unauthorized
Connecting to webservices.schedulesdirect.tmsdatadirect.com|144.142.232.53|:80...
connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/xml]
Saving to: “STDOUT”

    [
<=>
] 43,513       211K/s              2011-10-08 14:53:23.077 DataDirect,
Error: DataDirect XML failed to properly parse, downloaded listings were
probably corrupt.
    [
<=>
] 56,653      16.3K/s
gzip: stdout: Broken pipe
    [
<=>
] 68,333      19.3K/s   in 3.5s


Cannot write to “-” (Broken pipe).
2011-10-08 14:53:25.936 Encountered error in grabbing data.
2011-10-08 14:53:26.062 Failed to fetch some program info
2011-10-08 14:53:26.063 Adjusting program database end times.
2011-10-08 14:53:26.663     0 replacements made
2011-10-08 14:53:26.663 Marking generic episodes.
2011-10-08 14:53:27.023     Found 22323
2011-10-08 14:53:27.023 Fudging non-unique programids with multiple parts.
2011-10-08 14:53:27.140     SH014444700000 -> SH014444700201 (part 1 of 2)
2011-10-08 14:53:27.423     SH014444700000 -> SH014444700202 (part 2 of 2)
2011-10-08 14:53:27.622     MV002758420000 -> MV002758420201 (part 1 of 2)
2011-10-08 14:53:27.665     SH014734270000 -> SH014734270202 (part 2 of 2)
2011-10-08 14:53:27.690     SH014758280000 -> SH014758280603 (part 3 of 6)
2011-10-08 14:53:27.715     SH014737160000 -> SH014737160201 (part 1 of 2)
2011-10-08 14:53:27.740     SH014737160000 -> SH014737160202 (part 2 of 2)
2011-10-08 14:53:27.766     SH010742360000 -> SH010742360202 (part 2 of 2)
2011-10-08 14:53:27.791     MV003717030000 -> MV003717030202 (part 2 of 2)
2011-10-08 14:53:27.816     SH014759620000 -> SH014759620202 (part 2 of 2)
2011-10-08 14:53:27.841     SH014113490000 -> SH014113490202 (part 2 of 2)
2011-10-08 14:53:27.866     Found 24
2011-10-08 14:53:27.866 Marking repeats.
2011-10-08 14:53:31.674     Found 34553
2011-10-08 14:53:31.674 Unmarking new episode rebroadcast repeats.
2011-10-08 14:53:31.816     Found 0
2011-10-08 14:53:34.472 Marking episode first showings.

2011-10-08 15:00:21.366     Found 12054
2011-10-08 15:00:21.366 Marking episode last showings.
2011-10-08 15:07:10.149     Found 12054
2011-10-08 15:07:10.250 Grabbing next suggested grabbing time
2011-10-08 15:07:10.765 DataDirect: BlockedTime is: 2011-10-08T15:07:10
2011-10-08 15:07:10.765 DataDirect: NextSuggestedTime is:
2011-10-09T06:00:04
2011-10-08 15:07:10.816
===============================================================
| Attempting to contact the master backend for rescheduling.  |
| If the master is not running, rescheduling will happen when |
| the master backend is restarted.                            |
===============================================================
2011-10-08 15:07:10.821 MythCoreContext: Connecting to backend server:
192.168.1.13:6543 (try 1 of 1)
2011-10-08 15:07:31.861 Connection to master server timed out.
                        Either the server is down or the master server
settings
                        in mythtv-settings does not contain the proper IP
address

2011-10-08 15:07:31.861 Error rescheduling id -1 in
ScheduledRecording::signalChange
2011-10-08 15:07:31.861 MythCoreContext: Connecting to backend server:
192.168.1.13:6543 (try 1 of 1)
2011-10-08 15:07:31.861 Connection to master server timed out.
                        Either the server is down or the master server
settings
                        in mythtv-settings does not contain the proper IP
address

2011-10-08 15:07:31.861 MythCoreContext: Connecting to backend server:
192.168.1.13:6543 (try 1 of 1)
2011-10-08 15:07:31.861 Connection to master server timed out.
                        Either the server is down or the master server
settings
                        in mythtv-settings does not contain the proper IP
address

2011-10-08 15:07:32.862 mythfilldatabase run complete.
2011-10-08 15:07:32.863 DataDirect: Deleting temporary files

(I shut down the backend while I filled the database.  Next time I won't.)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.mythtv.org/pipermail/mythtv-users/attachments/20111008/7b52fd6a/attachment-0001.html 


More information about the mythtv-users mailing list