[mythtv-users] slow mythfilldatabase

[Bill Meek]

On 1/6/21 2:50 AM, Stephen Worthington wrote:
> On Tue, 5 Jan 2021 22:03:16 -0800, you wrote:
> 
>> MythTV Version : v31.0-v31.0 on Ubuntu 20 LTS, mysql 8.0.22
>>
>> Greetings. After upgrading from Ubuntu 18 LTS to 20 LTS,
>> mythfilldatabase takes 45-60 minutes to run, sometimes more. It
>> previously took less than three minutes, and the system didn't have this
>> problem when upgrading from Ubuntu 16 LTS to 18 LTS.
> 
> Where do you get your EPG data from?  Previous reports of similar
> problems turned out to be caused by getting a huge data set from
> Schedules Direct - all of the EPG rather than just the new data.  As I
> understand it (not being a Schedules Direct user), you are supposed to
> only get the full EPG data on the first download, and then after that
> limit how much you get to only the new data or maybe only one week of
> data.  If you have recently changed to Schedules Direct or to the new
> way of downloading the Schedules Direct data, that might be your
> problem.

@dn, please mention that you completed the XMLTV conversion and that exactly one
copy of the data exists. Here's the SQLite example, which should be similar to
the other method:

  https://forum.mythtv.org/viewtopic.php?f=36&t=3480&start=15#p19508

With an up-to-date* MythTV version, you can get more info by running
mythfilldatabase -v xmltv. Do that for the backend by using: mythbackend --setverbose xmltv
and waiting for the backend to run MFDB or just running: mythfilldatabase -v xmltv
from the command line *as user mythtv*.

*I don't remember when the commit went in that improves the MFDB/XMLTV logging,
but if you do this,  you'll get it:

  sudo add-apt-repository ppa:mythbuntu/31
  sudo apt update
  sudo apt dist-upgrade

Also, verify that this exists (should have been installed automatically):

$ cat /etc/mysql/conf.d/mythconverg.cnf
# Disable Binary logging for the mythconverg database. Binary logging
# for all databases was off by default prior to MySQL V8.
[mysqld]
binlog-ignore-db=mythconverg

If it doesn't, add it and restart the DB. I'd stop the backend first.

FYI, I don't use any of the innodb_... or log_... changes in my .cnf file.

-- 
Bill