[mythtv-users] Duplicate detection not working for some recordings

Peter Bennett pb.mythtv at gmail.com
Sun Jan 10 17:11:32 UTC 2021


On 1/10/21 11:58 AM, Philipp Hahn wrote:
> Hello,
>
> I'm trying to understand why MythTV plans to re-record an episode I 
> still have.
>
> I've read <https://www.mythtv.org/wiki/Duplicate_matching> but I 
> cannot figure it out myself. (I live in Germany and I'm using 
> 'tv_grab_eu_epgdata' as my listing provider, so no "programid"):
>
>
> This is my recording rule, which should record every showing, but 
> skips duplicates based on "subtitle" only:
>
>> MariaDB [mythconverg]> SELECT * FROM record WHERE title='Hawaii Five-0';
>> +----------+------+--------+-----------+------------+----------+------------+---------------+-----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+---------+-------------+------------+-------------+-----------+-------------+-----------+----------+-----------+-------+------------+-----------+-----------+-----------------+--------+---------------+--------------+--------------+--------------+--------------+--------------+--------------+---------+----------+--------+----------+----------+------------+-----------+-----------+---------------------+---------------------+---------------------+--------------+-----------+--------+------------+ 
>>
>> | recordid | type | chanid | starttime | startdate  | endtime  | 
>> enddate    | title         | subtitle  | description | season | 
>> episode | category | profile | recpriority | autoexpire | maxepisodes 
>> | maxnewest | startoffset | endoffset | recgroup | dupmethod | dupin 
>> | station    | seriesid  | programid | inetref         | search | 
>> autotranscode | autocommflag | autouserjob1 | autouserjob2 | 
>> autouserjob3 | autouserjob4 | autometadata | findday | findtime | 
>> findid | inactive | parentid | transcoder | playgroup | prefinput | 
>> next_record         | last_record         | last_delete | 
>> storagegroup | avg_delay | filter | recgroupid |
>> +----------+------+--------+-----------+------------+----------+------------+---------------+-----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+---------+-------------+------------+-------------+-----------+-------------+-----------+----------+-----------+-------+------------+-----------+-----------+-----------------+--------+---------------+--------------+--------------+--------------+--------------+--------------+--------------+---------+----------+--------+----------+----------+------------+-----------+-----------+---------------------+---------------------+---------------------+--------------+-----------+--------+------------+ 
>>
>> |       85 |    4 |  55622 | 20:15:00  | 2021-01-09 | 21:15:00 | 
>> 2021-01-09 | Hawaii Five-0 | Quinn Liu | Dem Exmarineoffizier Steve 
>> McGarrett wird von der Gouverneurin von Hawaii die Leitung einer 
>> Sondereinheit zur Bekämpfung des organisierten Verbrechens auf Hawaii 
>> übertragen. Dafür nimmt er den ehemaligen Polizisten Chin Ho Kelly, 
>> den Polizisten Danny "Danno" Williams und die junge Polizistin Kona 
>> "Kono" Kalakaua in sein Team auf.    | 10 |       1 | Action   | 
>> Default |           0 |          0 |           0 |         0 
>> |           0 |         0 | US Crime |         2 |     2 | kabel eins 
>> | 173914608 |           | ttvdb.py_164541 |      0 |             0 
>> |            1 |            0 |            0 |            0 
>> |            0 |            1 |       1 | 22:10:00 | 738164 |        
>> 0 | 0 |          0 | Default   |         0 | 2021-01-16 19:15:00 | 
>> 2021-01-09 20:13:01 | 2021-01-08 18:08:27 | Crime        | 183 |      
>> 0 |          5 |
>> +----------+------+--------+-----------+------------+----------+------------+---------------+-----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+---------+-------------+------------+-------------+-----------+-------------+-----------+----------+-----------+-------+------------+-----------+-----------+-----------------+--------+---------------+--------------+--------------+--------------+--------------+--------------+--------------+---------+----------+--------+----------+----------+------------+-----------+-----------+---------------------+---------------------+---------------------+--------------+-----------+--------+------------+ 
>>
>> 1 row in set (0.001 sec)
>
> That episode is aired again the following week:
>
>> MariaDB [mythconverg]> SELECT * FROM program WHERE title='Hawaii 
>> Five-0' AND subtitle='Der Passagier auf 4C';
>> +--------+---------------------+---------------------+---------------+----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------+---------------+---------+-------+-----------------+-----------------+--------+-----------+------+----------------+------------+-----------+-----------+-----------------+----------+-----------+-------------------------+-----------+----------+---------+---------------+-------+------+-----------+---------------+-----------+---------+--------+---------+---------------+ 
>>
>> | chanid | starttime           | endtime             | title         
>> | subtitle             | description | category | category_type | 
>> airdate | stars | previouslyshown | title_pronounce | stereo | 
>> subtitled | hdtv | closecaptioned | partnumber | parttotal | 
>> seriesid  | originalairdate | showtype | colorcode | 
>> syndicatedepisodenumber | programid | manualid | generic | 
>> listingsource | first | last | audioprop | subtitletypes | videoprop 
>> | inetref | season | episode | totalepisodes |
>> +--------+---------------------+---------------------+---------------+----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------+---------------+---------+-------+-----------------+-----------------+--------+-----------+------+----------------+------------+-----------+-----------+-----------------+----------+-----------+-------------------------+-----------+----------+---------+---------------+-------+------+-----------+---------------+-----------+---------+--------+---------+---------------+ 
>>
>> |  55622 | 2021-01-16 20:15:00 | 2021-01-16 21:15:00 | Hawaii Five-0 
>> | Der Passagier auf 4C | Jahrzehnte nach dem Absturz wird ein 
>> verschollenes Flugzeugwrack am Meeresgrund entdeckt. Nicht nur, dass 
>> die ungeklärte Unfallursache nun endlich aufgeklärt werden kann, 
>> fördert die Bergung noch einen weiteren Fall zutage. In den 
>> mittlerweile stark angegriffenen Überresten finden die Ermittler eine 
>> Leiche, die definitiv erst nach dem Absturz im Flieger platziert 
>> wurde. Das Team steht vor komplizierten Nachforschungen...     | 
>> Action   | series |    2019 |     0 |               0 
>> |                 |      0 |         1 |    0 |              0 
>> |          0 |         0 | 173914608 | NULL            |          | 
>> |                         |           |        0 |       0 
>> |             4 |     1 |    0 |           | NORMAL |           
>> |         |      0 |       0 |             0 |
>> |  55622 | 2021-01-17 00:55:00 | 2021-01-17 01:40:00 | Hawaii Five-0 
>> | Der Passagier auf 4C | Jahrzehnte nach dem Absturz wird ein 
>> verschollenes Flugzeugwrack am Meeresgrund entdeckt. Nicht nur, dass 
>> die ungeklärte Unfallursache nun endlich aufgeklärt werden kann, 
>> fördert die Bergung noch einen weiteren Fall zutage. In den 
>> mittlerweile stark angegriffenen Überresten finden die Ermittler eine 
>> Leiche, die definitiv erst nach dem Absturz im Flieger platziert 
>> wurde. Das Team steht vor komplizierten Nachforschungen...     | 
>> Action   | series |    2019 |     0 |               0 
>> |                 |      0 |         1 |    0 |              0 
>> |          0 |         0 | 173914608 | NULL            |          | 
>> |                         |           |        0 |       0 
>> |             4 |     0 |    1 |           | NORMAL |           
>> |         |      0 |       0 |             0 |
>> +--------+---------------------+---------------------+---------------+----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------+---------------+---------+-------+-----------------+-----------------+--------+-----------+------+----------------+------------+-----------+-----------+-----------------+----------+-----------+-------------------------+-----------+----------+---------+---------------+-------+------+-----------+---------------+-----------+---------+--------+---------+---------------+ 
>>
>> 2 rows in set (0.002 sec)
>
> And the earliest showing is scheduled for recording:
>
>> MariaDB [mythconverg]> SELECT * FROM oldrecorded WHERE title='Hawaii 
>> Five-0' AND subtitle='Der Passagier auf 4C';
>> +--------+---------------------+---------------------+---------------+----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+-----------+-----------+-----------------+--------+----------+------------+---------+-----------+-----------+------------+---------+--------+ 
>>
>> | chanid | starttime           | endtime             | title         
>> | subtitle             | description | season | episode | category | 
>> seriesid  | programid | inetref         | findid | recordid | 
>> station    | rectype | duplicate | recstatus | reactivate | generic | 
>> future |
>> +--------+---------------------+---------------------+---------------+----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+-----------+-----------+-----------------+--------+----------+------------+---------+-----------+-----------+------------+---------+--------+ 
>>
>> |  55622 | 2021-01-16 20:15:00 | 2021-01-16 21:15:00 | Hawaii Five-0 
>> | Der Passagier auf 4C | Jahrzehnte nach dem Absturz wird ein 
>> verschollenes Flugzeugwrack am Meeresgrund entdeckt. Nicht nur, dass 
>> die ungeklärte Unfallursache nun endlich aufgeklärt werden kann, 
>> fördert die Bergung noch einen weiteren Fall zutage. In den 
>> mittlerweile stark angegriffenen Überresten finden die Ermittler eine 
>> Leiche, die definitiv erst nach dem Absturz im Flieger platziert 
>> wurde. Das Team steht vor komplizierten Nachforschungen...     |      
>> 0 |       0 | Action   | 173914608 |           | ttvdb.py_164541 
>> |      0 |       85 | kabel eins |       4 |         0 |        -1 
>> |          0 |       0 |      1 |
>> |  55622 | 2021-01-17 00:55:00 | 2021-01-17 01:40:00 | Hawaii Five-0 
>> | Der Passagier auf 4C | Jahrzehnte nach dem Absturz wird ein 
>> verschollenes Flugzeugwrack am Meeresgrund entdeckt. Nicht nur, dass 
>> die ungeklärte Unfallursache nun endlich aufgeklärt werden kann, 
>> fördert die Bergung noch einen weiteren Fall zutage. In den 
>> mittlerweile stark angegriffenen Überresten finden die Ermittler eine 
>> Leiche, die definitiv erst nach dem Absturz im Flieger platziert 
>> wurde. Das Team steht vor komplizierten Nachforschungen...     |      
>> 0 |       0 | Action   | 173914608 |           | ttvdb.py_164541 
>> |      0 |       85 | kabel eins |       4 |         0 |         4 
>> |          0 |       0 |      1 |
>> +--------+---------------------+---------------------+---------------+----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+-----------+-----------+-----------------+--------+----------+------------+---------+-----------+-----------+------------+---------+--------+ 
>>
>> 2 rows in set (0.002 sec)
>
> But I already have this episode recorded:
>
>> MariaDB [mythconverg]> SELECT * FROM recorded WHERE title='Hawaii 
>> Five-0' AND subtitle='Der Passagier auf 4C';
>> +--------+---------------------+---------------------+---------------+----------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+----------+----------+---------+---------+------------+-------------+----------+----------+-----------+-----------+-----------------+---------------------+------------+-------+-----------------+-----------------+----------+--------+---------------+------------+-------------+-------------+--------------------------+---------------------+---------------------+-----------+---------+-----------+------------+---------+--------------+---------------------+------------+------------+-----------+ 
>>
>> | chanid | starttime           | endtime             | title         
>> | subtitle             | description | season | episode | category | 
>> hostname | bookmark | editing | cutlist | autoexpire | commflagged | 
>> recgroup | recordid | seriesid  | programid | inetref         | 
>> lastmodified        | filesize   | stars | previouslyshown | 
>> originalairdate | preserve | findid | deletepending | transcoder | 
>> timestretch | recpriority | basename                 | 
>> progstart           | progend             | playgroup | profile | 
>> duplicate | transcoded | watched | storagegroup | bookmarkupdate      
>> | recgroupid | recordedid | inputname |
>> +--------+---------------------+---------------------+---------------+----------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+----------+----------+---------+---------+------------+-------------+----------+----------+-----------+-----------+-----------------+---------------------+------------+-------+-----------------+-----------------+----------+--------+---------------+------------+-------------+-------------+--------------------------+---------------------+---------------------+-----------+---------+-----------+------------+---------+--------------+---------------------+------------+------------+-----------+ 
>>
>> |  55626 | 2020-02-12 01:38:00 | 2020-02-12 02:20:00 | Hawaii Five-0 
>> | Der Passagier auf 4C | Dem Exmarineoffizier Steve McGarrett wird 
>> von der Gouverneurin von Hawaii die Leitung einer Sondereinheit zur 
>> Bekämpfung des organisierten Verbrechens auf Hawaii übertragen. Dafür 
>> nimmt er den ehemaligen Polizisten Chin Ho Kelly, den Polizisten 
>> Danny "Danno" Williams und die junge Polizistin Kona "Kono" Kalakaua 
>> in sein Team auf.    |     10 |       3 | Action   | barrel   
>> |        0 |       0 |       0 |          0 |           1 | US Crime 
>> |       85 | 173914608 |           | ttvdb.py_164541 | 2020-02-13 
>> 20:51:57 | 1329837461 |     0 |               0 | 2019-01-01      
>> |        0 |      0 |             0 |          0 |           1 
>> |           0 | 55626_20200212013800.m4v | 2020-02-12 01:40:00 | 
>> 2020-02-12 02:15:00 | Default   | Default |         0 |          1 | 
>> 0 | Crime        | 0000-00-00 00:00:00 |          5 |       4853 | 
>> Input 1   |
>> +--------+---------------------+---------------------+---------------+----------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+---------+----------+----------+----------+---------+---------+------------+-------------+----------+----------+-----------+-----------+-----------------+---------------------+------------+-------+-----------------+-----------------+----------+--------+---------------+------------+-------------+-------------+--------------------------+---------------------+---------------------+-----------+---------+-----------+------------+---------+--------------+---------------------+------------+------------+-----------+ 
>>
>> 1 row in set (0.005 sec)
>
>
> This (currently) if the only episode scheduled for re-recording, but 
> I've seen this (strange) behavior for other episodes of this and other 
> series before.
>
> There are many more episodes of this series scheduled for the next 
> days, which are NOT recorded as I also already have them; so duplicate 
> matching works for them and they are detected as "repeats".
>
> It might be relevant that I'm currently missing the previous episode, 
> which is correctly scheduled to be recorded.
>
> What am I missing?
>
>> mythbackend -v schedule --testsched 2>&1 | less
> was not enlightening.
>
> Philipp
>
> PS: Is there some easy way to also use `tv_augment` when 
> `mythfilldatabase` invokes `tv_grab_eu_epgdata` as they have the 
> annoying behavior to not have consistent naming over time: This year 
> they call the series "Navy CIS: L.A.", but the past years they called 
> it "NCIS: Los Angeles" or "Navy CIS: Los Angeles" or "NCIS: Los 
> Angeles". This is easy to match by using a "Power Recordign Rule", but 
> as "programid" is not set, duplicate matching is based on "title", 
> which is not consistent.
>
The key here is the column "duplicate" in recorded and oldrecorded. 
duplicate = 0 means record again, 1 means do not. I see that duplicate 
is 0 in your oldrecorded table, so those will record again. Duplicate 
can be set to zero because the recording was bad (could be a few seconds 
or minutes missing), or you if used the "allow rerecord" menu option or 
"delete and allow rerecord".

Peter




More information about the mythtv-users mailing list