[mythtv-users] 0.22 autoexpire behavior

Mon Nov 16 22:04:06 UTC 2009

On Mon, November 16, 2009 1:20 pm, Michael T. Dean wrote:
> On 11/16/2009 10:54 AM, Yan Seiner wrote:
>> On Sun, November 15, 2009 9:19 pm, Michael T. Dean wrote:
>>
>>> So, what happened to cause the issue in the first place?  If it is just
>>> the problem that Myth can't delete because there's no room to record,
>>> why didn't Myth delete shows before it ran out of space?  I don't know
>>> for sure, but I wouldn't be surprised if Myth were busy trying to
>>> expire
>>> a bunch of tiny recordings while your system was making one or more
>>> high-bitrate (HDTV) recordings and the filesystem was filling faster
>>> than it was emptying.  It won't do this with large files--as Myth will
>>> take care to make sure it's deleting faster than all the recorders
>>> could
>>> possibly write, but with small files, it may be spending enough time in
>>> between deletes that it can't keep up.
>> I think I have a part of the problem.  My database is seriously fubared.
>> I did a dump and looked at it; seems that over the years I have
>> collected
>> tons and tons of cruft.  (mythmusic is looking for music in
>> /lib/modules/*....)
>
> That should be cleaned up.
>
>>   There's multiple backends, frontends, etc. that no
>> longer exist.
>>
>
> That doesn't matter/affect performance--and takes virtually no space.
>
>> I've posted the dump at ... .
>
> BTW, by gzip compressing the recording, you can generally make it about
> 1/5 the size or less and compression/uncompression takes very little
> time or CPU. See http://www.mythtv.org/wiki/Database_Backup_Compression
>
>>   I'd appreciate
>> any and all help in fixing it.  I don't mind dumping everything but
>> recording data.  All the recordings should be on selene at
>> /data20/mythtv/recordings; everything else can be deleted.
>>
>
> All the recording metadata shows recordings on selene, so
>
>> selene is the only backend and frontend ATM.  I need to add eos as a
>> secondary BE/FE but I need to clean up the database first.
>>
>> How do I do that?
>
> The best approach (though I doubt it will help) is:
> http://www.mythtv.org/wiki/Database_Backup_and_Restore#Partial_restore_of_a_backup
>
>> As for how this started, I reserve 60 GB on /data20, so myth should have
>> lots of room.  I saw this coming over several days; I messed around with
>> stuff but never could get it to delete and finally over the weekend it
>> choked.
>>
>>> If that's the case, make sure you increase the "Extra Disk Space"
>>> setting so you have a little more "breathing room" before the file
>>> system fills up and Bad Things Happen (TM).
>>>
>> 60GB should be plenty.
>
> But if the system is full, if that 60GB were used by some other process
> between Myth's recordings, the drive would fill up completely when
> Myth's not recording/expiring recordings, so it wouldn't be able to
> start new recordings/expire more recordings.
>
> I guess I should have said, "Increase the 'Extra Disk Space' and make
> sure that /only/ Myth is using the filesystem."
>
> Mike
> _______________________________________________
> mythtv-users mailing list
> mythtv-users at mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
> !DSPAM:4b01c232184372088739198!
>
>

OK, so touch + chown created the files myth was complaining about.  These
expired normally.

2009-11-16 13:32:11.590 AutoExpire: CalcParams(): Max required Free Space:
60.0 GB w/freq: 15 min
2009-11-16 13:32:11.783 Expiring 0 MBytes for 1281 @ Tue Dec 16 00:00:00
2008 => Nature "Chimpanzees: An Unnatural History"
2009-11-16 13:32:11.793 Expiring 0 MBytes for 1131 @ Sun Feb 15 09:00:00
2009 => Motorcycle Racing "Monster Energy AMA Supercross Series"
2009-11-16 13:32:11.794 Expiring 0 MBytes for 1341 @ Mon Feb 16 07:00:00
2009 => Teen Kids News
2009-11-16 13:32:11.795 Expiring 0 MBytes for 1131 @ Sat Feb 21 07:30:00
2009 => Horseland "The Princess"
2009-11-16 13:32:11.799 Expiring 0 MBytes for 1131 @ Sat Mar 14 07:30:00
2009 => Horseland "The Secret"
2009-11-16 13:32:11.799 Expiring 0 MBytes for 1282 @ Tue Mar 31 18:00:00
2009 => Ask This Old House "Banging Pipes; Installing Fiberglass Door"
2009-11-16 13:32:11.800 Expiring 0 MBytes for 1282 @ Tue May 26 18:30:00
2009 => Nightly Business Report
2009-11-16 13:32:11.801 Expiring 0 MBytes for 1282 @ Tue May 26 18:30:00
2009 => Nightly Business Report
2009-11-16 13:32:11.802 Expiring 0 MBytes for 1282 @ Tue May 26 18:30:00
2009 => Nightly Business Report
2009-11-16 13:32:11.803 Expiring 0 MBytes for 1281 @ Wed May 27 18:30:00
2009 => Nightly Business Report
2009-11-16 13:32:11.804 Expiring 0 MBytes for 2281 @ Sat May 30 07:30:00
2009 => Bob the Builder "The Sunflower Farm Takes Shape"
2009-11-16 13:32:11.805 Expiring 0 MBytes for 1282 @ Wed Jun 10 18:40:29
2009 => Unknown
2009-11-16 13:32:11.806 Expiring 0 MBytes for 1282 @ Wed Jun 10 18:45:19
2009 => Unknown
2009-11-16 13:32:11.807 Expiring 0 MBytes for 1282 @ Wed Jun 10 18:52:37
2009 => Unknown
2009-11-16 13:32:11.808 Expiring 0 MBytes for 1282 @ Mon Jun 29 18:02:39
2009 => Unknown
2009-11-16 13:32:11.809 Expiring 0 MBytes for 1091 @ Mon Jul 20 18:30:00
2009 => KEZI 9 News
2009-11-16 13:32:11.816 Expiring 0 MBytes for 1091 @ Mon Jul 20 18:30:00
2009 => KEZI 9 News
2009-11-16 13:32:11.845 Expiring 0 MBytes for 1091 @ Mon Jul 20 18:30:00
2009 => KEZI 9 News
2009-11-16 13:32:11.847 Expiring 0 MBytes for 1091 @ Mon Jul 20 19:00:00
2009 => Entertainment Tonight
2009-11-16 13:32:11.847 Expiring 0 MBytes for 1091 @ Mon Jul 20 19:00:00
2009 => Entertainment Tonight
2009-11-16 13:32:11.849 Expiring 0 MBytes for 1091 @ Mon Jul 20 19:00:00
2009 => Entertainment Tonight
2009-11-16 13:32:11.850 Expiring 0 MBytes for 1091 @ Mon Jul 20 20:00:00
2009 => The Bachelorette "The Men Tell All"
2009-11-16 13:32:11.851 Expiring 0 MBytes for 1091 @ Mon Jul 20 20:00:00
2009 => The Bachelorette "The Men Tell All"
2009-11-16 13:32:11.852 Expiring 0 MBytes for 1131 @ Sat Jul 25 07:30:00
2009 => Horseland "No News Is Good News"
2009-11-16 13:32:11.853 Expiring 0 MBytes for 1131 @ Sat Jul 25 08:30:00
2009 => Sushi Pack "Collect 'Em All; Jigsaw Sushi"
2009-11-16 13:32:11.854 Expiring 0 MBytes for 1131 @ Sun Jul 26 17:30:00
2009 => Wild About Animals
2009-11-16 13:32:11.856 Expiring 0 MBytes for 1131 @ Sat Aug 1 08:30:00
2009 => Sushi Pack "Sushis of a Certain Stature; A Very Big Deal"
2009-11-16 13:32:11.857 Expiring 0 MBytes for 1131 @ Sat Aug 1 11:00:00
2009 => Wild About Animals
2009-11-16 13:32:11.858 Expiring 0 MBytes for 1131 @ Sun Aug 2 17:30:00
2009 => Wild About Animals
2009-11-16 13:32:11.859 Expiring 0 MBytes for 1131 @ Sat Aug 15 08:30:00
2009 => Sushi Pack "Pants on Fire; The Wrong Sushi"
2009-11-16 13:32:11.861 Expiring 0 MBytes for 1131 @ Sun Aug 16 17:30:00
2009 => Wild About Animals
2009-11-16 13:32:11.861 Expiring 0 MBytes for 1131 @ Sat Aug 22 08:30:00
2009 => Sushi Pack "Respectable Delectables; Star of Light, Star So
Bright"
2009-11-16 13:32:11.863 Expiring 0 MBytes for 1131 @ Sun Aug 23 17:30:00
2009 => Wild About Animals
2009-11-16 13:32:11.902 Reschedule requested for id 0.
2009-11-16 13:32:12.278 Scheduled 98 items in 0.4 = 0.00 match + 0.36 place
.....
2009-11-16 13:39:14.892 Scheduled 98 items in 0.3 = 0.03 match + 0.31 place
2009-11-16 13:43:36.414 Reschedule requested for id -1.
2009-11-16 13:43:36.814 Scheduled 98 items in 0.4 = 0.15 match + 0.24 place
2009-11-16 13:47:11.903 AutoExpire: CalcParams(): Max required Free Space:
60.0 GB w/freq: 15 min
2009-11-16 13:49:00.501 Reschedule requested for id -1.

But it's still not autoexpiring anything that actually takes up space.

selene:/data20/mythtv/recordings# df
SouborovÃ½ systÃ©m      1K blokÅ¯   PouÅ¾itÃ©     VolnÃ© UÅ¾i% PÅipojeno do
/dev/md20            1922866224 1901450808   1880220 100% /data20

With 1.8 GB free, and expire running every 15 minutes, it should be
dumping 58 GB of recordings....

--Yan

-- 
   o__
   ,>/'_         o__
   (_)\(_)       ,>/'_          o__
A day may come  (_)\(_)         ,>/'_      o__
when the courage of men fails, (_)\(_)     ,>/'_                      o__
when we forsake our friends and break all (_)\(_)                     ,>/'_
bonds of fellowship, but it is not this day. But it is not this day! (_)\(_)

This day we ride!