[mythtv-users] OT: Troubleshooting write speed problems
nasa01 at comcast.net
nasa01 at comcast.net
Tue Aug 21 13:30:10 UTC 2007
-------------- Original message ----------------------
From: Joel Michael <joel at gimps-r-us.com>
> nasa01 at comcast.net wrote:
> > Hi,
> > I know, this is way off topic, but I figured there must be a lot of smarter
> people on the list than I.
> > I was troubleshooting what I thought was a network issue, when I decided to
> test my harddrive speeds... Looking at the results, my aim how changed. How do
> I fix these write speed issues? Info follows:
> Ok, I'll throw in a few comments from what I'm seeing. This post isn't
> exactly easy to follow, but I'll try and make the most of it.
> > I have three machines (Main, mythtv, MythTV_Server). All machines are
> running a version of mandrake (later than 2006).
> I'm not too familiar with Mandrake, but a linux kernel is a linux kernel ;-)
> > mythtv:
> > Kernel: 2.6.22-rc1
> YIKES! Is there any particular reason you're running a -rc1 kernel,
> especially a -rc1 from the last stable kernel? You should probably be
> running 2.6.22 (maybe 2.6.22.something), or the latest 2.6.23-rc
> (whatever it might be at this moment in time). Just to make sure, does
> 'uname -r' say 2.6.22-rc1?
> > GIGABYTE GV-NX73G256D-RH GeForce 7300GS 512MB(256MB on Board) GDDR2 PCI
> Express x16 Video Card
> > WINTEC AMPO 1GB (2 x 512MB) 240-Pin DDR2 SDRAM DDR2 533 (PC2 4200) Dual
> Channel Kit Desktop Memory Model 3AMD2533-1G1K-R
> > AMD Athlon 64 X2 3800+(65W) Windsor 2.0GHz Socket AM2 Processor
> > Seagate ST3300831A ATA Drive
> > MSI K9N Platinum Socket AM2 NVIDIA nForce 570 Ultra MCP ATX AMD Motherboard
> > hdparm -v /dev/hda
> The other thing you may want to investigate is using libata to access
> your hard drives, but YMMV as PATA support isn't quite as mature as SATA
> support for some chipsets.
> > multcount = 16(on)
> > IO_Support = 1 (32-bit)
> > unmaskirq = 1 (on)
> > using_dma = 1 (on)
> > keepsettings = 0 (off)
> > readahead = 256 (on)
> > geometry = 19457/255/63, sectors = 312581808, start = 0
> > dd results very similar to dd results for hda on MythTV_Server
> > MythTV_Server:
> > Kernel: 2.6.17-13mdv
> > HighPoint Technologies, RocketRaid 1740
> > DFI Infinity RS482 Motherboard
> > CPU AMD|A64 3400+ 2.2G 939
> > 756M generic ram
> > 4x320G Harddrives in Raid 5
> > hdparm -v /dev/hda (same as mythtv, except for geometry)
> > ...will update hdparm -v /dev/sda later (would this be usefull?)
> > hdparm -tT /dev/sda
> > /dev/sda:
> > Timing cached reads: 2432 MB in 2.00 seconds = 1214.37 MB/sec
> > Timing buffered disk reads: 184 MB in 3.01 seconds = 61.05 MB/sec
> > time dd if=/dev/zero of=./test.tmp bs=1024k count=4000
> > 2066+0 records in
> > 2066+0 records out
> > 2166358016 bytes (2.2 GB) copied, 129.33 seconds, 16.8 MB/s
> > Command terminated by signal 2
> > 0.02user 19.98system 2:09.49elapsed 15%CPU (0avgtext+0avgdata 0maxresident)k
> > 0inputs+0outputs (1major+275minor)pagefaults 0swaps
> > sync; time bash -c "dd if=/dev/zero bs=1024k count=20 48
> of=/mnt/Raid/testspeed; sync"
> > 2048+0 records in
> > 2048+0 records out
> > 2147483648 bytes (2.1 GB) copied, 63.3346 seconds, 33.9 MB/s
> > 0.01user 4.42system 1:13.53elapsed 6%CPU (0avgtext+0avgdata 0maxresident)k
> > 0inputs+0outputs (4major+943minor)pagefaults 0swaps
> So, what I'm seeing here (and correct me if I'm wrong), is that the "dd"
> test isn't quite living up to the speed that hdparm suggests.
> Off the top of my head, I can think of a few reasons for this.
> First thing that comes to mind is disk contention. Is there anything
> else doing a reasonable amount of I/O on the disk during your test? To
> make sure, try booting to single user mode and re-run the dd test.
> The next thing I can think of, is disk layout. How is your disk
> partitioned? Do you run LVM? Software RAID? On your RAID set, how big
> is the stripe size?
> Next contender is the file system. What kind of file system is it (for
> MythTV systems, people tend to use XFS)? Did you remember to tell the
> file system about the stripe size of your RAID set? What other
> performance related metrics did you adjust (e.g. block size, inodes per
> block, journal size, etc)? What mount options are you using (e.g.
> noatime, journal options)?
> Lastly, check the hardware (it's unlikely that hardware is a problem,
> given that you have two machines displaying the same symptoms). Is your
> power supply ok? Are all the cables plugged in right? Are any of the
> cables kinked or pinched? Do your kernel logs say anything about disk
> errors? Controller errors?
> A well optimised system will be within a few MB/sec of the theoretical
> throughput as reported by hdparm. My Myth box is 2MB/sec under on a
> software mirror, and 10MB/sec under the sum of two disks on a RAID-0 set
> that is actually being used (for commflaging and recording at the
> moment, if you're wondering).
> But, the biggest question is, is it really a problem? Put on your
> normal load, then fire up iostat and take a look at the last 4 columns
> (avgqu-sz, await, svctm, %util). You want avgqu-sz to usually be less
> than 10, certainly no more than 100. The next two columns are only
> really useful if you're tuning for latency (which isn't much of a factor
> in a MythTV box, but can be for something like a home directory server).
> The %util is good to look at as well, but can be a bit misleading.
> Don't worry too much if you're 100% utilised, but your queue size is
> still low.
I do appreciate you taking the time out to respond. I can't answer all your astute questions right now, as I'm at work -- however I will try and clear some things up...
1. I am using 2.6.22-rc1 because I have both a PVR-500 and a pchdtv 3500 in my system. Recommendations were to use a kernel after 2.6.18 (as it has built in support for the 3500). But 2.6.18 - 2.6.22 had some kind of bug which caused problems with ivtv -- rc1 was the first one to fix that bug. I haven't updated since (maybe I should).
2. Why care? Mainly for my Server, which has all my media on it. Putting new media on it (for example vob files) can be really slow (usaully around 25MB/s). Playing dvd ripped files seems ok, but playing hd files producing some *stuttering*. I also have noticed some pauses in playing music from the server. Finally, I hope to have access to media via multiple computer (all at once) which the present speeds wouldn't support.
3. HighPoint Technologies, RocketRaid 1740 is a pci hardware raid card (see http://www.highpoint-tech.com/ for info). I don't run LVM and Nope - not software RAID. The RAID array is configured as one partiton. I am using JFS as the fs (can't remember why....)
Thanks again for taking the time,
More information about the mythtv-users