[mythtv] MythTV Usability Report

Buzz buzz at oska.com
Mon Jan 9 05:21:39 UTC 2006

Qualitative Vs Quantitative.    

Jono's usability report was a qualitative analysis.  He was analysing the
"quality" of his experience (mostly with the UI), and suggesting approaches
to improve that experience.  Qualitative analysis is frequently
experimental/statistical, and no single case on it's own can hold much
merit, apart from being socially indicitave of the "normal" users responses,
for some value of "normal".  To get a truly meaningful qualitative analysis
requires a much bigger dataset that can be statisitically analysed.
Surveys are the commonest method of getting such data.  Said survey should
also perport to determine a value for "normal".   Eg:
'developer','schmo','grade 10 intelligence level', etc.

Each of the people who has responded to Jono's report has subconsciously
asked a question already: "is jono's quality of experience indicitive of my
experience?"... Or more easily, "do I agree with Jono?"  The questions you
should actually be asking are:

1) what is the "normal" user set? (or plurally, what "sets")?
2) is Jono's experience indicitative of the "normal" user set?, or maybe the
"normal2" set, or the "normal3" set, or set "X"? 
3) which set do I fit in?
4) is my experience in set "X" indicitative of others in set "X"?
5) what can be done to improve the experience/s of users generally?
(normally with regard to a specific set)
6) what set is the biggest?
7) for most quality improvement/impact, which set should be targeted?
(usually the biggest, statistically).

Programmers like numbers, order, systems.  Quantitative analysis is those
numbers, and iterpretation of those numbers.   Example, you want to make the
UI more "usable", this is your "feature".  "usable" is (for example only)
equated to "minimising number of required key presses on remote" and/or
"minimising complexity of key-press-order".  Qualitative analysis would then
generate a log of keypresses for users  (in controlled circumstances, or at
least in controlled sets of users), and analyse these.  Other example
targets might include "try to get 90% of the systems features used available
within 3 key presses", or might include "try to maximise special remote key
usage, and minimise navigation(up,down,left,right) key usage",  etc.
Decide what is important beforehand for your "feature", and try to define
that quantitatively.  I say "try", it can be quite difficult to be sure
you've go the definition correct.   The definition may be different for
different sets of users.


Has anyone EVER done any explicit quantitative or qualitative ananysis of
the Myth UI?  I doubt it. 

We all subconsciously do 'implicit' analysis, based on our interpretation of
other users experiences (and our own), and attempt to build a set of
qualitative experiences mentally and validate those by 'comparing notes'
with others: SAYS: "do you like the coffee?" THINKS: "I like the coffee."
HEARS: "yes, the coffee is nice." IMPLYS: "the coffee here must be good".
SO, is the coffee good? Who can really say.?<grin>

I make no suggestions/answers here, just food for though.  If you want my
opinion, ask.

David Bussesnchutt(aka Buzz).
(BSc in Comp Sci, AI, UI Design, Statistical/Experimental Psychology).

> -----Original Message-----
> From: mythtv-dev-bounces at mythtv.org 
> [mailto:mythtv-dev-bounces at mythtv.org] On Behalf Of Craig Tinson
> Sent: Monday, 9 January 2006 1:03 PM
> To: jono at jonobacon.org; Development of mythtv
> Subject: Re: [mythtv] MythTV Usability Report
> Jono Bacon wrote:
> >Hi all,
> >
> >Firstly, thanks for MythTV. It is an incredible piece of 
> software our 
> >house is a better place with our MythTV box. Keep up the great work.
> >
> >For a while now I have been noting down little quirks and 
> oddities in 
> >MythTV. Although MythTV is incredibly usable and works very well, 
> >fixing these problems would make it more intuitive and easier to use.
> >This list is certainly not exhaustive and although I have 
> been meaning 
> >to do an exhaustive usability assessment, I have not had the 
> time. As 
> >such, these are major usability issues I have confronted.
> >
> >I would love to conduct a more in-depth usability test in 
> the future if 
> >that would be of interest. I write quite a bit about design, 
> usability 
> >and MythTV on my blog at www.jonobacon.org.
> >
> >I have put a code at the beginning of each issue for easily 
> referring to it.
> >
> >--> General
> >
> >* G1 - When watching a show, you should be able to hit the record 
> >button to record the entire show if it has been watched from the 
> >beginning and as such the live TV buffer contains the show.
> >* G2 - If you schedule a show to record, you can only watch 
> the show at 
> >the same time as recording it by first selecting Media
> >Library->Watch and then selecting a show. This is unintuitive - you
> >should just be able to watch TV like normal and be able to view the 
> >channel while the show is recording.
> >* G3 - Switching between channels is far to slow - this 
> slowness makes 
> >skipping through channels rather laborious.
> >* G4 - The term 'Optical Disks' in the menu is not particularly clear
> >- I suspect most people know its a Disk, but not optical.
> >* G5 - In the Upcoming recordings screen, the use of dimmed and 
> >non-dimmed entries in entirely unclear - what do they signify? It is 
> >certainly unclear to me and my other half. The other problem is that 
> >many of the entries listed in Upcoming will not actually be taped 
> >because it says the recording will be taped at a later time. 
> If it is 
> >not going to be taped, why is it still in the list?
> >* G6 - Many of the screens in MythTV (such as Upcoming and Set
> >Priorities) have specific letters in each entry. These letters 
> >obviously refer to something specific, but there is no 
> legend displayed 
> >on the screen to say what they mean.
> >* G7 - There seems to be no simple way of cancelling all 
> recordings for 
> >a show other than finding it in the EPG and changing the recording 
> >option to not record the show. The ideal solution would be to have a 
> >list of shows that are being recorded and then when you 
> select a show, 
> >there are options such as Cancel this recording, Cancel all 
> recordings 
> >etc.
> >
> >--> Electronic Programme Guide
> >
> >* EPG1 - When watching TV you will often want to view the EPG.
> >Currently you do this by pressing Menu and then selecting 
> Program Guide 
> >from the on-screen menu. This two step process needs to be instead 
> >bound to a single key so that you can press one button and 
> access the 
> >EPG while watching TV.
> >* EPG2 - When you access the EPG from the main menu, there is no TV 
> >feed on the top right-hand corner, whereas when you access 
> the EPG when 
> >watching TV by pressing Menu->Program Guide, there is a TV 
> feed in the 
> >EPG. This behaviour needs to be unified - I would suggest 
> always having 
> >a feed of the current TV channel.
> >* EPG3 - The EPG should not be inside the Manage menu, for a few 
> >reasons. The first is that you don't really 'manage' your program 
> >schedule, and secondly because you need to reference the EPG 
> regularly. 
> >Why take two steps to access the EPG when you likely want to 
> access it 
> >on the main menu?
> >
> >--> MythMusic
> >
> >* MM1 - When in the main playback screen, there are a number of 
> >different artists in a long list, but there is no way of 
> jumping from 
> >artist to artist.
> >* MM2 - If you have not created a playlist, or you have just cleared 
> >you active play queue, MythMusic by default has no songs 
> loaded. This 
> >is totally unintuitive. The default functionality should be 
> that when 
> >no no queue or playlist is available, *all* of your music should be 
> >available to play. It seems crazy that All My Music needs to be 
> >consciously ticked in the Edit Playlist area to actually hear some 
> >music.
> >* MM3 - There is no way to create a playlist based on genre.
> >* MM4 - When playing back a song it lists encoding details (eg.
> >128kbps 44.1khz) - this information is of no interest to 
> most users and 
> >therefore should not be displayed.
> >* MM5 - There is copious room in the bottom third of the screen, and 
> >this should really be used to display guidance notes about 
> creating a 
> >playlist. Creating playlists is not very intuitive and this 
> space could 
> >be usefully used for notes.
> >* MM6 - There is no obvious way to save a playlist that you 
> have just 
> >constructed. I still don't know how to do this.
> >* MM7 - When creating a playlist, the icons on the left 
> (such as the CD 
> >icon when you have inserted a CD and it appears below the 
> All My Music 
> >line) are not clear at all. This need to be much bigger or use the 
> >space at the bottom of the screen to show a nice big icon. On my 28" 
> >TV, they just were not clear enough and look like bullet points.
> >* MM8 - When in the main music playback screen and at the top of the 
> >list of songs, you can't press Up to go to the bottom of the list. I 
> >assume the same problem happens at the bottom of the list - 
> you should 
> >be able to press Down to go to the top of the list.
> >
> >--> MythWeather
> >
> >* MW1 - When loading MythWeather and it says it is 
> retrieving weather 
> >data, it takes a long time to grab this information. It 
> would be better 
> >if it just went away and grabbed it periodically in the background, 
> >this giving little or no delay.
> >* MW2 - Unlike other modules in MythTV, MythWeather does not display 
> >information in the LCD panel on the front of my case.
> >
> >--> Ideas for features
> >
> >* Reminders - there should be a feature to allow you to set 
> a reminder 
> >to watch a particular show, even if you are not recording it. MythTV 
> >would then pp up a box to say the show is on and allow you to change 
> >the channel. It would also be useful to possibly pop up a small OSD 
> >with a countdown to when the reminded show starts.
> >* A module to go and grab National Lottery numbers and display them.
> >
> >Cheers,
> >
> >  Jono
> >_______________________________________________
> >mythtv-dev mailing list
> >mythtv-dev at mythtv.org
> >http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-dev
> >
> >  
> >
> well.. personally I think this is a good report.
> I've read through all the replies and to be frank I think 
> they are completely out of order.
> I've been using mythtv for a while now and yeah - I know how 
> it works..I know what all the menu options are for and I know 
> how to move things around if I wanted. but that isn't the point..
> The responses so far have been of the frame of mind of "well 
> if you don't like it - change it" or even worse "well if you 
> don't like it - don't use it"
> This is an old (and tiring!) point of view and really doesn't 
> help future the cause of OpenSource software in general. If 
> this was still the frame of mind then linux wouldn't have 
> ever got out of console mode (and yeah - we all know there 
> are still some elitists that would love that)
> How is OpenSource software ever expected to get into the 
> realm of public use without it being easier to use?? more 
> software should undergo similar Usability Testing.
> Well.. just my two-penneth worth.
> Craig
> _______________________________________________
> mythtv-dev mailing list
> mythtv-dev at mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-dev

More information about the mythtv-dev mailing list