100%(1)1 out of 1 people found this document helpful
This preview shows page 1 - 10 out of 47 pages.
Lecture 7Evaluation and ethicsITECH3001 User Experience
2Recap on last lecture•We covered the key points of what evaluation isand why it is important. The return on investmentfor conducting proper evaluations.•What companies can learn and save throughconducting proper evaluations•What usability tests are and how to conduct ausability test.•What sorts of things we can evaluate•Different types of usability testing environments
3Learning outcomes•From this lecture you will learn what othertechniques there are for evaluating systems andhow they are used. These include:–Expert review–Heuristic evaluation–Cognitive walkthrough–Field studies•You will also learn about how each of them comparein terms of effectiveness.(S&P Chapter 4)
4Why evaluate•Understand the real world and howusersinteractwith technology in the workplace.•Compare designs, which one is best?•Engineer towards a target, is it good enough?Designers have a target, a goal to make sure theirdesign produces a product reaches thisgoal.•Check the system conforms to astandard.•Ensure the system isusable.•Ultimately to SAVE$$$
5Other types of evaluationMany different approaches apart from usabilitytesting or evaluations:–Expert reviews–Heuristic evaluation–Cognitive walkthrough–Field studies(More detail S & P pg 154-55).“Expert reviewers critique an interface todetermine conformance with a short listof design heuristics.”Design experts conduct reviewusually guided by someheuristicsObserving users use system in thecontext of where used.Expert imagines how userwill interact with the system.
6Expert (usability experts) reviews•Getting feedback from users, customers, colleagues.•Long established technique. Guided by heuristics.•Can occur early or late in the design process. Take fromhalf a day to a week.•Outcome can be a formal report with identified problemsand recommendations.•Could result in further discussion with design teams.•Experts step through tasks role playing typical users andtrying to identify problems.•Expert reviewers should be placed in a situation that issimilar to the real users.
7Expert reviews•Can occur early or late in design. Outcome might be aformal report with recommendations for changes or moreinformal feedback to design.•Expert reviews might take half a day to one week toundertake.•Variety of expert reviews possible.–heuristic evaluation–guideline reviews–consistency inspection–cognitive walk-through
8Downside of expert reviews“The danger with expert reviews is that the expertsmay not have an adequate understanding of thetask domain or user communities. Experts comein many flavours, and conflicting, advice canconfuse the situation.”(S&P pp 156)•Important therefore to choose:–Knowledgeable experts–Experts who are familiar with the project–Those who have longer term association with theorganisation i.e. know it well.
9Heuristic EvaluationNielsen (1990s) designed heuristic evaluation as a low-cost