South Puget Sound Community College // March 9-10

Courses in this series:

1. Principles of user-centered design (Val)
2. Practices of user-centered design (Val)
3. Writing for the web (Val)
4. Mastering usability
5. Planning and preparing for usability testing
6. Conducting usability testing (Val)
7. Measuring the user experience (this class)
8. Informed design: providing feedback (April)

Accounts

• Set up an account at TryMyUI (will do this WE or TH)
• Complete the user test at TryMyUI (so we can have some data – note – installs a small app on your machine to record keystrokes – if using a Mac, use Chrome not Safari; ditto MSFT)
• Set up a Gmail account to create a form in Google docs (will do this TH)
• Usability Scorecard (free)

Files

Dropbox files // Timer

Tests, Tools, Links

Chi-Squared

• Chi Squared distribution table
• Chi Squared tutorial (Penn)
• Chi Test in Excel (MSFT)

Google Analytics

• Absolute beginner’s guide to GA
• Getting started with GA (step-by-step set up)

A/B Testing

• Benefits of A/B testing (Google)
• Google Optimize
• Power of A/B testing
• Step-by-step guide with GA

Information visualization

• The Beauty of Data Visualization (TED Talk)
• Tufte’s Rules (website)
• Tufte’s Rules (preso, start at slide 4 – slide 16)

Everything else ;-)

• Browser stats (W3C)
• Measuring Usability (blog, tools)
• Measuring User Experience (companion site)
• SUS text
• Screen rez stats (W3C)
• System Usability Scale (SAS) from Usability.gov
• Understanding statistical functions in Excel (udemy course)
• Web Analytics Association
• What is a key performance indicator?

 

Books

• Measuring the User Experience, Tom Tullis and Bill Albert
• Quantifying the User Experience, Jeff Sauro and James R Lewis
• Web Analytics 2.0, Avinash Kaushik

Essays and Examples

• A note on confidence interval estimations and margin of error
• Comparison of three one-question, post-task usability questionnaires
• Guide your design with a 1-page UX strategy
• How to choose the right UX metrics for your products
• How to compute a confidence interval in five easy steps
• Integrating usability testing into agile 
• Lean UX: Getting out of the deliverables business
• Net Promoter Score (HBR)
• Rating the severity of usability problems
• Translating business goals into specific objectives and KPIs

Videos

• In-class explanation of chi-squared
• Simple explanation of chi-squared 
• The Beauty of Data Visualization (TED Talk)

Course Description

Usability consultants and other web professionals must justify their design decisions with solid, reliable, and relevant data. This course provides the participant  with the quantitative analysis expertise needed to extract this meaningful data from their usability test results.

User testing techniques vary and, as such, the methods used to compile, evaluate and analyze data vary as well. This class explores options for collecting and documenting test results. Well-planned and implemented user testing provides relevant results. Participants will explore and analyze these results to target design areas in need of improvement.

• Overview of usability testing analysis
• Introduction to user experience metrics
• Ten myths about usability metrics
• Collecting focus and user group results
• Collecting and documenting other site stats
• Measuring severity ratings
• When and how to measure errors
• Exploring behavioral and physiological metrics
• Understanding Google analytics
• Understanding post-test debriefing
• Creating usability reports