ENG 508 Mobile Usability Test Report Rubric

Are the elements of a formal test plan present?

(Barnum, 283)

  • Cover or Title Page
  • Table of Contents including appendices
  • List of tables/ illustrations
  • Purpose/Executive Summary
    • Problem Statement and Test Objectives
  • Introduction/Background
  • Methodology
    • User Profiles/Personas
    • Participants and participant incentive
    • Tasks/Scenarios
    • Findings/Results
    • Test Environment and Equipment List
    • Post-task, post-test results
    • Recommendations
  • Appendices

Are the materials for a test plan present?

  • Moderator’s script
  • Moderator’s checklist
  • Screener questionnaires
  • Description of scenarios
  • Checklists broken down by pre, during, and post test tasks
  • Observation form
  • Pre-test questionnaire
  • Post-test questionnaire
  • Post-task questionnaire
  • Success condition descriptions
  • Fail conditions descriptions

Scaled responses

Quality of purpose/executive summary

Poor (1 – 2 – 3 – 4 – 5) Good

Quality of observation form

Poor (1 – 2 – 3 – 4 – 5) Good

Overall quality of questionnaires

Poor (1 – 2 – 3 – 4 – 5) Good

Quality of moderator’s script

Poor (1 – 2 – 3 – 4 – 5) Good

Quality of personas

Poor (1 – 2 – 3 – 4 – 5) Good

Are tasks, scenarios, analysis, and conclusions focused on appropriate for mobile concerns such as:

Learnability: Time used to accomplish tasks at the first use

Poor (1 – 2 – 3 – 4 – 5) Good

Efficiency: Shorter task completion time for satisfaction

Poor (1 – 2 – 3 – 4 – 5) Good

Memorability: Time to finish tasks after not using applications for a period of time

Poor (1 – 2 – 3 – 4 – 5) Good

Error: Number of errors made (e.g., detour steps, deviating button clicks from the right path, wrong answers, percentage of correctly completed tasks)

Poor (1 – 2 – 3 – 4 – 5) Good

Satisfaction: Attitude of users toward applications after using them (e.g., level of difficulty, confidence, like/dislike)

Poor (1 – 2 – 3 – 4 – 5) Good