sxsphinxstack

Skills / Working / Run a usability test

Working Design skill

Run a usability test

Plan and run task-based usability sessions, observe participant behavior without coaching, and turn evidence into prioritized design findings.

Watch representative people attempt real tasks. Separate what participants did and said from the team's interpretation, and prioritize barriers by effect on the intended outcome.

Inputs

  • Name the research question, product stage, target participants, task owner, and decision deadline.
  • Define recruitment, incentive, consent, recording, accessibility, privacy, and retention.
  • Prepare a stable prototype or environment plus a reset path.

Procedure

  1. Turn product questions into observable learning goals and decisions the study can influence.
  2. Define participant criteria from actual users or a justified proxy. Record important groups the sample will not represent.
  3. Write realistic task scenarios that give motivation without revealing the steps or target labels.
  4. Pilot the script, environment, recording, timing, reset, and note template.
  5. Obtain informed consent and explain that the product, not the participant, is being tested.
  6. Ask participants to attempt each task without coaching. Use neutral prompts such as "What are you thinking?"
  7. Record actions, quotes, completion, errors, assistance, recovery, confidence, and time only when meaningful.
  8. Debrief after each session and distinguish observations, interpretation, and hypotheses.
  9. Group evidence across participants, preserve counterexamples, and avoid percentages from tiny samples.
  10. Rank findings by task impact, frequency in this sample, confidence, and repair cost.
  11. Re-test the highest-risk repaired path or document why another method is required.

Boundaries

Do not secretly record, recruit vulnerable participants without safeguards, or use production accounts that can cause real harm. Never blame participants or treat a convenience sample as representative of all users.