Child pages
  • Image Reorderer User Testing - Round 1 Protocol

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

Reference: User Testing Protocol

Supporting Materials:

Greeting script

Excerpt Include
User Testing Greeting Script
User Testing Greeting Script

User Testing Demographic Questionnaire

Scenarios

Instructor

Panel

You are an instructor for Introduction to Nutrition and are finalizing some images you want to use for your course. You have already uploaded the image files. You are reviewing your images and re-organizing them.

Student

Panel

You are a student in Introduction to Nutrition and are studying for your upcoming test on the nutritional value of fruit. You have located the exam study site for your class which features the images you will be tested on. You change the order of images in the gallery to make sure you haven't memorized information based on their logical order.

Tasks

Task

Description

Task 1

Please rearrange as many of the images as you wish.  Try to rearrange at least 4 images.

Task 2

Now that you are familiar with the application, I'd like you to move [facilitator:  choose image in middle of row and describe to them by name] to the middle of the row above it.

Task 3

Now please move the Mangosteen to the end of the list.

Task 4

Now please move [facilitator:  choose image in middle of row and describe to them by name] to the front of the top row.

Task 5

Next, please move the dragonfruit to the right of the lemon. [Note to facilitator:  if these two are already in that order, choose another pair for them to put together]

Task 6

Now please move the orange to the left of the fig.  [Note to facilitator:  if these two are already in that order, choose another pair for them to put together]

fluid:Post-test Questionnaire

Have the participant fill this out on their own before asking them the post-test questions below.

Post-test questions

Note:  ask these verbally after the user has filled out the questionnaire

  1. How easy or difficult was it for you to reorder images?
  2. How easy or difficult was it for you to understand that you could reorder them?
  3. How did you know how to reorder them?
  4. Were you able to identify which image was selected?  How?
  5. Did the mouse 'drag and drop' behaviour/keyboard behavior work as as you expected?
  6. Were you able to successfully move images to your desired location?
  7. Did you notice any indication of where the image would be dropped once you "picked it up"?  What was it?  Was is helpful?
  8. Overall what did you think of reordering images?
  9. Any other feedback about reordering images you'd like to give us at this point?



Note
titleFacilitation Tips
  • Ask the participant to think aloud.
  • Help the participant to speak freely
    • Distance yourself from the product.
    • Don't react.
    • Don't interrupt.
    • Don't draw attention to specific issues that you care about.
    • Don't ask leading questions.
    • Don't lead with your note-taking (meaning only taking notes when the participant does something interesting).
  • Don't help
  • Test the system, not the user
  • Capture themes, not every action
  • Thank your participants

More details...