Child pages
  • Image Reorderer User Testing - Round 1 Protocol

Documentation for a historical release of Infusion: 1.3
Please view the Infusion Documentation site for the latest documentation.
If you're looking for Fluid Project coordination, design, communication, etc, try the Fluid Project Wiki.

Skip to end of metadata
Go to start of metadata

Reference: User Testing Protocol

Supporting Materials:

Greeting script

Error rendering macro 'excerpt-include'

No link could be created for 'User Testing Greeting Script'.

User Testing Demographic Questionnaire

Scenarios

Instructor

You are an instructor for Introduction to Nutrition and are finalizing some images you want to use for your course. You have already uploaded the image files. You are reviewing your images and re-organizing them.

Student

You are a student in Introduction to Nutrition and are studying for your upcoming test on the nutritional value of fruit. You have located the exam study site for your class which features the images you will be tested on. You change the order of images in the gallery to make sure you haven't memorized information based on their logical order.

Tasks

Task

Description

Task 1

Please rearrange as many of the images as you wish.  Try to rearrange at least 4 images.

Task 2

Now that you are familiar with the application, I'd like you to move [facilitator:  choose image in middle of row and describe to them by name] to the middle of the row above it.

Task 3

Now please move the Mangosteen to the end of the list.

Task 4

Now please move [facilitator:  choose image in middle of row and describe to them by name] to the front of the top row.

Task 5

Next, please move the dragonfruit to the right of the lemon. [Note to facilitator:  if these two are already in that order, choose another pair for them to put together]

Task 6

Now please move the orange to the left of the fig.  [Note to facilitator:  if these two are already in that order, choose another pair for them to put together]

fluid:Post-test Questionnaire

Have the participant fill this out on their own before asking them the post-test questions below.

Post-test questions

Note:  ask these verbally after the user has filled out the questionnaire

  1. How easy or difficult was it for you to reorder images?
  2. How easy or difficult was it for you to understand that you could reorder them?
  3. How did you know how to reorder them?
  4. Were you able to identify which image was selected?  How?
  5. Did the mouse 'drag and drop' behaviour/keyboard behavior work as as you expected?
  6. Were you able to successfully move images to your desired location?
  7. Did you notice any indication of where the image would be dropped once you "picked it up"?  What was it?  Was is helpful?
  8. Overall what did you think of reordering images?
  9. Any other feedback about reordering images you'd like to give us at this point?



Facilitation Tips

  • Ask the participant to think aloud.
  • Help the participant to speak freely
    • Distance yourself from the product.
    • Don't react.
    • Don't interrupt.
    • Don't draw attention to specific issues that you care about.
    • Don't ask leading questions.
    • Don't lead with your note-taking (meaning only taking notes when the participant does something interesting).
  • Don't help
  • Test the system, not the user
  • Capture themes, not every action
  • Thank your participants

More details...

1 Comment

  1. Hi all--

    Is the image reorder based on an html table structure? If not blind users won't have a sense of middle or row. If the reorderer isn't based on table structure, have them move an item to a particular position within the list of objects (ex. "move item so that it is the fifth object in the list").