Documentation for a historical release of Infusion: 1.3
Please view the Infusion Documentation site for the latest documentation.
If you're looking for Fluid Project coordination, design, communication, etc, try the Fluid Project Wiki.

Simple Text Inline Edit User Testing - Round 3 Protocol

Reference: User Testing Protocol

Supporting Materials:

Greeting script

Error rendering macro 'excerpt-include' : No link could be created for 'User Testing Greeting Script'.

User Testing Demographic Questionnaire

Scenarios

Student

You are a Teaching Assistant for Astronomy 7A. Your instructor has asked you to review the Sections in the Section Info Tool to make sure they are correct.  The course consists of one lecture section which all the students attend, and 3 discussion sections. Each student in the class attends only one of the discussion sections. All the lecture and discussion sections have their own entry in the the [fluid:insert LMS they are familiar with] Learning Management System. At the request of the instructor, you are reviewing the information on all the sections of the course in the [fluid:insert LMS they are familiar with] in preparation for the beginning of the semester.

Instructor

You are an instructor for Astronomy 7A. Your course consists of one lecture section which all the students attend, and 3 discussion sections. Each student in the class attends only one of the discussion sections. All the lecture and discussion sections have their own entry in the the [fluid:insert LMS they are familiar with] Learning Management System. You are reviewing the information on all your sections in the [fluid:insert LMS they are familiar with] in preparation for the beginning of the semester.

Tasks

Task

Description

Task 1

You realize there is an extra discussion section listed for your course for Graduate Student Instructor Ray Davis. It's also in the wrong room, Lecture Hall B, and you decide to delete it.

Task 2

As you are reviewing the titles of your sections, you notice that all the sections are labeled with "LEC," which indicates that they lecture sections. You know the last three sections should actually be labeled with "DISC" for discussion sections, so you decide to fix them.

Task 3

Next, looking at the section titles you believe that the title for the lecture section should contain an "L" for lecture instead of a "P" (as you're not sure what that's for), so you decide to change it.

Task 4

You realize the numbering is off in the discussion sections now. Change Ray Davis' discussion section to have "104" in the title instead of "105."

Task 5

After thinking about the "L" you added previously to the lecture section title, you're not absolutely sure it's right and are afraid you may be changing something you shouldn't, so you decide to change the lecture section title back to what it was before.

Task 6

When you see the "P" back in the lecture section title, you are positive it's wrong, and decide to put the "L" back again.

Notes for Test Coordinator

You want to observe whether the user has trouble:

  • recognizing they can edit inline
  • successfully editing text
  • discovering how to "save and exit" inline edit
  • recognizing that an edit was successfully made
  • using, or even notices, the "undo" link
  • using, or even notices, the "redo" link

fluid:Post Test Questionnaire

Have the user fill this out on their own before asking them the post-test questions below.

Post-test questions

NOTE:  ask these verbally AFTER the participant has filled out the post-test questionnaire

  1. Did you see anything that told you you could edit the text directly on this page? How helpful was it to you?
  2. Did you expect that clicking the highlighted area would allow you to edit the text directly on this page? If not, what did you expect?
  3. Did you notice any indication that your edit was successful?
  4. Did you think there was a way to "undo" your edit? Did you think there was a way to "redo" an edit that you'd undone?
  5. Did you notice an "undo" or "redo" link?
  6. Did you enjoy using inline edit? Is there anything you would improve?



Facilitation Tips

  • Ask the participant to think aloud.
  • Help the participant to speak freely
    o Distance yourself from the product.
    o Don't react.
    o Don't interrupt.
    o Don't draw attention to specific issues that you care about.
    o Don't ask leading questions.
    o Don't lead with your note-taking (meaning only taking notes when the participant does something interesting).
  • Don't help
  • Test the system, not the user
  • Capture themes, not every action
  • Thank your participants

More details...