Reference:  User Testing Protocol

Supporting Materials:

• Simple Text Inline Edit Prototype
• User Testing Demographic Questionnaire
• Simple Text Inline Edit Post Questionnaire.doc
• Simple Text Edit Task Sheet(3).doc
• Tasks to put in front of students
• Simple Text IE Instructor Tasks2.doc

Greeting script

Scenarios

Student

Task

1) You realize there is an extra discussion section listed for your course for Graduate Student Instructor Ray Davis. It's also in the wrong room, Lecture Hall B, and you decide to delete it.

2) As you are reviewing the titles of your sections, you notice that all the sections are labeled with "LEC," which indicates that they lecture sections. You know the last three sections should actually be labeled with "DISC" for discussion sections, so you decide to fix them.

3) Next, looking at the section titles you believe that the title for the lecture section should contain an "L" for lecture instead of a "P" (as you're not sure what that's for), so you decide to change it.

4) You realize the numbering is off in the discussion sections now. Change Ray Davis' discussion section to have "104" in the title instead of "105."

5) After thinking about the "L" you added previously to the lecture section title, you're not absolutely sure it's right and are afraid you may be changing something you shouldn't, so you decide to change the lecture section title back to what it was before.

6) When you see the "P" back in the lecture section title, you are positive it's wrong, and decide to put the "L" back again.

Instructor

Task

1) You realize there is an extra discussion section listed for your course for Graduate Student Instructor Ray Davis. It's also in the wrong room, Lecture Hall B, and you decide to delete it.

2) As you are reviewing the titles of your sections, you notice that all the sections are labeled with "LEC," which indicates that they lecture sections. You know the last three sections should actually be labeled with "DISC" for discussion sections, so you decide to fix them.

3) Next, looking at the section titles you believe that the title for the lecture section should contain an "L" for lecture instead of a "P" (as you're not sure what that's for), so you decide to change it.

4) You realize the numbering is off in the discussion sections now. Change Ray Davis' discussion section to have "104" in the title instead of "105."

5) After thinking about the "L" you added previously to the lecture section title, you're not absolutely sure it's right and are afraid you may be changing something you shouldn't, so you decide to change the lecture section title back to what it was before.

6) When you see the "P" back in the lecture section title, you are positive it's wrong, and decide to put the "L" back again.

Notes for Test Coordinator

Offering help during the test

Try not to offer help too soon. Let the user attempt to move the box a few times. If they ask for help reply with:

• "What do you think you/that would do?"

You want to observe whether the user has trouble:

• recognizing they can edit inline
• successfully editing text
• discovering how to "save and exit" inline edit
• recognizing that an edit was successfully made
• using, or even notices, the "undo" link
• using, or even notices, the "redo" link

Post-test Questionnaire (have the user fill this out themselves)

Simple Text Inline Edit Post Questionnaire.doc 

Post-test questions (ask these verbally after the user has filled out the questionnaire)

1. Did you see anything that told you you could edit the text directly on this page? How helpful was it to you?
2. Did you expect that clicking the highlighted area would allow you to edit the text directly on this page? If not, what did you expect?
3. Did you notice any indication that your edit was successful?
4. Did you think there was a way to "undo" your edit? Did you think there was a way to "redo" an edit that you'd undone?
5. Did you notice an "undo" or "redo" link?
6. Did you enjoy using inline edit? Is there anything you would improve?