Simple Text Inline Edit User Testing - Round 3 Protocol
Reference: User Testing Protocol
Supporting Materials:
- Simple Text Inline Edit Prototype
- User Testing Demographic Questionnaire
- fluid:Facilitator's Note Taking Task Sheet - use this for note taking and understanding common flows through tasks
- fluid:User task sheets - give these to users so they have written tasks in front of them -- give them one at time as you read it to them
- fluid:Post Test Questionnaire - likert scale questions to have participants fill out before asking interactive post-test questions
Greeting script
User Testing Demographic Questionnaire
Scenarios
Student
You are a Teaching Assistant for Astronomy 7A. Your instructor has asked you to review the Sections in the Section Info Tool to make sure they are correct. The course consists of one lecture section which all the students attend, and 3 discussion sections. Each student in the class attends only one of the discussion sections. All the lecture and discussion sections have their own entry in the the [fluid:insert LMS they are familiar with] Learning Management System. At the request of the instructor, you are reviewing the information on all the sections of the course in the [fluid:insert LMS they are familiar with] in preparation for the beginning of the semester.
Instructor
You are an instructor for Astronomy 7A. Your course consists of one lecture section which all the students attend, and 3 discussion sections. Each student in the class attends only one of the discussion sections. All the lecture and discussion sections have their own entry in the the [fluid:insert LMS they are familiar with] Learning Management System. You are reviewing the information on all your sections in the [fluid:insert LMS they are familiar with] in preparation for the beginning of the semester.
Tasks
Task |
Description |
---|---|
Task 1 |
You realize there is an extra discussion section listed for your course for Graduate Student Instructor Ray Davis. It's also in the wrong room, Lecture Hall B, and you decide to delete it. |
Task 2 |
As you are reviewing the titles of your sections, you notice that all the sections are labeled with "LEC," which indicates that they lecture sections. You know the last three sections should actually be labeled with "DISC" for discussion sections, so you decide to fix them. |
Task 3 |
Next, looking at the section titles you believe that the title for the lecture section should contain an "L" for lecture instead of a "P" (as you're not sure what that's for), so you decide to change it. |
Task 4 |
You realize the numbering is off in the discussion sections now. Change Ray Davis' discussion section to have "104" in the title instead of "105." |
Task 5 |
After thinking about the "L" you added previously to the lecture section title, you're not absolutely sure it's right and are afraid you may be changing something you shouldn't, so you decide to change the lecture section title back to what it was before. |
Task 6 |
When you see the "P" back in the lecture section title, you are positive it's wrong, and decide to put the "L" back again. |
Notes for Test Coordinator
You want to observe whether the user has trouble:
- recognizing they can edit inline
- successfully editing text
- discovering how to "save and exit" inline edit
- recognizing that an edit was successfully made
- using, or even notices, the "undo" link
- using, or even notices, the "redo" link
fluid:Post Test Questionnaire
Have the user fill this out on their own before asking them the post-test questions below.
Post-test questions
NOTE: ask these verbally AFTER the participant has filled out the post-test questionnaire
- Did you see anything that told you you could edit the text directly on this page? How helpful was it to you?
- Did you expect that clicking the highlighted area would allow you to edit the text directly on this page? If not, what did you expect?
- Did you notice any indication that your edit was successful?
- Did you think there was a way to "undo" your edit? Did you think there was a way to "redo" an edit that you'd undone?
- Did you notice an "undo" or "redo" link?
- Did you enjoy using inline edit? Is there anything you would improve?
Facilitation Tips
- Ask the participant to think aloud.
- Help the participant to speak freely
o Distance yourself from the product.
o Don't react.
o Don't interrupt.
o Don't draw attention to specific issues that you care about.
o Don't ask leading questions.
o Don't lead with your note-taking (meaning only taking notes when the participant does something interesting). - Don't help
- Test the system, not the user
- Capture themes, not every action
- Thank your participants
More details...