Reference: User Testing Protocol
Greeting script
Scenarios
Student
You are a student and have just logged into Sakai. You are browsing through the Image Gallery. You decide you'd like to add some files to the current site.
You are taking an Introduction to Photography class. Your current assignment is to take three pictures demonstrating different types of lighting and share them with the rest of the class for discussion and critique. You found and took several pictures with your digital camera and transfered them to your computer several days ago. You now need to locate those pictures and submit them for the assignment to the class Image Gallery. If you remember correctly, you transferred the pictures to your computer into a folder named Photography101.
Task |
Description |
|---|---|
Task 1 |
Upload a file from the Photography101 folder on your desktop |
Task 2 |
Upload the 4 most recent files in Photography101 that were saved today |
Task 3 |
Upload all files in Photography101. <while upload progress is going> You realized that IMG_9409.jpg and IMG_9407.jpg are the wrong files and you didn't intend to upload those to the Photography class site. What would you do? |
Task 4 |
You remembered there are photos you wanted to add to the site from your desktop. You want to add image020, image021, and image025.jpg. What would you do? |
Instructor
You are an instructor and have just logged into Sakai. You are browsing through the Image Gallery. You decide you'd like to add some files to the current site.
Notes for Test Coordinator
Offering help during the test
Try not to offer help too soon. Let the user attempt to move the image a few times.
- If they ask for help reply with:
- "What do you think you/that would do?"
"What do you think that means [if they ask about the red bars]?"
You want to observe whether users are able to:
- recognize that they can upload files
- selecting multiple files from the OS file system
- cancelling or pausing upload in progress
- removing files
Post-test questionnaire
How easy or difficult was it for you to realize you could upload multiple files?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to move a section of the portal to a specific location?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to distinguish between sections of the portal that could be moved and those that were locked in place?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
Post-test questions
Note: Don't read the examples in parenthesis to users; they are there to provide context for you.
1. How easy or difficult was it for you to realize you could move different sections in your portal?
- Did you notice a visual cue for picking up one of these sections? How helpful was it to you?
2. How easy or difficult was it for you to move a section in your portal from one location to a new location?
- Did you notice a visual cue for dropping a section? How helpful was it to you? (position, valid/invalid targets)
3. Red Bar Visual Cue:
- How did you know where the section you were moving would land?
- Did you notice a red bar? What do you think it is for?
- Was there anything confusing about it? If so, what?
- (If confusing) Are there any changes you would suggest to make it less confusing?
4. Did you have trouble moving any sections of the portal?
- Was there a visual cue for placing a section? How helpful was it to you?
5. How easy or difficult was it for you to distinguish between sections of the portal that could be moved and those that were locked in place?
- Did you see a visual cue that helped you determine whether a section could be picked up or not? How helpful was it to you?
