Reference: User Testing Protocol
Greeting script
Scenarios
Student
What courses are you taking that require online submission of assignments?
You are about to submit this week's assignment for [course name]. You have just logged into Sakai to submit this week's lab report for [course name].
Instructor
What courses are you teaching currently? Do any of them require you to upload files on the course site, such as lecture notes, instructions for assignments, pictures, etc.?
You just realized that you need to upload this week's lecture slides and assignment instructions for [course name] to the course site, so you have logged into Sakai. You browse to the Psychology course site and find the Add files button.
Tasks
Task |
Description |
||
|---|---|---|---|
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="e03ab505-9f28-4728-8401-b9469f0b7a90"><ac:plain-text-body><![CDATA[ |
Task 1 |
Upload a word file from the [course name] folder on your desktop |
]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="693190f0-9778-44e8-8f46-2af87d5728bd"><ac:plain-text-body><![CDATA[ |
Task 2 |
Upload the 4 most recent files in [course name] |
]]></ac:plain-text-body></ac:structured-macro> |
Task 3 |
While the 4 files are being uploaded, you realized you didn't mean to upload two of them. What would you do? |
||
Task 4 |
You'd like to add 5 more files, |
Post-test Questions
- Was it easy to figure out how to upload?
- Did you notice the visual que that the files are being uploaded?
- Were you able to realize which files are uploaded and which ones are not?
- Was it easy to stop the upload and add or remove files?
- Did you notice the pause button and remove buttons?
- Was it easy to add more files to the queue?
- Did you notice the Add more button?
*In between sessions, remember to remove what the previous user has uploaded, since there is only one test account available.
Notes for Test Coordinator
Offering help during the test
Try not to offer help too soon. Let the user attempt to move the image a few times.
- If they ask for help reply with:
- "What do you think you/that would do?"
"What do you think that means [if they ask about the red bars]?"
You want to observe whether users are able to:
- recognize that they can upload files
- selecting multiple files from the OS file system
- cancelling or pausing upload in progress
- removing files
Post-test questionnaire
How easy or difficult was it for you to realize you could upload multiple files?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to pause upload?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to add more files to upload?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to remove files from queue?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
