...
| border | false |
|---|
...
| width | 65% |
|---|
...
Reference: User Testing Protocol
Supporting Materials:
- File Uploader Prototype
- User Testing Demographic Questionnaire
- Uploader User Testing Task Sheet
- Post-test Questionnaire
Greeting script
| Excerpt Include |
|---|
...
|
...
|
User Testing Demographic Questionnaire
Scenarios
Student
| Panel | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| You are a student and What courses are you taking that require online submission of assignments? You are about to submit this week's assignment for [fluid:course name]. You have just logged into Sakai to submit this week's lab report for your Biology262 course. You browse to the Biology course site.
InstructorPanel | [fluid:course name]. |
Instructor
| Panel |
|---|
For this task, assume you are an instructor for a Psychology 101 course site. You just realized that you need to upload this week's lecture slides and assignment instructions for Psychology 101 to the course site , so you have logged into Sakai. You browse to the Psychology course site and find the Add files button.. Assume you are already in your course site for the following tasks. You want to upload both lecture slides and assignment instructions to the file manager which is where you are. |
Tasks
Task | Description |
|---|---|
Task 1 |
...
Please upload an assignments file from the |
...
Psychology 101 folder on your desktop. |
Task 2 |
...
Please upload the 4 most recent |
...
lecture files from the Psychology 101 folder on your desktop. |
Task 3 |
...
Now I'd like you to upload the rest of the lecture slides, 5 - 12. [fluid:Let them hit upload and then...] While the files are being uploaded, you realize you didn't |
...
mean to upload lecture slides 11 & 12. What |
...
do you do? |
Task 4 |
...
[fluid:Before they hit done preferably, ask them] Now I'd like to upload 3 more of the assignments files. Please show me how you would upload 3 more files? |
Notes for Test Coordinator
Offering help during the test
...
Don't offer help
...
; let the user attempt to
...
perform the task themselves. If they ask for help reply with:
- "What do you think you/that would do?"
...
- "What
...
- do
...
- you
...
- think
...
- that
...
- means (e.g. remove, checkmark, warning sign icons)?"
You want to observe whether users are able to:
- recognize that they can upload files
...
- select multiple files from the OS file system
...
- cancel or
...
- pause upload in progress
...
- remove files
fluid:Post-test
...
How easy or difficult was it for you to realize you could upload multiple files?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to move a section of the portal to a specific location?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
How easy or difficult was it for you to distinguish between sections of the portal that could be moved and those that were locked in place?
- Very difficult
- Difficult
- Neutral
- Easy
- Very easy
Post-test questions
Note: Don't read the examples in parenthesis to users; they are there to provide context for you.
1. How easy or difficult was it for you to realize you could move different sections in your portal?
- Did you notice a visual cue for picking up one of these sections? How helpful was it to you?
2. How easy or difficult was it for you to move a section in your portal from one location to a new location?
- Did you notice a visual cue for dropping a section? How helpful was it to you? (position, valid/invalid targets)
3. Red Bar Visual Cue:
- How did you know where the section you were moving would land?
- Did you notice a red bar? What do you think it is for?
- Was there anything confusing about it? If so, what?
- (If confusing) Are there any changes you would suggest to make it less confusing?
4. Did you have trouble moving any sections of the portal?
- Was there a visual cue for placing a section? How helpful was it to you?
5. How easy or difficult was it for you to distinguish between sections of the portal that could be moved and those that were locked in place?
- Did you see a visual cue that helped you determine whether a section could be picked up or not? How helpful was it to you?
...
| width | 35% |
|---|
...
| borderColor | #321137 |
|---|---|
| bgColor | #fff |
| titleBGColor | #c1b7c3 |
| title | MORE ON USER TESTING PROTOCOL |
| borderStyle | solid |
...
| borderColor | #CCCCCC |
|---|---|
| bgColor | #F8F8F8 |
| titleBGColor | ##DFDFDF |
| title | MORE ON USER TESTING |
| borderStyle | solid |
...
| borderColor | #CCCCCC |
|---|---|
| bgColor | #F8F8F8 |
| titleBGColor | ##DFDFDF |
| title | MORE ON FILE UPLOADER |
| borderStyle | solid |
...
Questionnaire
- Have the user fill this out on their own before asking them the post-test questions below.
Post test questions (ask these verbally after the user has filled out the questionnaire)
- Is there anything else you'd like to tell me about your upload experience?