Child pages
  • Uploader User Testing - Round 2 Protocol

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

borderfalse

...

width65%

...

Reference: User Testing Protocol

Supporting Materials:

Greeting script

Excerpt Include

...

User Testing Greeting Script

...

User Testing Greeting Script

User Testing Demographic Questionnaire

Scenarios

Student

What courses are you teaching currently? Do any of them require you to upload files on the course site, such as lecture notes, instructions for assignments, pictures, etc.?
<The user answers: XYZ course.>

So you are teaching XYZ.

[fluid:course name].

Panel

What courses are you taking that require online submission of assignments?

You are

a student and

about to submit this week's assignment for [fluid:course name]. You have just logged into Sakai to submit this week's lab report for

your Biology262 course. You browse to the Biology course site.

Task

Description

Task 1

Upload a word file from the Biology262 folder on your desktop

Task 2

Upload the 4 most recent files in Biology262 that were saved today

Task 3

While the 4 files are being uploaded, you realized two of them are the wrong files. What would you do?

Task 4

You'd like to add more files, how would you go about doing that?

Instructor

Panel

Instructor

Panel

For this task, assume you are an instructor for a Psychology 101 course site.

You just realized that you need to upload this week's lecture slides and assignment instructions for Psychology 101 to the course site

, so you have logged into Sakai. You browse to the Psychology course site and find the Add files button.

.  Assume you are already in your course site for the following tasks.  You want to upload both lecture slides and assignment instructions to the file manager which is where you are.

Tasks

Task

Description

Task 1

...

Please upload an assignments file from the

...

Psychology 101 folder on your desktop.

Task 2

...

Please upload the 4 most recent

...

lecture files from the Psychology 101 folder on your desktop.

Task 3

...

Now I'd like you to upload the rest of the lecture slides, 5 - 12.  [fluid:Let them hit upload  and then...] While the files are being uploaded, you realize you didn't

...

mean to upload lecture slides 11 & 12. What

...

do you do?

Task 4

...

[fluid:Before they hit done preferably, ask them] Now I'd like to upload 3 more of the assignments files.  Please show me how you would upload 3 more files?

Notes for Test Coordinator

Offering help during the test

...

Don't offer help

...

; let the user attempt to

...

perform the task themselves. If they ask for help reply with:

  • "What do you think you/that would do?"

...

  • "What

...

  • do

...

  • you

...

  • think

...

  • that

...

  • means (e.g. remove, checkmark, warning sign icons)?"

You want to observe whether users are able to:

  • recognize that they can upload files

...

  • select multiple files from the OS file system

...

  • cancel or

...

  • pause upload in progress

...

  • remove files

fluid:Post-test

...

How easy or difficult was it for you to realize you could upload multiple files?

  1. Very difficult
  2. Difficult
  3. Neutral
  4. Easy
  5. Very easy

How easy or difficult was it for you to pause upload?

  1. Very difficult
  2. Difficult
  3. Neutral
  4. Easy
  5. Very easy

How easy or difficult was it for you to add more files to upload?

  1. Very difficult
  2. Difficult
  3. Neutral
  4. Easy
  5. Very easy

How easy or difficult was it for you to remove files from queue?

  1. Very difficult
  2. Difficult
  3. Neutral
  4. Easy
  5. Very easy

Post-test questions

Note: Don't read the examples in parenthesis to users; they are there to provide context for you.

1. How easy or difficult was it for you to realize you could move different sections in your portal?

  • Did you notice a visual cue for picking up one of these sections? How helpful was it to you?

2. How easy or difficult was it for you to move a section in your portal from one location to a new location?

  • Did you notice a visual cue for dropping a section? How helpful was it to you? (position, valid/invalid targets)

3. Red Bar Visual Cue:

  • How did you know where the section you were moving would land?
  • Did you notice a red bar? What do you think it is for?
  • Was there anything confusing about it? If so, what?
  • (If confusing) Are there any changes you would suggest to make it less confusing?

4. Did you have trouble moving any sections of the portal?

  • Was there a visual cue for placing a section? How helpful was it to you?

5. How easy or difficult was it for you to distinguish between sections of the portal that could be moved and those that were locked in place?

  • Did you see a visual cue that helped you determine whether a section could be picked up or not? How helpful was it to you?

...

width35%

...

borderColor#321137
bgColor#fff
titleBGColor#c1b7c3
titleMORE ON USER TESTING PROTOCOL
borderStylesolid

...

borderColor#CCCCCC
bgColor#F8F8F8
titleBGColor##DFDFDF
titleMORE ON USER TESTING
borderStylesolid

...

borderColor#CCCCCC
bgColor#F8F8F8
titleBGColor##DFDFDF
titleMORE ON FILE UPLOADER
borderStylesolid

...

Questionnaire

  • Have the user fill this out on their own before asking them the post-test questions below.

Post test questions (ask these verbally after the user has filled out the questionnaire)

  1. Is there anything else you'd like to tell me about your upload experience?