Child pages
  • Uploader User Testing - Round 1 Protocol

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

Reference: User Testing Protocol

Supporting Materials:

Greeting script

Excerpt Include
User Testing Greeting Script
User Testing Greeting Script

User Testing Demographic Questionnaire

Scenarios

Note: Trying to create scenarios where participants will use the File Upload component without us telling them specifically "to upload a file".

Scenario 0

Panel

You are taking an Introduction to Photography class. Your current assignment is to take three pictures demonstrating different types of lighting and share them with the rest of the class for discussion and critique. You found and took several pictures with your digital camera and transfered them to your computer several days ago. You now need to locate those pictures and submit them for the assignment to the class Image Gallery. If you remember correctly, you transferred the pictures to your computer into a folder named Photography101.

Tasks

Task

Description

Task 1

Upload a file from the Photography101 folder on your desktop

Task 2

Upload the 4 most recent files in Photography101 that were saved today

Task 3

Upload all files in Photography101. <while upload progress is going> You realized that IMG_9409.jpg and IMG_9407.jpg are the wrong files and you didn't intend to upload those to the Photography class site. What would you do?

Task 4

You remembered there are photos you wanted to add to the site from your desktop. You want to add image020, image021, and image025.jpg. What would you do?

Scenario 1

Panel

It's the middle of the semester and your group project for Psychology 101 is due in two days.  You are collaborating with several other students.  Each of you has taken a section of the project to work on.  As each team member finishes their section they IM the group to let everyone know their progress.

Your job on the project team is to take all the sections and combine them into one document and submit to the instructor through your class Sakai site (folder: "final project").

The files you need to combine are:
- introduction.doc
- method.doc
- results.doc

The files may be located in any of the following places:
- folder "class project" on the computer's hard drive
- Psychology 101 class work space on Sakai
- Sociology 100 class work space on Sakai

Scenario 2

Panel

You are a TA for undergraduate class "Psychology 101" and teach a tutorial/discussion section of 30 students.  You are responsible for lecturing in the tutorial as well as grading the assignments of your 30 students. 

Last week was the course mid term and you have just finished grading all 30 online assignments.  Your feedback remarks for each student are written in a Word document.  You need to get each student's feedback to them on their space on the course Sakai site.  You are hoping to do this for the following three students' feedback.

Student Files:
- Allison_feedback.doc
- Colin_feedback.doc
- Daphne_feedback.doc

Scenario 3

Panel

You are an instructor for undergraduate class "Psychology 101" and teach a large lecture of 300 undergraduate students in the Fall term.  There are typically 10 tutorial/discussion sections of 30 students each taught by your TAs.  You have your TAs do the grading of exams and assignments.  It is the Winter term/Fall semester and recently you have been asked by your department chair to offer this course in the summer term/session as an online course.  In preparation for the new online course you have created a separate Sakai site for it and started organizing your lectures and notes by week.

Today you are working on the materials for the new online course for week 3.  You have a lecture in Powerpoint and 2 short assignment descriptions that you have been finalizing.  You have just recruited a few new TAs and want them to familiarize themselves with these materials and so are making the materials available on the new course Sakai site.

Files for TAs to review are:
- lecture_3.ppt
- Assignment_3.doc
- Group_assignment_description.doc

Notes for Test Coordinator

Offering Help during the test

Don't offer help; let the user attempt to perform the task themselves. If they ask for help reply with:

  • "What do you think you/that would do?"
  • "What do you think that means?"

You want to observe whether the user has trouble:

  • uploading a file from the computer, another site, or current Sakai site
  • is pause/resume upload understandable or does this confuse them
  • does the user understand that you cannot "cancel" the upload until you first "pause" the upload, is this confusing
  • differentiating between paused and not paused states
  • is the wizard layout for the Continue and Cancel buttons confusing? should these two buttons be moved adjacent to each other instead of separated on either side of the panel?

Post-test Questionnaire

  • Have the user fill this out on their own.