Documentation for a historical release of Infusion: 1.3
Please view the Infusion Documentation site for the latest documentation.
If you're looking for Fluid Project coordination, design, communication, etc, try the Fluid Project Wiki.

Layout Reorderer User Testing - Round 4 Protocol

Reference: User Testing Protocol

Supporting Materials:

Greeting script

Error rendering macro 'excerpt-include' : No link could be created for 'User Testing Greeting Script'.

User Testing Demographic Questionnaire

Scenarios

Student

Your university has just 'unveiled' a new portal that you'll be able to use to stay on top of campus and course information and activities.   One of the features they are touting is the ability to customize your layout.  In a minute, we'll show you the portal as you see it on your first visit.  Since you have a few extra minutes, you decide to play around with the layout a bit.

Instructor

Your university has just 'unveiled' a new portal that you'll be able to use to stay on top of campus and course information and activities.   One of the features they are touting is the ability to customize your layout.  In a minute, we'll show you the portal as you see it on your first visit.  Since you have a few extra minutes, you decide to play around with the layout a bit.

Tasks

Task

Description

Task 1

Since it is the beginning of the semester and you're still getting used to your new schedule, you decide to move your course information to the top of the page.
[Note to Facilitator: Participant will find that the first box in the portal is locked and cannot be moved. Observe whether they understand: that the box is locked.   If they do not understand why they cannot move the My Courses box  to the topmost position (after several minutes), explain to them that it is locked]

Task 2

You decide the calendar might also be pretty useful so you move it just below your course information.

Task 3

Next, you decide to even-out the columns a bit and move your bookmarks to the other column.  Please do so now.

Task 4

You're still not exactly happy with the layout.  Please adjust the layout anyway you'd like and let me know when you are done.

Notes for Test Coordinator

You want to observe whether the user has trouble:

  • recognizing they can move a portlet on the portal home page
  • moving a portlet to a specific location
  • differentiating between locked and unlocked portlets

fluid:Layout Reorderer Post Test Questionnaire

Note: Have users fill out this questionnaire before verbally asking them to answer the post-test questions.

Post-test questions

Note:  ask these verbally after the user has filled out the questionnaire

  1. Did you understand how to move a box from one location to another?
  2. Did you notice a visual cue for picking up one of these boxes? How helpful was it to you? (looking for cursor change to hand)
  3. Did you notice a visual cue that helped you see where you would place a box? How helpful was it to you? (looking for green box drop target)
  4. Further questions about drop target, which can be skipped if answered in question #2:
    1. How did you know where the box you were moving would land?
    2. Did you notice a green outline box? What do you think it is for?
    3. Was there anything confusing about this box? If so, what?
    4. (If confusing) Are there any changes you would suggest to make it less confusing?
  5. Did you see a visual cue that helped you determine whether a box could be picked up or not? How helpful was it to you? (looking for lock icon to show the portlet is locked.)
  6. Do you have any suggestions for making any of the actions easier to do?
  7. Anything else you'd like to tell us about your experience changing the layout of your portal?

Blind User

  1. Did JAWS do a good job indicating to you the names of the boxes?
  2. Did you understand where to place the box?
  3. Did you understand if a box was locked, what that meant?

    Facilitation Tips

    • Ask the participant to think aloud.
    • Help the participant to speak freely
      • Distance yourself from the product.
      • Don't react.
      • Don't interrupt.
      • Don't draw attention to specific issues that you care about.
      • Don't ask leading questions.
      • Don't lead with your note-taking (meaning only taking notes when the participant does something interesting).
    • Don't help
    • Test the system, not the user
    • Capture themes, not every action
    • Thank your participants

    More details...