Getting started with Fluid Engage 0.3 testing

Environment

In order to test Fluid Engage 0.3, you will need one of the following devices:

  • iPhone OS 3.0 or higher on iPhone 3G or 3GS
  • iPhone OS 3.0 or higher on iPod touch 1G, 2G or 3G

In order to test Fluid Engage with VoiceOver (screen reader on iPhone or iPod touch) you will need

  • iPhone OS 3.0 or higher on iPhone 3GS
  • iPhone OS 3.0 or higher on iPod touch 32 GB or 64 GB (Fall 2009 or later)

Setting up the application

Setting up for standard tests

  1. On your iPhone/iPod touch, open up Safari.
  2. Go to http://build.fluidproject.org.
  3. Tap on "Fluid Engage Mobile" (under "Engage Demos" on the right side).
  4. Tap on "+" on the browser's chrome (the lower action bar).
  5. Tap on "Add to Home Screen".
  6. If you so desire, edit the name to something more intuitive, like "FE: Nightly Build".
  7. Tap on "Add".
  8. Quit Safari, and go back to the iPhone/iPod touch home screen.
  9. Tap on the newly added icon to start the application.
  10. From hereon, use said icon to access Fluid Engage Mobile.

Setting up for standard tests with VoiceOver

QA tests with VoiceOver will be done using Engage 0.3 through Safari and not using the iPhone app. Although setting up the Fluid Engage Mobile app on iPhone/iPod Touch (as above) using VoiceOver is technically possible, there is an issue with using the app with VoiceOver. Upon page transition, VoiceOver focus does not automatically fall on the new page. Thus, there is no feedback that the new page has loaded. Further, invoking VoiceOver command to read the screen content results in the previous page being read. VoiceOver focus on the new page occurs only upon tapping an element. On the other hand, with Safari, the focus falls automatically on the title of the new page upon transition and the title is announced. Invoking VoiceOver command to read the screen content results in the new page being read.

Setting up a bookmark for the Engage 0.3 home page url
  1. On your iPhone/iPod touch, open up Safari.
  2. Go to http://build.fluidproject.org:8095/engage/home/home.html.
  3. Invoke the "Utilities" button
  4. Add a bookmark.
  5. Edit the bookmark name to FE.
  6. From hereon, use said bookmark to access Engage 0.3.

Using the iPhone with VoiceOver

Start VO

To start/stop VO
    Go to Settings -> General -> Accessibility -> VoiceOver and invoke the switch control to turn VoiceOver on/off.

Turn screen curtain on

To turn off/on screen display
    Triple-tap with three fingers.

Unlock

To unlock iPhone
    Tap towards the lower end of the screen till you hear "Unlock". Then double-tap on the screen.

Set language

To set VoiceOver language
    Go to Settings -> General -> International -> Language and select language.

Read

To read items one by one
    Left-flick single finger to read out elements on the screen left-to-right and top-to-bottom.
    Right-flick single finger to read them in reverse order.
To read items randomly
    Drag finger or tap over the screen. VO reads out items at the positions touched.
To read the screen from top to bottom
    Flick up with two fingers.
To read the screen downwards from the item selected
    Flick down with two fingers.
To pause/restart reading
    Tap once with two fingers.
To adjust reading speed
    Select Speed slider in VoiceOver settings and flick up/down with one finger to increase/decrease reading speed.

Select

To select an item
    The currently read item is the one that is selected. (Visually, a black rectangle, called the VoiceOver cursor, can be seen around the selected item.)

Invoke

To invoke the selected element
    Double tap anywhere on the screen.

Scroll

To scroll
    Flick up/down with three fingers to page up/down.

Mute

To mute/restart VO
    Double tap with three fingers.

Type

To enter text using keyboard
    Drag a finger over keyboard. When desired key is read, keep holding the selected key and tap the screen with another finger to enter the character.

Rotor control

To read only certain item types
    With one finger anchored on the screen, draw arcs on the screen with another finger around it. You will hear options such as 'headings', 'links', 'form elements'. Select the desired one with a tap. Left/right flicks with one finger will then read only items of that type.
    When this is invoked on text, options will be to read character by character or word by word.

Reporting issues

General QA guidelines

  • Take a good look at the wireframes (Mobile wireframes (Draft 9)), and compare what you see on the device to what the wireframes suggest. Reading the storycards behind each wireframe may also help to identify unintended behavior.
  • It often helps to read both the procedure and the expected results before initiating the particular test.
  • Does the tool behave the way that you would expect?
  • Are you surprised by anything?
  • Does something take longer than you would expect?
  • When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback?