Guidlines

Environments

  • OS
    • Windows 7
    • Windows 8.1
    • Windows 10
    • Mac OS 10.11 ( El Capitan )
  • Browser
    • Chrome (latest)

General QA Guidelines

General Use

  • Does the tool behave the way that you would expect
  • Are you surprised by anything
  • Does something take longer than you would expect
  • When the tool does something unexpected or takes too long to do something, does the tool provide appropriate feedback

 

QA Tests


Protocol
Perform the following tests using each browser/system environment

Unit Test

________________________________________________________

Protocol
Launch the following link to execute unit tests.

Test 1: First Discovery Unit tests

State Tests

________________________________________________________

Description
Ensures that the component properly traverses through the various states.

Protocol
Perform these tasks on the following site using both the mouse and keyboard, all tests should be done in sequence.

  1. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=electron
  2. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=search

Test 1: Launch

Test 2: Hover/Focus 

Test 3: Disable self voicing

Test 4: Enable self voicing

Test 5: Language Selection

Test 6: Language Selection - Hover/Focus

Test 7: Language Selection - Scroll Languages

Test 8: Language Selection - Change Language

Test 9: Language Selection - Restore Language to English

Test 10: Language Selection - Continue

Test 11: Welcome

Test 12: Welcome - Back

Test 13: Welcome - Return

Test 14: Welcome - Continue

Test 15: Text-to-Speech

Test 16: Text-to-Speech - Disable

Test 17: Text-to-Speech - Enable

Test 18: Text-to-Speech - Back

Test 19: Text-to-Speech - Return

Test 20: Text-to-Speech - Continue

Test 21: Speech Rate

Test 22: Speech Rate - Increase

Test 23: Speech Rate - Decrease

Test 24: Speech Rate - Disabled Text-to-Speech

Test 25: Speech Rate - Enable Text-to-Speech

Test 26: Speech Rate - Back

Test 27: Speech Rate - Return

Test 28: Speech Rate - Continue

Test 29: Contrast

Test 30: Contrast - Change Contrast

Test 31: Language Selection - Restore Language to English

Test 32: Contrast - Back

Test 33: Contrast - Return

Test 34: Contrast - Continue

Test 35: Text Size

Test 36: Text Size - Increase

Test 37: Text Size - Decrease

Test 38: Text Size - Back

Test 39: Text Size - Return

Test 40: Text Size - Continue

Test 41: Letter Spacing

Test 42: Letter Spacing - Increase

Test 43: Letter Spacing - Decrease

Test 44: Letter Spacing - Back

Test 45: Letter Spacing - Return

Test 46: Letter Spacing - Continue

Test 47: Line Spacing

Test 48: Line Spacing - Increase

Test 49: Line Spacing - Decrease

Test 50: Line Spacing - Back

Test 51: Line Spacing - Return

Test 52: Line Spacing - Continue

Test 53: Captions

Test 54: Captions - Disable

Test 55: Captions - Enable

Test 56: Captions - Back

Test 57: Captions - Return

Test 58: Captions - Continue

Test 59: Show Sounds

Test 60: Show Sounds - Disable

Test 61: Show Sounds - Enable

Test 62: Show Sounds - Back

Test 63: Show Sounds - Return

Test 64: Show Sounds - Continue

Test 65: Onscreen Keyboard

Test 66: Onscreen Keyboard - Enable

Test 67: Onscreen Keyboard - Disable

Test 68: Onscreen Keyboard - Back

Test 69: Onscreen Keyboard - Return

Test 70: Onscreen Keyboard - Continue

Test 71: Sticky Keys

Test 72: Sticky Keys - Invalid Entry

Test 73: Sticky Keys - Turn On

Test 74: Sticky Keys - Type

Test 75: Sticky Keys - Disable

Test 76: Sticky Keys - Back

Test 77: Sticky Keys - Return

Test 78: Sticky Keys - Continue

Test 79: Confirmation

Test 80: Confirmation - Back

Test 81: Confirmation - Return

Test 82: Confirmation - Continue

Test 83: Consent

Test 84: Consent - Back

Test 85: Consent - Return

Test 86: Consent - Continue

Test 87: Saved to USB

Test 88: Stored Preferences

Test 89: Reset Demo

Task Oriented Functional Tests

________________________________________________________

Description
Ensures that the component is able to handle expected input.

Protocol
Perform these tasks on the following site.

  1. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=electron
  2. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=search

Test 1: Change Language

Test 2: Change Text-to-Speech

Test 3: Change Speech Rate

Test 4: Change Contrast

Test 5: Change Text Size

Test 6: Change Letter Spacing

Test 7: Change Line Spacing

Test 8: Change Captions

Test 9: Change Show Sounds

Test 10: Change Onscreen Keyboard

Test 11: Sticky Keys - Valid Entry

Test 12: Sticky Keys - Invalid Entry - Enabled

Test 13: Sticky Keys - Invalid Entry - Disabled

Test 14: Press 'h' for help

Test 15: Page Reload

Test 16: Reset

Boundary Tests

________________________________________________________

Description
Ensures proper functionality at the input limits

Protocol
Perform these tasks on the following site.

  1. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=electron
  2. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=search

Test 1: Language - Scroll to the Top

Test 2: Language - Scroll to the Bottom

Test 3: Self Voicing - Enabled

Test 4: Self Voicing - Disabled

Test 5: Speech Rate - Maximum

Test 6: Speech Rate - Minimum

Test 7: Text Size - Maximum

Test 8: Text Size - Minimum

Test 9: Letter Spacing - Maximum

Test 10: Letter Spacing - Minimum

Test 11: Line Spacing - Maximum

Test 12: Line Spacing - Minimum

Test 13: Captions - Enabled

Test 14: Captions - Disabled

Test 15: Show Sounds - Enabled

Test 16: Show Sounds - Disabled

Test 17: Onscreen Keyboard - Enabled

Test 18: Onscreen Keyboard - Disabled

Test 19: Sticky Keys - Enabled

Test 20: Sticky Keys - Valid Entry

Test 21: Sticky Keys - Disabled - Invalid Entry

Test 22: No Changes

Test 23: All Preferences Changed

Ad-hoc

________________________________________________________

Description
Tests which should cause errors or not be accepted as input

Protocol
Attempt to use the tool in various situations, using your imagination and freedom to explore the interface and interactions.

  1. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=electron
  2. http://first-discovery.mybluemix.net/demos/prefsServerIntegration/index.html?preview=search