Skip to end of metadata
Go to start of metadata

This testing grid is intended to act as a set of actions which are to be attempted in a number of different environments (read: hardware and software combinations) in order to ensure broad compatibility and continued functionality of the Storytelling Tool. If the tool changes such that the devices listed are no longer supported, new functionality is added, or the list in some other way no longer accurately reflects real-world usage of the Tool, please feel free to make contributions to the grid.

When a particular device is able to pass a sequence, the applicable cell in the grid is to be marked "Pass" and the background colour changed to green (Confluence offers some quick cell background choices in its editing tools). If the device does not pass a particular sequence, the cell is to be marked "Fail" and the background set to red. If the test is completed but has issues, the cell is to be marked "Issues" and the background set to yellow. Where the sequence is not applicable, e.g. on a desktop where camera capture isn't an option, the cell is to be marked "N/A" and the background set to blue. If a particular device or sequence has not been tested, simply leave it blank.

The devices and software versions listed are based on what is currently available for use by staff at the IDRC, and though it should not necessarily be seen as prescriptive, reasonable attempts should be made to access these when testing.


Grid last updated:
October 8, 2019

Tests last completed: October 8, 2019


Action sequences:

  1. Story Builder: User is able to publish a story with no blocks and no other fields filled in
  2. Story Builder: User is able to publish a story with one empty block of each type and no other fields filled in (empty, but with empty blocks too)
  3. Story Builder: User is able to publish a story with two text blocks
  4. Story Builder: User is able to publish a story with two image blocks, both images uploaded from the file system*
  5. Story Builder: User is able to publish a story with two image blocks, both images captured from the device*
  6. Story Builder: User is able to publish a story with two image blocks, one image captured, one image uploaded*
  7. Story Builder: User is able to publish a story with two audio blocks, both files uploaded from the file system*
  8. Story Builder: User is able to publish a story with two audio blocks, both files captured from the device*
  9. Story Builder: User is able to publish a story with two audio blocks, one file captured, one file uploaded*
  10. Story Builder: User is able to publish a story with two video blocks, both files uploaded from the file system*
  11. Story Builder: User is able to publish a story with two video blocks, both files captured from the device*
  12. Story Builder: User is able to publish a story with two video blocks, one file captured, one file uploaded*
  13. Story Builder: User can publish a story with one block of each type and all the fields filled in
  14. Story Builder/Viewer: Listening to the story with the Orator plays the story completely both in the Story Preview and on viewing a published story and highlights text as it reads
  15. All pages: Imagery in the editor changes along with UIO contrast theme changes

* for the sequences that require two images, videos, audio files, etc. the intent is that these files be different from one another. I.e. for two uploaded images, make sure they're different images.


Device NameOS & VersionBrowser & Version

1

23456789101112131415
Apple iPad Mini 2iOS 12.3.1SafariPassPassPass

Issues

(6, 13)

Issues

(6, 14)

Issues

(6, 13)

Issues

(13)

Pass

Issues

(13)

Issues

(13)

Pass

Issues

(13)

Issues

(6, 13)

PassPass
Apple iPad Air 2iOS 12.4SafariPassPassPass

Issues

(1, 6, 13) 

Issues

(1, 6, 14)

Issues

(1, 6, 13) 

Issues

(13)

Pass

Issues

(13)

Issues

(13)

Pass

Issues

(13)

Issues

(6, 13)

PassPass
Apple iPad (6th gen)iOS 12.3.1SafariPassPassPass

Issues

(6)

Issues

(6)

Issues

(6)

PassPassPassPassPassPass

Issues

(6)

PassPass
Apple iPod touch (6th gen)iOS 11.4.1SafariPass

Fail

(15)

Pass

Issues

(6)

Issues

(6, 14)

Issues

(6)

PassPassPassPassPassPass

Issues

(6)

PassPass
Lenovo P52Windows 10 Pro build 1903Chrome 77PassPassPassPassN/AN/APassN/AN/APassN/AN/APassPassPass
Lenovo P52Windows 10 Pro build 1903Firefox 69Pass

Issues

(6)

Pass

Issues

(6)

N/AN/APassN/AN/APassN/AN/A

Issues

(6)

PassPass
Lenovo P52Windows 10 Pro build 1903Edge 44PassPass

Issues

(3, 4)

Issues

(3, 4)

N/AN/A

Issues

(3, 4)

N/AN/A

Issues

(3, 4)

N/AN/A

Issues

(3, 4)

Issues

(5)

Pass
Lenovo P52Windows 10 Pro build 1903Internet Explorer 11

Fail

(7, 8)

Fail

(7, 8)

Fail

(7, 8)

Fail

(7, 8)

N/AN/A

Fail

(7, 8)

N/AN/A

Fail

(7, 8)

N/AN/A

Fail

(7, 8)

Fail

(9)

Fail

(10)

Google Pixel 3Android 10Chrome 77PassPassPassPass

Issues

(1)

Issues

(1)

PassPassPassPassPassPassPass

Issues

(2)

Pass
Google Pixel 3Android 10Firefox Focus 8

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(11)

Fail

(12)

Pass
Google Pixel 3Android 10Firefox 68Pass

Issues

(6)

Pass

Issues

(1, 6)

Issues

(1, 6)

Issues

(1, 6)

Pass

Fail

(16)

Fail

(16)

PassPassPass

Issues

(1, 6)

PassPass
MacBook Pro (2015)macOS High Sierra 10.13.6Chrome 77PassPassPassPassN/AN/APassN/AN/APassN/AN/A

Issues

(1)

PassPass
MacBook Pro (2015)macOS High Sierra 10.13.6Safari 12.1.1PassPass

Pass

Issues

(1, 6)

N/AN/APassN/AN/APassN/AN/A

Issues

(1, 6)

PassPass
MacBook Pro (2015)macOS High Sierra 10.13.6Firefox 69PassPassPass

Issues

(6)

N/AN/APassN/AN/APassN/AN/APassPassPass


Issues noted in latest pass:

  1. Photos taken in portrait show up rotated 90° CCW when they're added to the uploader and published. This is known and covered by  SJRK-286 - Getting issue details... STATUS
  2. The Orator highlighting does not appear at all. This has been captured in  FLUID-6412 - Getting issue details... STATUS
  3. With all editing tests, the instructions on the editor do not get hidden when the first block is added, they simply get pushed below the editing space. This has been captured in  SJRK-304 - Getting issue details... STATUS
  4. The input field labels do not show up once the field is filled in and placeholder text disappears. This has been captured in  SJRK-305 - Getting issue details... STATUS
  5. The Orator highlighting leaves little bits of the highlighting around the text after it has passed by a given section of text. This has been captured in  FLUID-6407 - Getting issue details... STATUS
  6. Empty Image blocks (with no image selected/uploaded) have a thin border around the placeholder image. This is known and covered in  SJRK-226 - Getting issue details... STATUS
  7. CSS Grid is not supported and so most of the layout is broken, and the masthead is completely missing.
    1. The grid issue is known and covered by in  SJRK-95 - Getting issue details... STATUS
    2. The masthead issue has been captured in  SJRK-306 - Getting issue details... STATUS
  8. The story preview fails to load when clicking "preview my story". This is because the Speech Synthesis API is not supported in IE: https://caniuse.com/#feat=speech-synthesis. This has been addressed in  SJRK-307 - Getting issue details... STATUS
  9. The Orator doesn't work at all for the same reason as above. See that Jira for detail
  10. UIO fails to load. This may also be addressed by SJRK-307
  11. The story preview fails to load, so publishing cannot occur. Likely related to Speech Synthesis API not working, but this cannot be debugged currently. SJRK-307 may provide relief.
  12. The Orator does not work, see above.
  13. Photo library doesn't load sometimes. Capture seems to work fine. This appears to be occurring in apps other than Safari as well and as such may not be solvable.
  14. Captured images in iOS continue to be duplicated. This is known and covered by  SJRK-184 - Getting issue details... STATUS
  15. Story did not publish, "Internal server error" reported, with detail of "Network connection lost". Error occurs when there are empty Image, Audio or Video blocks. This has been captured in  SJRK-308 - Getting issue details... STATUS
  16. Audio capture option is not presented, can only upload. Likely not much to be done about this, as it may depend on Firefox not sending the same Android Intents as Chrome.
  • No labels