Testing Methodology

Seven test categories, applied on named hardware. Where a result has not been produced, the scorecard says so.

Test categories

CategoryWhat it coversStatus
Installation testInstall path, error handling, permission promptsNot yet tested
Compatibility testBehaviour across phone, tablet and TV form factorsNot yet tested
Performance testStartup time, channel switch time, playback stabilityNot yet tested
UI testNavigation, D-pad reachability, accessibility of controlsNot yet tested
Stability testCrash frequency over a sustained sessionNot yet tested
Permission reviewManifest permission audit against stated functionNot yet tested
Update reviewUpdate mechanism, signature continuity, data retentionNot yet tested

How results will be reported

  • The device model, Android version and app version string used.
  • The date of the test.
  • The observed result, stated plainly, including failures.
  • Any condition that would make the result non-reproducible.