Skip to main content

Ready to market your stellar app?

Samsung Developer Program is your gateway to app monetization success.

Learn More

Samsung Developer Program

Test Results Summary

When 1 or more AAT test modules are requested to be run, a summary.xml file is generated that contains details of the overall test suite (test app and device information, and test summary data), and result summaries for each test module that was run, with links to detailed test module results.  The detailed results pages of some test modules contain links to detailed logs or attachments.  When in a detailed results page, click the 'Summary' link or the browser back button to return to the summary page.

Test_Results_Summary.png  

 

Test Information

Tester

Name of the person who created the AAT ticket

Email

Email address of the person who created the AAT ticket

Test Title

Title ([device model name _[app package name]) assigned to the test suite that was run

Test Profile

How the AAT request was generated:

web-portal         Requested via the SDP portal.

Ticket ID

Unique identifier assigned to the AAT ticket associated with the test report

Total Test Cases

Total number of test cases that were run

Passed Test Cases

Total number of test cases with test criteria that were run and the app successfully met all test case criteria

Failed Test Cases

Total number of test cases with test criteria that were run and the app did NOT meet at least 1 test case criterion

Condition Test Cases

Total number of test cases with descriptive results (NOT pass / fail criteria) that were run

Blocked Test Cases

Number of test cases that could not be run because an internet connection could not be established OR the test device could not connect to the test server

Date & Time
(Start ~ End)

Date of testing (YYYY-MM-DD) and the start and end times (hh:mm:ss ~ hh:mm:ss)

 

Device Information

Device Model

User device model that the test module was run on

Software Version

Build number

Screen Size

Dots-per-inch (DPI) of the device display

Resolution

In upright portrait orientation, the horizontal width and vertical length (pixels x pixels) of the device display

OS

Name and version of the device OS

 

App Information

Application Source

How the app was provided to AAT testing:

Downloaded from Galaxy Apps         As stated.

Downloaded from Google Play         As stated.

Sideloaded                                           Attached by the tester.

Package ID

Package name of the application

 

Summary Results by Test Module

Test Module

Name of the AAT test module that was run

This link leads to the detailed test results for the test module.

For each test module run:

        Total

Number of test cases in the test module that were run and produced complete results (passed, failed, or condition), or produced partial or no results (blocked).

        Status

Current state of testing the app via the test module:

Completed     All testing has finished.

        Passed

Number of test cases where the app successfully met all test case criteria

        Failed

Number of test cases where the app  did NOT pass at least 1 test case criterion

        Condition

Number of test cases that determined whether or not the purpose of the test case was accomplished the (for example, that app memory usage was measured)

        Blocked

Number of test cases that could not be completely run because necessary connections could not be established, were interrupted, or terminated

  • Was this article helpful?