Overview
When an Application Test is completed, you can start looking at the results. For this, in the Login Enterprise sidebar menu > Results, navigate to Application Testing.
When clicked, you are presented with a list of previously executed Application Tests. The columns display various information, such as the following:
- Time - Displays the date and time of the test.
- Name - Displays the name and sequence number of the test.
- App. Failures - Shows the number of applications that failed relative to the total number of applications tested.
- App. Perf - Indicates how many measurements were out of bounds compared to the configured thresholds. The number on the right shows the total number of configured measurements.
- Comment - Displays the configured comment for the Test.
You can also download the report as a PDF and/or delete the Test results.
To view a summary of the Test, click the arrow button next to each Test result to expand it.
Viewing details
As shown in the example, you can view the details of the three events that took place during the Test. Clicking on an event opens a pop-up with more details and provides the option to explore further.
As shown, for application errors, you can click to expand the details, click the download button to download the log file or click the camera icon to open the screenshot, if applicable.
PDF report
If you download the PDF file or open it via the email report, you will see a report containing the following items:
- Test summary - Displays the application's success and performance.
- Platform summary - Displays the performance summary of the measurements taken.
- Configuration - Displays the configuration of the executed Test.
- Application summary - Lists the executed applications, indicating which were successful and which were not.
- Applications in more detail - Provides detailed information about each application, including measurements and their compliance with defined thresholds. If an issue occurs, a screenshot is included.
Attached to this article, you can find a PDF file of an example Application Testing report.
Email report
After the Application Test concludes and email settings are configured, you will receive an email notification containing details of the Test Run, with the PDF report attached. To learn how to configure notification types, including that of email, see Notifications.
Results page
Single Application Test
To view the Test results for a single Application Test, select a Test and click View. The Results overview page will display the Platform summary and Application summary for the selected Test.
You can also compare Application Tests by selecting checkboxes for multiple Tests. For details, see Comparing multiple Application Tests.
Platform summary
-
Logon performance
- Actual: The actual time it took to log in.
- Threshold: The login time threshold set in the Test.
- Execution: Green if the login was successful, regardless of the time taken.
- Performance: Green if the actual login time was below the threshold or if no threshold was set; red if the actual time exceeded the threshold.
For more information on the Login performance, see Login performance.
-
Latency
- Actual: The actual latency in milliseconds (ms).
- Threshold: The latency threshold set in the Test, in milliseconds (ms).
- Execution: Green if latency was measured; red if no latency could be measured.
- Performance: Green if the actual latency was below the threshold or if no threshold was set; red if the actual latency exceeded the threshold.
To learn more about the Latency, see Monitoring Latency.
Application summary
-
Application(s)
- Execution: Green if the script was successfully executed; red if the script had a failure during the execution.
- Performance: Green if all measurements/timers in the script were below the threshold or if no threshold was set; red if one or more measurements exceeded the threshold.
- Screenshot: If a screenshot was taken, click the camera icon to open a popup displaying the screenshot. If multiple screenshots are available, arrows will appear in the popup to navigate through them. A download button is also available to save the screenshot on your desktop.
-
Measurements (Timers)
- Actual: The actual time recorded for the measurement.
- Threshold: The threshold set in the Test for the specific measurement.
- Status: The status indicator is green if the actual time is below the threshold or if no threshold is set; it is red if the actual time exceeds the threshold.
By default, the measurements (timers) include the app start time, which is automatically recorded when the START function in the workload scripts is executed. This function is used by default to launch target apps. Additionally, any custom timers defined in the workload scripts will also be displayed in the UI.
To learn how to configure custom timers, see the Scripting functions.
You can also retrieve Application Testing results through the API. For information on how to access the Public API from Login Enterprise, see Accessing the Public API.
Multiple Application Tests
You can select up to five Application Tests to compare.
Options for comparison
- Select a baseline Test: Choose a baseline Test to which the other Application Tests will be compared.
- Add/Remove Tests from comparison: Use the checkboxes to add or remove Application Tests from the comparison.
Results overview
The results are divided into two parts, just like for a single Application Test:
- Platform summary: This section displays the login time and latency, along with the percentage difference between the compared Tests. For details, see the Platform summary.
- Application summary: This section compares the results of the Application scripts. For details, see the Application summary.
Notes and considerations
- The results of the baseline Test are pinned in the first column. The other Test columns are sorted from oldest to newest.
- If the results do not fit the screen, scrollbars will appear in the table. The Baseline Test column remains pinned and does not move with the scrollbar.
- The results of the Baseline Test are the primary reference. All Applications and timers from the baseline are displayed. If a selected Test has additional Applications or timers not present in the Baseline Test, those will only be shown when that Test is designated as the baseline.
- The PDF report for the multiple Application Test comparison isn’t available yet.
- App Testing 1.4.pdf100 KB