Application Testing: Results

Overview

Viewing details

PDF report

Email report

Results page

Overview

When an Application Test is completed, you can start looking at the results. For this, in the Login Enterprise sidebar menu > Results, navigate to Application testing.

Frame 248 (1).png

When clicked, you are presented with a list of previously executed Application Tests. The columns display various information, such as:

  • Time - Displays the date and time of the test.
  • Name - Displays the name and sequence number of the test.
  • App. Failures - Shows the number of applications that failed relative to the total number of applications tested.
  • App. Perf - Indicates how many measurements were out of bounds compared to the configured thresholds. The number on the right shows the total number of configured measurements.
  • Comment - Displays the configured comment for the test.

You can also download the report as a PDF and/or delete the test results.

Frame 250.png

To view a summary of the test, click the arrow button next to each test result to expand it.

Frame 249.png

Viewing details

As shown in the example, you can view the details of the three events that took place during the test. Clicking on an event opens a popup with more details and provides the option to explore further.

Frame 251.png

As shown, for application errors, you can click to expand the details, click the download button to download the log file or click the camera icon to open the screenshot, if applicable.

PDF report

If you download the PDF file or open it via the email report, you will see a report containing the following items:

  • Test summary - Displays the application's success and performance.
  • Platform summary - Displays the performance summary of the measurements taken.
  • Configuration - Displays the configuration of the executed test.
  • Application summary - Lists the executed applications, indicating which were successful and which were not.
  • Applications in more detail - Provides detailed information about each application, including measurements and their compliance with defined thresholds. If an issue occurs, a screenshot is included.

Attached to this article, you can find a PDF file attached of an example Application Testing report. 

Email report

After the Application test concludes and email settings are configured, you receive an email notification containing details of the test run, with the PDF report attached. To learn how to configure notification types, including that of email, see Notifications.

mceclip4.png

Results page

You can select one Test and click View or select multiple Tests and click Delete.

Frame 574.png

Currently, comparing Tests is not supported. When you select more than one Test, the View button will be disabled.

Platform summary

  • Logon performance
    • Actual: The actual time it took to log in.
    • Threshold: The login time threshold set in the test.
    • Execution: Green if the login was successful, regardless of the time taken.
    • Performance: Green if the actual login time was below the threshold or if no threshold was set; red if the actual time exceeded the threshold.

For more information on the Login performance, see Measuring total login time.

  • Latency
    • Actual: The actual latency in milliseconds (ms).
    • Threshold: The latency threshold set in the test, in milliseconds (ms).
    • Execution: Green if latency was measured; red if no latency could be measured.
    • Performance: Green if the actual latency was below the threshold or if no threshold was set; red if the actual latency exceeded the threshold.

To learn more about the Latency, see Monitoring Latency.

Frame 575.png

Application summary

  • Application(s)
    • Execution: Green if the script was successfully executed; red if the script had a failure during the execution.
    • Performance: Green if all measurements/timers in the script were below the threshold or if no threshold was set; red if one or more measurements exceeded the threshold.
    • Screenshot: If a screenshot was taken, click the camera icon to open a popup displaying the screenshot. If multiple screenshots are available, arrows will appear in the popup to navigate through them. A download button is also available to save the screenshot on your desktop.
  • Measurements (Timers)
    • Actual: The actual time recorded for the measurement.
    • Threshold: The threshold set in the test for the specific measurement.
    • Status: The status indicator is green if the actual time is below the threshold or if no threshold is set; it is red if the actual time exceeds the threshold.

By default, the measurements (timers) include the app start time, which is automatically recorded when the START function in the workload scripts is executed. This function is used by default to launch target apps. Additionally, any custom timers defined in the workload scripts will also be displayed in the UI.

To learn how to configure custom timers, see the Scripting functions.

Frame 576.png

You can also retrieve Application Testing results through the API. For information on how to access the Public API from Login Enterprise, see Accessing the Public API.