Load Testing: Comparison

Starting in Login Enterprise 4.5, you are able to directly compare two Load Testing results sets. Click the check boxes corresponding to the two tests that you wish to compare, and then click the “Compare” button at the bottom right of the table.

Performance Comparisons

You will be presented with high level comparisons of the two tests, with the older test serving as the basis for the comparison. You can quickly review the difference in logon performance, application performance, and the changes in EUX Score and VSIMax.

When compared tests were executed with different Login Enterprise versions, you will be presented with a note. A note will also be shown when there is more than a 20% change across test executions.

As of release 4.9.10, you can swap the test being used as the basis for comparison. Click the arrow icon to reverse the comparisons. In other words, the A vs. B comparison will become B vs. A comparison.

(Comparison view prior to 4.9.10 without ability to swap)

End-User Experience Data

As of release 5.1, "EUX / VSIMAX METRICS" are shown by default once a comparison is opened. You can use the check boxes to select or deselect specific EUX timers, which will add or remove them from the chart.

For more information on the EUX Score, see this article.

Visualization Options

The chart options and visualizations are the same as when Load Testing Results are analyzed in isolation. For more information on Load Testing Results, see this article.

Login Performance

When comparing results, a tabular view is also presented for the components that comprise Total Login Time. The percent difference is shown for each. Each value is shown as the average during the test execution, in seconds.

Application Performance

A similar tabular view is shown for each application included in the test execution. The percent difference is shown for each action, per application. Use the arrows next to each application name to expand the entry and view its timer results. Each value is shown as the average during the test execution, in seconds.