EUX Score 

As of the 4.11 Login Enterprise release, the 2023 EUX Score (End User Experience Score) represents the performance of any windows machine (virtual, physical, cloud or on premises) and ranks it between 0 and 10 as experienced by the virtual user. The EUX score can be determined with any number of users (1 and up).

In the case of VDI systems with shared hardware, the EUX Score will decrease as more users are added to the platform as performance will go down as systems get more crowded. 

**See the bottom of this page for a quick note about our 2023 EUX Score that is built into our 4.11 release and how it may be different from our 2021 EUX Score Preview** 

Determining the EUX score 

The EUX score is built up from several actions, or timers, that reflect typical user operations that we found correlate well with a human users experience while working on the system. These actions allow us to measure application responsiveness, keyboard input processing, CPU heavy actions and storage I/O latency.

In addition to these actions, the EUX Score for load testing also accounts for application and session failures, and will reduce the score when these events happen.

See below for more information on the 2023 EUX Timers

VSIMax 

The VSIMax defines the EUX tipping point of your system. If you go beyond the VSIMax your EUX Score will start to degrade significantly.  

As explained above, the EUX performance input metrics were chosen to reflect the user experience. In addition to this we carefully chose and tuned the timers to also reflect the load that a virtualization system experiences when increasing the number of sessions that run on that system. 

VSIMax is triggered when the user experience dips below a certain value. We determined two criteria for this threshold: 

• An absolute value, which indicates at which point the experience starts to degrade 
• A relative value, based on the performance of the system when it is running optimally 

The reason for the absolute value is obvious. The second criterion needs more explanation.  

We ran capacity planning experiments on several systems with different configurations. A recurring pattern was found in nearly all test results. While adding more sessions, at a certain point the performance starts to degrade very rapidly. Ideally you want VSIMax to be triggered before the point of that collapse, or just when it starts to happen. To determine this point, the second criterion proved to be more reliable. When correlating our results with the hypervisor’s internal metrics, we found that at around 85% of the initial EUX score, we are at the point where we are generating too much load. Even though the exact percentage did vary in between systems, we found that 85% was a good general number to base VSIMax on. 

Calculation of VSIMax 

The VSIMax score is calculated in two steps. The first step determines the threshold from which to compare the EUX to as it changes over time. The second step determines the number of sessions that were running when we crossed that threshold. 

Step 1: Determining the Threshold 

The baseline represents the EUX score when the system under test is running without any load. The closest we get to that state, the better. To that end, we use the EUX score of the median response times. 

To find the baseline, we scan the complete test run to determine the five consecutive minutes with the highest average. That average is the score we use as the baseline. We record where that took place as the starting point for the next step. 

Step 2: Determining the VSIMax 

In this step we are looking at which point the EUX score falls below the threshold found in the previous step for three consecutive minutes. The threshold will be set to 85% of the average that was found in the previous step or 5.5, whichever is highest. 

We use the EUX score as our input. We return the session count that was found at the start of the stretch of three minutes where we dipped below the threshold. 

If we encounter any missing data after we find our baseline, the result cannot be interpreted, and we will not get a VSIMax score. 

2021 EUX Score Preview (prior to Login Enterprise 5.0)

If you are an existing customer and have been using the 2021 EUX Score (Preview), here is some more information about what you can expect from our new 2023 EUX Score. If you are interested in enabling the new 2023 EUX Score on your virtual appliance please email us at support@loginvsi.com. 

In 2021 we released our EUX Score Preview, which was widely adopted and used by our customers. Since the release of our EUX score, we have listened to your feedback and used it to help us build our roadmap for the future. Login Enterprise 4.11 includes much of that feedback, and more, in our new 2023 EUX Score.

Because there may be some variation between the 2021 EUX Score Preview and the 2023 EUX Score, we have kept the 2021 EUX Score enabled in 4.11 but will provide you with ways to enable the new 2023 EUX Score in order for you to compare with your existing results to see if there are in fact any variations. While we cannot predict how it will be different for each customer, we do have some high-level guidance on what you can expect.

• Systems with software security products are expected to receive a higher score in EUX2023. We found that the impact of several of these products on the EUX2021 score was too high when comparing it too real user perceived performance
• Systems with poorly performing storage solutions are expected to receive a lower score. We found that EUX2021 was too forgiving towards slow disk IO, resulting in higher scores than the real user’s perceived performance.
• When running tests on high performance system with fast, low latency storage and a system that does not run many background services, you can expect higher scores.
• As CPU resource contention increases the new score will start to drop faster.

Please note that we will enable the 2023 EUX Score as the default EUX Score in our next release.