Manage Tests: Continuous Testing

Note: Launcher groups and Account groups are required to be configured. On our Accounts and Launcher page you can find on how to do that.

With Login VSI Enterprise there are three test scenario's you can use, Continuous, Application and Load testing. This article describes the Continuous testing configuration. 

On the Manage test page click on "Add new environment" under the "Continuous testing" section.

Info

When pressed an new page appears where you can configure:

• Environment Name
  • We recommend giving it a logical name that makes it easy to identify. 
• Connector type
  • There are a number of different connectors for more information about the connector configurations click here. 
• Description of the environment
  • Give a simple description of the configured environment.

Once you select the preferred connector type a list appears below the configuration. Fill in the required fields and click the save button. 

Click on the Accounts or Launchers link for more info about grouping / configuration.

Schedule

When you have configured the Info section, you can start configuring the schedule, the schedule consists of when you want to to run the continuous tests. As for the scheduling you can select 2 options;

• Log in every X minutes
• Run concurrent session(s)
• Run a session from each launcher every X minutes

The difference between these options is that with the "Log in every X minutes" a virtual user will log in to the environment, run the test, and log of. It will then wait for the configured amount of time and do the same actions again. With the "run concurrent session(s)" option, the users will keep logging in, do the actions that are defined and log out. However, they will not wait for a set amount of time and will re-start immediately after logging out. When choosing for "Run a session from each launcher every X minutes" it will launch one session from every launcher configured for the environment within the specified time frame.

In the Schedule you can also select the schedule type, you can choose out of the following options:

• Always on
• Daily schedule
• Weekly schedule
• Run a session from each launcher every

Always on will keep the virtual user running continuously and indefinitely. The enable switch is grey it will not launch sessions, once clicked it will become green and start launching sessions. If you are newly creating the environment it might be best to leave it disabled until you have completely configured the new environment.

Daily schedule will show you the option of selecting the hours where you want the virtual user to run. By dragging you can select a large area or simply click on the bars. Each bar represents 15 minutes. 

As for the Weekly schedule, it works similarly to the Daily schedule but you can configure a week in advance. This is a great feature if you have a weekly reboot / maintenance window in which you do not the Virtual user to run. Again each bar represents 15 minutes.

Custom Screenshots

The schedule also give you the possibility to enable the Custom Screenshots feature. This will give you the possibility to take screenshots at specified steps in application scripts. This is done with the screenshot functionality, more can be found in our scripting function page. This will also work for your Application Testing. In Application testing you won't find the option to enable this feature, that is because it is enabled by default (core feature). The scripting method ("TakeScreenshot()") applies here aswell.

Actions

When the schedule has been configured you can add the preferred applications you wish for the Virtual user to test. To do this select the "Add applications button"

You are presented with the list of applications that are available in the Login Enterprise appliance. To learn more about applications and how to create / add them click here.

In this window you can select multiple applications and search for them in the upper right of the window. Once you are satisfied with the selected applications you can select save to save and exit.

When the items are added you can see a similar list as showed in the below image. You can reorder applications in the Actions menu. You can do this by clicking on the application drag and drop area and organize them in the order you want Login Enterprise to run the applications. "Wait" Action(s) can also be added to you preferred setup and also between applications.

 

From Login Enterprise 4.6 and higher you have the option to configure "leave applications running" or "run once" for an application. The Leave Application running feature does not close the application and the run once feature will only run the script once. For more information about this feature please see this page. This feature is not applicable to webscripts. 

Notifications and Thresholds

When you have finished the action list, you can start with adding notifications to the environment. The notifications will alert you when a certain threshold has been crossed. In short the idea is that you are notified once an application or measurement is behaving out of the ordinary. 

There are 4 session notifications that you can always enable. 

• Login Failure
• Login
• Latency
• Application Failure

The Application notifications can be added manually by selecting the "Add new notification" button, when clicked you see the below image where you can configure the application measurement.

 For more detailed information about the standard notifications / email configurations click here.

Starting the test

If you are satisfied with the action lists and you have launchers and users configured you can now enable the schedule so the continuous testing can begin. You can start this from within the test configuration:

Or from the Manage test overview