Skip to content

Run Regression Tests

What is Regression Testing?

Regression Testing is a type of testing that is done to verify that a code change in the software does not impact the existing functionality of the product. This is to ensure that the product works fine with new functionality, bug fixes or any changes to the existing feature. Previously executed test cases are re-executed in order to verify the impact of the change.

How To Run Regression Tests

  • Ensure that you already signed in with azure. You can login with az login
  • Ensure that you already updated nuget packages.
  • Ensure that you already have latest version of be-configuration repository in the your projects folder. For example if you want to run user area regressions then your directory structure will look like this:
    • projects
      - be-user repository
      - be-configuration repository
      - be-mf-configuration repository from the MoneyFlow project when you run the remittance regression tests.
  • Go to Environment Variables -> System Variables create new variable with ASPNETCORE_ENVIRONMENT name:
    • You can set it to Test if you want run regression tests under development area
    • You can set it to Staging if you want run regression tests under stage area
    • You can set it to Development as default for all other types of local testing
  • Connect to the VPN (Cloudflare WARP)
  • You now can run the Regression Tests

Problems & Solutions

  • If you get Forbidden about accessing a key-vault, you should add your IP address to related key-vault network allowed IPs. (Puneesh - another solution to keyvault access would be to add a hostfile entry for keyvault and resolve it to private endpoint IP. Then you dont have to open your public IP. If you open a public IP, the terraform will remove it everytime it runs. So better solution is to add a hostfile entry)
  • If you use the Resharper test runner in Visual Studio, it will use the values of environment variables when the session was created. That means you need to create a new test session if you change any variables, i.e. from Development to Staging.