CI-Pipeline for performance test

Maurice Zimmnaurequested to merge
feature/CI_build_perf into main

Description

This is a first prototype for the black-box test documented in the documentation

Related Issue(s)

Other Changes

  • Now, assuming that the design_evaluator configs are written for a respective module, it will be tested.
  • Probably for a non-existing config at least the last stage will fail
  • It is possible, that you get a notification via mail, about your test status once it has been executed.

Screenshots/Logs

Testing Instructions

  1. Checkout a branch, where you have a tool modification
  2. Merge the changes from branch feature/CI_build_perf into your feature branch (to get the pipeline settings)
  3. Push your feature branch to origin
  4. Go to your commit on the gitlab page
  5. Look for the test running -> should look something like this, when its running:

image

Developer Checklist

  • Code has been tested locally and/or in pipeline.
  • (if applicable) documentation updated.
  • (if applicable) impact of new dependencies reviewed and included in project.
  • Merge conflicts resolved with the target branch.

Additional Notes

  • The pipeline has 3 stages: Setup, build and run
  • It runs on gitlab-runners
  • Currently code is compiled, tested and executed in a UNIX environment

Merge request reports