Collect coverage / reports / visualizations for additional jobs
We are now collecting the coverage of unittests, which is very important. Strangely the pipelines often show this as average of 0 jobs - which could become another task. We can also collect / upload unit test reports https://git.rwth-aachen.de/help/ci/testing/unit_test_reports.md
There are also packages for code coverage:
https://coverage.readthedocs.io/en/coverage-5.0.4/index.html
which generate reports in a standardized format (code climate report /
https://docs.gitlab.com/ee/ci/testing/test_coverage_visualization.html
Code quality:
There's an template that can be imported, similar to the security one: https://docs.gitlab.com/ee/ci/testing/code_quality.html#example-configuration
https://pypi.org/project/pylint-gitlab/
Its even possible to create a job, that checks whether the coverage decreased and fails in that case: https://rpadovani.com/gitlab-code-coverage
Further things to look into:
- pep8/flake8 report
- Consolidate all information about CI jobs and stages we create into a document for later reference / publication.