Ensure that all test cases are executed at least once #740

New issue

Open

opened 2026-04-06 15:08:57 -05:00 by gilles-peskine-arm · 0 comments

gilles-peskine-arm commented

2026-04-06 15:08:57 -05:00

(Migrated from github.com)

Out of scope: Windows; FreeBSD; different processor architectures; readthedocs; metatests; demos; considerations about unit tests beyond running them in at least one configuration.

Definition of done: IGNORED_TESTS in tests/scripts/analyze_outcomes.py (added by https://github.com/Mbed-TLS/TF-PSA-Crypto/pull/729) is empty. Any new element in UNCOVERED_TESTS must be properly justified and tracked.

TF-PSA-Crypto should be autonomous for testing. That is, it should able to test itself, rather than relying on Mbed TLS for testing. The goal of this issue is that the testing done in `all.sh` should run every test case at least once, with a small number of justified and tracked exceptions, as is the case in Mbed TLS since https://github.com/Mbed-TLS/mbedtls/issues/2691. Out of scope: Windows; FreeBSD; different processor architectures; [readthedocs](https://github.com/Mbed-TLS/TF-PSA-Crypto/issues/279); metatests; demos; considerations about unit tests beyond running them in at least one configuration. Definition of done: `IGNORED_TESTS` in `tests/scripts/analyze_outcomes.py` (added by https://github.com/Mbed-TLS/TF-PSA-Crypto/pull/729) is empty. Any new element in `UNCOVERED_TESTS` must be properly justified and tracked. Related: https://github.com/Mbed-TLS/TF-PSA-Crypto/issues/57

No milestone

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

gh-Mbed-TLS/TF-PSA-Crypto#740

No description provided.

Rows
Columns