Task #91058
closed
reduce amount of tests in nightly runs
Added by Anja Leichsenring over 4 years ago.
Updated over 4 years ago.
Description
We tried with a wide variety of tests, covering all kind of combinations of PHP version, DBMS, composer install levels and drivers, but the resulting number of tests brought the testing infrastructure to its knees.
We saw test runs longer than 6 hours, and most of the time they did not even finish.
In order to get a step closer to stable nightly test runs, the number of tests is reduced again, with focus to good coverage of all permutations, but without 'runnung everything with everything'.
- Status changed from New to Under Review
Here is the current test matrix
DBMS mysql mssql sqlite postgreSQL
PHP
7.2 [I] A- F-(mysqli) F-(pdo) I+ I- F+
7.3 A+ F+(pdo) F+(srv) I- I
7.4 A F(mysqli) F(srv) I F I+ F-
Unit tests run across all PHP versions and composer stages.
+ means composer max
- means composer min
A means acceptance tests
I means install tests
F means functional tests
[I] means installation tests for all composer stages
pdo, mysqli and srv are the drivers for the DBMS, where we test more than one.
DBMS mysql mssql sqlite postgreSQL
PHP
7.2 [I] A- [F] F-(pdo) I+ I- F+
7.3 A+ [F] F+(srv) I- I
7.4 A [F] F(srv) I F I+ F-
- Status changed from Under Review to Resolved
- % Done changed from 0 to 100
- Related to Bug #91209: JavaSpec of 9.5 nightly builds has a merge conflict added
- Status changed from Resolved to Closed
Also available in: Atom
PDF