Task #91058
closed
reduce amount of tests in nightly runs
100%
Description
We tried with a wide variety of tests, covering all kind of combinations of PHP version, DBMS, composer install levels and drivers, but the resulting number of tests brought the testing infrastructure to its knees.
We saw test runs longer than 6 hours, and most of the time they did not even finish.
In order to get a step closer to stable nightly test runs, the number of tests is reduced again, with focus to good coverage of all permutations, but without 'runnung everything with everything'.
Updated by Gerrit Code Review over 4 years ago
- Status changed from New to Under Review
Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/64152
Updated by Gerrit Code Review over 4 years ago
Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/64152
Updated by Anja Leichsenring over 4 years ago
Here is the current test matrix
DBMS mysql mssql sqlite postgreSQL
PHP
7.2 [I] A- F-(mysqli) F-(pdo) I+ I- F+
7.3 A+ F+(pdo) F+(srv) I- I
7.4 A F(mysqli) F(srv) I F I+ F-
Unit tests run across all PHP versions and composer stages.
+ means composer max
- means composer min
A means acceptance tests
I means install tests
F means functional tests
[I] means installation tests for all composer stages
pdo, mysqli and srv are the drivers for the DBMS, where we test more than one.
Updated by Gerrit Code Review over 4 years ago
Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/64152
Updated by Anja Leichsenring over 4 years ago
DBMS mysql mssql sqlite postgreSQL
PHP
7.2 [I] A- [F] F-(pdo) I+ I- F+
7.3 A+ [F] F+(srv) I- I
7.4 A [F] F(srv) I F I+ F-
Updated by Gerrit Code Review over 4 years ago
Patch set 1 for branch 9.5 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/64289
Updated by Anja Leichsenring over 4 years ago
- Status changed from Under Review to Resolved
- % Done changed from 0 to 100
Applied in changeset bc5a8f7108f2dd0a0e3aa39726eb730e83d917f4.
Updated by Andreas Kienast over 4 years ago
- Related to Bug #91209: JavaSpec of 9.5 nightly builds has a merge conflict added
Updated by