Bug #80800
closedToo many records on sys_file_reference table breaks TYPO3 when saving IRRE records
100%
Description
When saving a record (eg: tx_news_domain_model_news) and uploading images on field with IRRE of FAL records (eg: fal_media) the database will generate lots of UPDATES on the sys_file_reference table, breaking it when this table is too big (250k+ records).
The reason for that is that the resorting method of TYPO3's Data Handler (sysext/core/Classes/DataHandling/DataHandler.php) verifies if there is a "sortby" configuration on the table's TCA, which, in the case of sys_file_reference, is the field "sorting". The resorting method is useful to recalculate the order of the record on a PID using the "sorting" field.
However, unless i'm wrong, there are no places on TYPO3 CMS where sys_file_reference records are listed, so this configuration is useless for this table. Setting it to empty string solves the problem and apparently has no side effects.
Version: TYPO3 7.6.16
Updated by Thomas Hohn over 7 years ago
- Status changed from New to Needs Feedback
Please provide information about TYPO3 version - if it 8.7 - did you follow all the migrations steps in the install tool?
Updated by José Ricardo over 7 years ago
Sorry, forgot it. It's 7.6.16 (i've updated the description as well).
Updated by Thomas Hohn over 7 years ago
Hi
Had similar issues on a installation. Our fix was rebuild the ref_index since it contained a lot of crashed records. And
then we started to use https://github.com/NamelessCoder/asynchronous_reference_indexing since we had
similar issues.
Updated by José Ricardo over 7 years ago
Gonna look the plugin, but the question is why sortby is necessary for sys_file_reference?
Updated by Sascha Egerer over 7 years ago
- Related to Bug #80875: Multiple problems with relation handler if too many records exist on a page added
Updated by Alexander Opitz about 7 years ago
- Status changed from Needs Feedback to New
Updated by Stephan Großberndt about 7 years ago
- Related to Task #48098: Reversed order in sorting field in sys_file_reference compared to e.g. tt_content added
Updated by Stephan Großberndt about 7 years ago
- Status changed from New to In Progress
- Priority changed from Should have to Must have
- TYPO3 Version changed from 7 to 9
Updated by Gerrit Code Review about 7 years ago
- Status changed from In Progress to Under Review
Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 9 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 10 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Gerrit Code Review about 7 years ago
Patch set 11 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54342
Updated by Susanne Moog almost 7 years ago
- Sprint Focus set to On Location Sprint
Updated by Gerrit Code Review almost 7 years ago
Patch set 1 for branch TYPO3_8-7 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/54840
Updated by Stephan Großberndt almost 7 years ago
- Status changed from Under Review to Resolved
- % Done changed from 0 to 100
Applied in changeset 8da63a4521d684c84607558026fcf708cdd11e09.
Updated by Stephan Großberndt almost 7 years ago
- Category set to File Abstraction Layer (FAL)
Updated by Stephan Großberndt almost 7 years ago
- Related to Bug #83160: Remove unused column sys_file_reference.sorting added