Bug #102295
closedTask "Storage Index" has nofile index Limit ends in a Excpection
100%
Description
When I try to execute the task "Storage Index," I get the error: "Data too long for column 'lastexecution_failure' at row 1."
I assume, the NOT IN clause (holding the uids) is too long.
You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for
the right syntax to use near ':dcValue1) AND (`uid` NOT IN (62671, 62672, 62673, 62674, 62675, 62676, 62677...'
at line 1, in file <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:98
- {"class":"TYPO3\\CMS\\Scheduler\\Task\\AbstractTask","uid":6,"exception":"Doctrine\\DBAL\\Driver\\Mysqli\\Exception\\ConnectionError
You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use
near ':dcValue1) AND (`uid` NOT IN (62671, 62672, 62673, 62674, 62675, 62676, 62677...' at line 1 in
<project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/Mysqli/Exception/ConnectionError.php:21\nStack trace:\n
#0 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/Mysqli/MysqliStatement.php(105): Doctrine\\DBAL\\Driver\\Mysqli\\Exception\\ConnectionError::new()\n
#1 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/Mysqli/MysqliConnection.php(152): Doctrine\\DBAL\\Driver\\Mysqli\\MysqliStatement->__construct()\n
#2 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(1301): Doctrine\\DBAL\\Driver\\Mysqli\\MysqliConnection->prepare()\n
#3 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Query/QueryBuilder.php(212): Doctrine\\DBAL\\Connection->executeQuery()\n
#4 <project>/public/typo3/sysext/core/Classes/Database/Query/QueryBuilder.php(300): Doctrine\\DBAL\\Query\\QueryBuilder->execute()\n
#5 <project>/public/typo3/sysext/core/Classes/Resource/Index/FileIndexRepository.php(476): TYPO3\\CMS\\Core\\Database\\Query\\QueryBuilder->executeQuery()\n
#6 <project>/public/typo3/sysext/core/Classes/Resource/Index/Indexer.php(179): TYPO3\\CMS\\Core\\Resource\\Index\\FileIndexRepository->findInStorageAndNotInUidList()\n
#7 <project>/public/typo3/sysext/core/Classes/Resource/Index/Indexer.php(128): TYPO3\\CMS\\Core\\Resource\\Index\\Indexer->detectMissingFiles()\n
#8 <project>/public/typo3/sysext/scheduler/Classes/Task/FileStorageIndexingTask.php(51): TYPO3\\CMS\\Core\\Resource\\Index\\Indexer->processChangesInStorages()\n
#9 <project>/public/typo3/sysext/scheduler/Classes/Scheduler.php(192): TYPO3\\CMS\\Scheduler\\Task\\FileStorageIndexingTask->execute()\n
#10 <project>/public/typo3/sysext/scheduler/Classes/Controller/SchedulerModuleController.php(795): TYPO3\\CMS\\Scheduler\\Scheduler->executeTask()\n
#11 <project>/public/typo3/sysext/scheduler/Classes/Controller/SchedulerModuleController.php(282): TYPO3\\CMS\\Scheduler\\Controller\\SchedulerModuleController->executeTasks()\n
#12 <project>/public/typo3/sysext/scheduler/Classes/Controller/SchedulerModuleController.php(175): TYPO3\\CMS\\Scheduler\\Controller\\SchedulerModuleController->getModuleContent()\n
#13 <project>/public/typo3/sysext/backend/Classes/Http/RouteDispatcher.php(91): TYPO3\\CMS\\Scheduler\\Controller\\SchedulerModuleController->mainAction()\n
#14 <project>/public/typo3/sysext/backend/Classes/Http/RequestHandler.php(110): TYPO3\\CMS\\Backend\\Http\\RouteDispatcher->dispatch()\n
#15 <project>/public/typo3/sysext/core/Classes/Middleware/ResponsePropagation.php(34): TYPO3\\CMS\\Backend\\Http\\RequestHandler->handle()\n
#16 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Core\\Middleware\\ResponsePropagation->process()\n
#17 <project>/public/typo3/sysext/backend/Classes/Middleware/SiteResolver.php(69): class@anonymous->handle()\n
#18 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\SiteResolver->process()\n
#19 <project>/public/typo3/sysext/backend/Classes/Middleware/AdditionalResponseHeaders.php(41): class@anonymous->handle()\n
#20 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\AdditionalResponseHeaders->process()\n
#21 <project>/public/typo3/sysext/backend/Classes/Middleware/OutputCompression.php(47): class@anonymous->handle()\n
#22 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\OutputCompression->process()\n
#23 <project>/public/typo3/sysext/backend/Classes/Middleware/BackendUserAuthenticator.php(166): class@anonymous->handle()\n
#24 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\BackendUserAuthenticator->process()\n
#25 <project>/public/typo3/sysext/backend/Classes/Middleware/BackendRouteInitialization.php(86): class@anonymous->handle()\n
#26 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\BackendRouteInitialization->process()\n
#27 <project>/public/typo3/sysext/backend/Classes/Middleware/ForcedHttpsBackendRedirector.php(55): class@anonymous->handle()\n
#28 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\ForcedHttpsBackendRedirector->process()\n
#29 <project>/public/typo3/sysext/backend/Classes/Middleware/LockedBackendGuard.php(75): class@anonymous->handle()\n
#30 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\LockedBackendGuard->process()\n
#31 <project>/public/typo3/sysext/core/Classes/Middleware/NormalizedParamsAttribute.php(45): class@anonymous->handle()\n
#32 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Core\\Middleware\\NormalizedParamsAttribute->process()\n
#33 <project>/public/typo3/sysext/core/Classes/Middleware/VerifyHostHeader.php(55): class@anonymous->handle()\n
#34 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Core\\Middleware\\VerifyHostHeader->process()\n
#35 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(78): class@anonymous->handle()\n
#36 <project>/public/typo3/sysext/core/Classes/Http/AbstractApplication.php(86): TYPO3\\CMS\\Core\\Http\\MiddlewareDispatcher->handle()\n
#37 <project>/public/typo3/sysext/backend/Classes/Http/Application.php(72): TYPO3\\CMS\\Core\\Http\\AbstractApplication->handle()\n
#38 <project>/public/typo3/sysext/core/Classes/Http/AbstractApplication.php(100): TYPO3\\CMS\\Backend\\Http\\Application->handle()\n
#39 <project>/public/typo3/index.php(20): TYPO3\\CMS\\Core\\Http\\AbstractApplication->run()\n
#40 <project>/public/typo3/index.php(21): {closure}()\n
#41 {main}\n\nNext
Updated by Garvin Hicking about 1 year ago
Just a short update: Issue is caused by a SQL query part with a "uid NOT IN" that exceeds character length when there are more than a few thousand records involved.
Query cannot be chunked due to the negated part.
Probable fix is to rework the record gathering. Stefan and me are working on it.
Updated by Gerrit Code Review 12 months ago
- Status changed from New to Under Review
Patch set 1 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916
Updated by Gerrit Code Review 12 months ago
Patch set 2 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916
Updated by Gerrit Code Review 12 months ago
Patch set 3 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916
Updated by Gerrit Code Review 12 months ago
Patch set 4 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916
Updated by Gerrit Code Review 11 months ago
Patch set 1 for branch 12.4 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/82237
Updated by Garvin Hicking 11 months ago
- Status changed from Under Review to Resolved
- % Done changed from 0 to 100
Applied in changeset c60198539e8d83ece129ff197a2378891dfd3db0.
Updated by Nikita Hovratov 11 months ago
- Has duplicate Bug #102711: Many entries in sys_file lead to sql error because query gets too long added