Project

General

Profile

Actions

Bug #102295

closed

Task "Storage Index" has nofile index Limit ends in a Excpection

Added by Florian E. 6 months ago. Updated 5 months ago.

Status:
Resolved
Priority:
Should have
Assignee:
-
Category:
CLI
Target version:
-
Start date:
2023-10-31
Due date:
% Done:

100%

Estimated time:
TYPO3 Version:
11
PHP Version:
7.4
Tags:
Complexity:
easy
Is Regression:
Sprint Focus:

Description

When I try to execute the task "Storage Index," I get the error: "Data too long for column 'lastexecution_failure' at row 1."
I assume, the NOT IN clause (holding the uids) is too long.


You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for
the right syntax to use near ':dcValue1) AND (`uid` NOT IN (62671, 62672, 62673, 62674, 62675, 62676, 62677...'
at line 1, in file <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:98
- {"class":"TYPO3\\CMS\\Scheduler\\Task\\AbstractTask","uid":6,"exception":"Doctrine\\DBAL\\Driver\\Mysqli\\Exception\\ConnectionError
 You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use
near ':dcValue1) AND (`uid` NOT IN (62671, 62672, 62673, 62674, 62675, 62676, 62677...' at line 1 in
<project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/Mysqli/Exception/ConnectionError.php:21\nStack trace:\n

#0 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/Mysqli/MysqliStatement.php(105): Doctrine\\DBAL\\Driver\\Mysqli\\Exception\\ConnectionError::new()\n
#1 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/Mysqli/MysqliConnection.php(152): Doctrine\\DBAL\\Driver\\Mysqli\\MysqliStatement->__construct()\n
#2 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(1301): Doctrine\\DBAL\\Driver\\Mysqli\\MysqliConnection->prepare()\n
#3 <project>/vendor/doctrine/dbal/lib/Doctrine/DBAL/Query/QueryBuilder.php(212): Doctrine\\DBAL\\Connection->executeQuery()\n
#4 <project>/public/typo3/sysext/core/Classes/Database/Query/QueryBuilder.php(300): Doctrine\\DBAL\\Query\\QueryBuilder->execute()\n
#5 <project>/public/typo3/sysext/core/Classes/Resource/Index/FileIndexRepository.php(476): TYPO3\\CMS\\Core\\Database\\Query\\QueryBuilder->executeQuery()\n
#6 <project>/public/typo3/sysext/core/Classes/Resource/Index/Indexer.php(179): TYPO3\\CMS\\Core\\Resource\\Index\\FileIndexRepository->findInStorageAndNotInUidList()\n
#7 <project>/public/typo3/sysext/core/Classes/Resource/Index/Indexer.php(128): TYPO3\\CMS\\Core\\Resource\\Index\\Indexer->detectMissingFiles()\n
#8 <project>/public/typo3/sysext/scheduler/Classes/Task/FileStorageIndexingTask.php(51): TYPO3\\CMS\\Core\\Resource\\Index\\Indexer->processChangesInStorages()\n
#9 <project>/public/typo3/sysext/scheduler/Classes/Scheduler.php(192): TYPO3\\CMS\\Scheduler\\Task\\FileStorageIndexingTask->execute()\n
#10 <project>/public/typo3/sysext/scheduler/Classes/Controller/SchedulerModuleController.php(795): TYPO3\\CMS\\Scheduler\\Scheduler->executeTask()\n
#11 <project>/public/typo3/sysext/scheduler/Classes/Controller/SchedulerModuleController.php(282): TYPO3\\CMS\\Scheduler\\Controller\\SchedulerModuleController->executeTasks()\n
#12 <project>/public/typo3/sysext/scheduler/Classes/Controller/SchedulerModuleController.php(175): TYPO3\\CMS\\Scheduler\\Controller\\SchedulerModuleController->getModuleContent()\n
#13 <project>/public/typo3/sysext/backend/Classes/Http/RouteDispatcher.php(91): TYPO3\\CMS\\Scheduler\\Controller\\SchedulerModuleController->mainAction()\n
#14 <project>/public/typo3/sysext/backend/Classes/Http/RequestHandler.php(110): TYPO3\\CMS\\Backend\\Http\\RouteDispatcher->dispatch()\n
#15 <project>/public/typo3/sysext/core/Classes/Middleware/ResponsePropagation.php(34): TYPO3\\CMS\\Backend\\Http\\RequestHandler->handle()\n
#16 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Core\\Middleware\\ResponsePropagation->process()\n
#17 <project>/public/typo3/sysext/backend/Classes/Middleware/SiteResolver.php(69): class@anonymous->handle()\n
#18 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\SiteResolver->process()\n
#19 <project>/public/typo3/sysext/backend/Classes/Middleware/AdditionalResponseHeaders.php(41): class@anonymous->handle()\n
#20 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\AdditionalResponseHeaders->process()\n
#21 <project>/public/typo3/sysext/backend/Classes/Middleware/OutputCompression.php(47): class@anonymous->handle()\n
#22 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\OutputCompression->process()\n
#23 <project>/public/typo3/sysext/backend/Classes/Middleware/BackendUserAuthenticator.php(166): class@anonymous->handle()\n
#24 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\BackendUserAuthenticator->process()\n
#25 <project>/public/typo3/sysext/backend/Classes/Middleware/BackendRouteInitialization.php(86): class@anonymous->handle()\n
#26 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\BackendRouteInitialization->process()\n
#27 <project>/public/typo3/sysext/backend/Classes/Middleware/ForcedHttpsBackendRedirector.php(55): class@anonymous->handle()\n
#28 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\ForcedHttpsBackendRedirector->process()\n
#29 <project>/public/typo3/sysext/backend/Classes/Middleware/LockedBackendGuard.php(75): class@anonymous->handle()\n
#30 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Backend\\Middleware\\LockedBackendGuard->process()\n
#31 <project>/public/typo3/sysext/core/Classes/Middleware/NormalizedParamsAttribute.php(45): class@anonymous->handle()\n
#32 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Core\\Middleware\\NormalizedParamsAttribute->process()\n
#33 <project>/public/typo3/sysext/core/Classes/Middleware/VerifyHostHeader.php(55): class@anonymous->handle()\n
#34 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(172): TYPO3\\CMS\\Core\\Middleware\\VerifyHostHeader->process()\n
#35 <project>/public/typo3/sysext/core/Classes/Http/MiddlewareDispatcher.php(78): class@anonymous->handle()\n
#36 <project>/public/typo3/sysext/core/Classes/Http/AbstractApplication.php(86): TYPO3\\CMS\\Core\\Http\\MiddlewareDispatcher->handle()\n
#37 <project>/public/typo3/sysext/backend/Classes/Http/Application.php(72): TYPO3\\CMS\\Core\\Http\\AbstractApplication->handle()\n
#38 <project>/public/typo3/sysext/core/Classes/Http/AbstractApplication.php(100): TYPO3\\CMS\\Backend\\Http\\Application->handle()\n
#39 <project>/public/typo3/index.php(20): TYPO3\\CMS\\Core\\Http\\AbstractApplication->run()\n
#40 <project>/public/typo3/index.php(21): {closure}()\n
#41 {main}\n\nNext 

Log: https://pastebin.com/kdP5DMpm


Related issues 1 (0 open1 closed)

Has duplicate TYPO3 Core - Bug #102711: Many entries in sys_file lead to sql error because query gets too longClosed2023-12-21

Actions
Actions #1

Updated by Stefan Bürk 6 months ago

  • Description updated (diff)
Actions #2

Updated by Garvin Hicking 6 months ago

Just a short update: Issue is caused by a SQL query part with a "uid NOT IN" that exceeds character length when there are more than a few thousand records involved.

Query cannot be chunked due to the negated part.

Probable fix is to rework the record gathering. Stefan and me are working on it.

Actions #3

Updated by Gerrit Code Review 6 months ago

  • Status changed from New to Under Review

Patch set 1 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916

Actions #4

Updated by Gerrit Code Review 6 months ago

Patch set 2 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916

Actions #5

Updated by Gerrit Code Review 6 months ago

Patch set 3 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916

Actions #6

Updated by Gerrit Code Review 6 months ago

Patch set 4 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/81916

Actions #7

Updated by Gerrit Code Review 5 months ago

Patch set 1 for branch 12.4 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/82237

Actions #8

Updated by Garvin Hicking 5 months ago

  • Status changed from Under Review to Resolved
  • % Done changed from 0 to 100
Actions #9

Updated by Nikita Hovratov 5 months ago

  • Has duplicate Bug #102711: Many entries in sys_file lead to sql error because query gets too long added
Actions

Also available in: Atom PDF