Project

General

Profile

Actions
Copy link

Bug #99326

closed

DataHandler - Process too many records

Added by Guillaume Germain almost 2 years ago. Updated 4 months ago.

Status:
Closed
Priority:
Should have
Assignee:
-
Category:
DataHandler aka TCEmain
Target version:
-
Start date:
2022-12-09
Due date:
% Done:

100%

Estimated time:
TYPO3 Version:
10
PHP Version:
Tags:
Complexity:
Is Regression:
Sprint Focus:

Description

With the "external_import" extension, I import a CSV of 150,000 lines in cli environnement.
At the first import, everything works fine.
On the second import, the check for record modification or deletion does not work because of the large number of records.

I get the error "Prepared statement contains too many placeholders".

Related issues 3 (1 open — 2 closed)

Related to TYPO3 Core - Task #93305: Long lists of parameters in QueryBuilder handled differently ("too many placeholders")Closed2021-01-18

Actions
Related to TYPO3 Core - Epic #93547: Collection of problems with large sitesAccepted2021-02-19

Actions
Related to TYPO3 Core - Bug #100894: Avoid reaching placeholder limit for statement (loosely related to #99326) in DatabaseIntegrityCheck.phpClosed2023-05-17

Actions
Actions
Copy link
 #1

Updated by Gerrit Code Review almost 2 years ago

  • Status changed from New to Under Review

Patch set 1 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77004

Actions
Copy link
 #2

Updated by Guillaume Germain almost 2 years ago

  • Related to Task #93305: Long lists of parameters in QueryBuilder handled differently ("too many placeholders") added
Actions
Copy link
 #3

Updated by Guillaume Germain almost 2 years ago

  • Related to Epic #93547: Collection of problems with large sites added
Actions
Copy link
 #4

Updated by Gerrit Code Review almost 2 years ago

Patch set 1 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #5

Updated by Gerrit Code Review almost 2 years ago

Patch set 2 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #6

Updated by Gerrit Code Review almost 2 years ago

Patch set 3 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #7

Updated by Gerrit Code Review almost 2 years ago

Patch set 4 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #8

Updated by Gerrit Code Review almost 2 years ago

Patch set 5 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #9

Updated by Gerrit Code Review almost 2 years ago

Patch set 6 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #10

Updated by Axel Böswetter over 1 year ago

Any updates on this one? I have CSV imports/ synchronisations with about 500.000 entries/ lines per file, that I try to import via EXT:external_import.

Actions
Copy link
 #11

Updated by Gerrit Code Review over 1 year ago

Patch set 7 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #12

Updated by Gerrit Code Review over 1 year ago

Patch set 8 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #13

Updated by Oliver Kleinecke over 1 year ago

  • Related to Bug #100894: Avoid reaching placeholder limit for statement (loosely related to #99326) in DatabaseIntegrityCheck.php added
Actions
Copy link
 #14

Updated by Gerrit Code Review over 1 year ago

Patch set 9 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/77005

Actions
Copy link
 #15

Updated by Gerrit Code Review over 1 year ago

Patch set 1 for branch 12.4 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/79673

Actions
Copy link
 #16

Updated by Guillaume Germain over 1 year ago

  • Status changed from Under Review to Resolved
  • % Done changed from 0 to 100
Actions
Copy link
 #17

Updated by Gerrit Code Review over 1 year ago

  • Status changed from Resolved to Under Review

Patch set 1 for branch 11.5 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/79692

Actions
Copy link
 #18

Updated by Guillaume Germain over 1 year ago

  • Status changed from Under Review to Resolved
Actions
Copy link
 #19

Updated by Benni Mack 4 months ago

  • Status changed from Resolved to Closed
Actions
Copy link

Also available in: Atom PDF