Project

General

Profile

Actions
Copy link

Bug #83580

closed

GeneralUtility::xml2array() can't parse bigger files (> 10MB)

Added by Frank Nägler almost 7 years ago. Updated 4 months ago.

Status:
Closed
Priority:
Should have
Assignee:
-
Category:
System/Bootstrap/Configuration
Target version:
-
Start date:
2018-01-16
Due date:
% Done:

100%

Estimated time:
TYPO3 Version:
9
PHP Version:
Tags:
Complexity:
Is Regression:
Sprint Focus:

Description

Because of an internal hard limit, GeneralUtility::xml2array() can't parse XML files bigger 10MB.
With #83578 a test is added to document this issue. The added test can be removed (or adjusted) after the bug is fixed.

Related issues 7 (3 open — 4 closed)

Related to TYPO3 Core - Task #83578: Add more UnitTests for GeneralUtility::xml2array()ClosedFrank Nägler2018-01-16

Actions
Related to TYPO3 Core - Epic #72584: sysext:impexpIn Progress2008-07-25

Actions
Related to TYPO3 Core - Story #92526: Concept for improved EXT:impexpAccepted2020-10-09

Actions
Related to TYPO3 Core - Task #95398: Replace XML handling by GeneralUtility with XmlEncoderClosed2021-09-29

Actions
Related to TYPO3 Core - Task #96635: Improve XML handling of XmlEncoder and XmlDecoderNew2022-01-24

Actions
Related to TYPO3 Core - Bug #100292: Data providers not static in #83580Closed2023-03-24

Actions
Has duplicate TYPO3 Core - Feature #95021: Handle "XML could not be parsed: Line ...: No memory" during import in EXT:impexpClosed2021-08-28

Actions
Actions
Copy link
 #1

Updated by Frank Nägler almost 7 years ago

  • Related to Task #83578: Add more UnitTests for GeneralUtility::xml2array() added
Actions
Copy link
 #2

Updated by Markus Klein over 6 years ago

Actions
Copy link
 #3

Updated by Benni Mack over 5 years ago

  • Category changed from Miscellaneous to System/Bootstrap/Configuration
Actions
Copy link
 #4

Updated by Alexander Nitsche about 3 years ago

  • Has duplicate Feature #95021: Handle "XML could not be parsed: Line ...: No memory" during import in EXT:impexp added
Actions
Copy link
 #5

Updated by Gerrit Code Review about 3 years ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #6

Updated by Alexander Nitsche about 3 years ago

  • Related to Story #92526: Concept for improved EXT:impexp added
Actions
Copy link
 #7

Updated by Matthias Druske about 3 years ago

I can confirm this issue also vor TYPO3 10.4.X

Tracing back the impexp extension's inability to parse XML files bigger than ~10 MB seems to be a direct consequence of the limit hard coded into the used parsing method. Besides the primary hurdle this poses for site migration (10 MB are exceeded easily nowadays), it also seems the current method is very hungry for memory anyway.

In addition, besides GeneralUtility::xml2array / GeneralUtility::xml2arrayProcess, I assume, that
GeneralUtility::xml2tree runs into the same issue.

Actions
Copy link
 #8

Updated by Gerrit Code Review about 3 years ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #9

Updated by Gerrit Code Review about 3 years ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #10

Updated by Gerrit Code Review about 3 years ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #11

Updated by Gerrit Code Review about 3 years ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #12

Updated by Gerrit Code Review about 3 years ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #13

Updated by Gerrit Code Review about 3 years ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #14

Updated by Gerrit Code Review about 3 years ago

Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #15

Updated by Gerrit Code Review about 3 years ago

Patch set 9 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #16

Updated by Gerrit Code Review about 3 years ago

Patch set 10 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #17

Updated by Gerrit Code Review about 3 years ago

Patch set 11 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #18

Updated by Gerrit Code Review about 3 years ago

Patch set 12 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #19

Updated by Gerrit Code Review about 3 years ago

Patch set 13 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #20

Updated by Gerrit Code Review about 3 years ago

Patch set 14 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #21

Updated by Gerrit Code Review about 3 years ago

Patch set 15 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #22

Updated by Gerrit Code Review about 3 years ago

Patch set 16 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #23

Updated by Gerrit Code Review about 3 years ago

Patch set 17 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #24

Updated by Gerrit Code Review about 3 years ago

Patch set 18 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #25

Updated by Gerrit Code Review about 3 years ago

Patch set 19 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #26

Updated by Gerrit Code Review about 3 years ago

Patch set 20 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #27

Updated by Gerrit Code Review about 3 years ago

Patch set 21 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #28

Updated by Gerrit Code Review about 3 years ago

Patch set 22 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #29

Updated by Gerrit Code Review about 3 years ago

Patch set 23 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #30

Updated by Gerrit Code Review about 3 years ago

Patch set 24 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #31

Updated by Gerrit Code Review about 3 years ago

Patch set 25 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #32

Updated by Gerrit Code Review about 3 years ago

Patch set 26 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #33

Updated by Gerrit Code Review about 3 years ago

Patch set 27 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #34

Updated by Gerrit Code Review about 3 years ago

Patch set 28 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #35

Updated by Gerrit Code Review about 3 years ago

Patch set 29 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #36

Updated by Gerrit Code Review about 3 years ago

Patch set 30 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #37

Updated by Gerrit Code Review about 3 years ago

Patch set 31 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #38

Updated by Gerrit Code Review about 3 years ago

Patch set 32 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #39

Updated by Gerrit Code Review about 3 years ago

Patch set 33 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #40

Updated by Gerrit Code Review about 3 years ago

Patch set 34 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #41

Updated by Gerrit Code Review about 3 years ago

Patch set 35 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #42

Updated by Gerrit Code Review about 3 years ago

Patch set 36 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #43

Updated by Gerrit Code Review about 3 years ago

Patch set 37 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #44

Updated by Gerrit Code Review about 3 years ago

Patch set 38 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #45

Updated by Gerrit Code Review about 3 years ago

Patch set 39 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #46

Updated by Alexander Nitsche about 3 years ago

  • Related to Task #95398: Replace XML handling by GeneralUtility with XmlEncoder added
Actions
Copy link
 #47

Updated by Gerrit Code Review about 3 years ago

Patch set 40 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #48

Updated by Gerrit Code Review about 3 years ago

Patch set 41 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #49

Updated by Gerrit Code Review about 3 years ago

Patch set 42 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #50

Updated by Gerrit Code Review about 3 years ago

Patch set 43 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #51

Updated by Gerrit Code Review about 3 years ago

Patch set 44 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #52

Updated by Gerrit Code Review almost 3 years ago

Patch set 45 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #53

Updated by Gerrit Code Review almost 3 years ago

Patch set 46 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #54

Updated by Gerrit Code Review almost 3 years ago

Patch set 47 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #55

Updated by Gerrit Code Review almost 3 years ago

Patch set 48 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #56

Updated by Gerrit Code Review almost 3 years ago

Patch set 49 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #57

Updated by Gerrit Code Review almost 3 years ago

Patch set 50 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #58

Updated by Alexander Nitsche almost 3 years ago

  • Related to Task #96635: Improve XML handling of XmlEncoder and XmlDecoder added
Actions
Copy link
 #59

Updated by Gerrit Code Review almost 3 years ago

Patch set 51 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #60

Updated by Gerrit Code Review almost 3 years ago

Patch set 52 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #61

Updated by Gerrit Code Review almost 3 years ago

Patch set 53 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #62

Updated by Gerrit Code Review almost 3 years ago

Patch set 54 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #63

Updated by Gerrit Code Review over 2 years ago

Patch set 55 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #64

Updated by Gerrit Code Review over 2 years ago

Patch set 56 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #65

Updated by Gerrit Code Review over 2 years ago

Patch set 57 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #66

Updated by Gerrit Code Review about 2 years ago

Patch set 58 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #67

Updated by Gerrit Code Review about 2 years ago

Patch set 59 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #68

Updated by Gerrit Code Review almost 2 years ago

Patch set 60 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #69

Updated by Gerrit Code Review over 1 year ago

Patch set 61 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #70

Updated by Gerrit Code Review over 1 year ago

Patch set 62 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #71

Updated by Gerrit Code Review over 1 year ago

Patch set 63 for branch main of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/70814

Actions
Copy link
 #72

Updated by Alexander Nitsche over 1 year ago

  • Status changed from Under Review to Resolved
  • % Done changed from 0 to 100
Actions
Copy link
 #73

Updated by Andreas Kienast over 1 year ago

  • Related to Bug #100292: Data providers not static in #83580 added
Actions
Copy link
 #74

Updated by Gerrit Code Review over 1 year ago

  • Status changed from Resolved to Under Review

Patch set 1 for branch 11.5 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/78249

Actions
Copy link
 #75

Updated by Gerrit Code Review over 1 year ago

Patch set 2 for branch 11.5 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/78249

Actions
Copy link
 #76

Updated by Gerrit Code Review over 1 year ago

Patch set 3 for branch 11.5 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/78249

Actions
Copy link
 #77

Updated by Alexander Nitsche over 1 year ago

  • Status changed from Under Review to Resolved
Actions
Copy link
 #78

Updated by Benni Mack 4 months ago

  • Status changed from Resolved to Closed
Actions
Copy link

Also available in: Atom PDF