Project

General

Profile

Actions
Copy link

Bug #63782

closed

Bug #63692: Memory consumption while bulk inserting

Do not fetch all columns in ReferenceIndex->generateRefIndexData

Added by Stephan Großberndt almost 10 years ago. Updated about 6 years ago.

Status:
Closed
Priority:
Should have
Assignee:
Stephan Großberndt
Category:
Performance
Target version:
next-patchlevel
Start date:
2014-12-11
Due date:
% Done:

100%

Estimated time:
TYPO3 Version:
6.2
PHP Version:
Tags:
Complexity:
medium
Is Regression:
No
Sprint Focus:

Description

Currently ReferenceIndex->generateRefIndexData fetches all data from each table and selects afterwards which fields and their contents are looked at searching for relations.

public function generateRefIndexData($table, $uid) {
    if (isset($GLOBALS['TCA'][$table])) {
        // Get raw record from DB:
        $record = $GLOBALS['TYPO3_DB']->exec_SELECTgetSingleRow('*', $table, 'uid=' . (int)$uid);

If the fields are selected beforehand using the information from the TCA a lot less data is fetched. This improves the speed of building the reference index as standalone task as well as when bulk inserting many records.

Actions
Copy link
 #1

Updated by Mathias Schreiber almost 10 years ago

  • Parent task set to #63692
Actions
Copy link
 #2

Updated by Gerrit Code Review almost 10 years ago

  • Status changed from New to Under Review

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #3

Updated by Gerrit Code Review almost 10 years ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #4

Updated by Gerrit Code Review almost 10 years ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #5

Updated by Gerrit Code Review almost 10 years ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #6

Updated by Gerrit Code Review almost 10 years ago

Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #7

Updated by Gerrit Code Review almost 10 years ago

Patch set 9 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #8

Updated by Gerrit Code Review almost 10 years ago

Patch set 10 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #9

Updated by Gerrit Code Review almost 10 years ago

Patch set 11 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #10

Updated by Gerrit Code Review almost 10 years ago

Patch set 12 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #11

Updated by Gerrit Code Review almost 10 years ago

Patch set 13 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #12

Updated by Gerrit Code Review almost 10 years ago

Patch set 14 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #13

Updated by Gerrit Code Review almost 10 years ago

Patch set 15 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #14

Updated by Gerrit Code Review almost 10 years ago

Patch set 16 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #15

Updated by Gerrit Code Review almost 10 years ago

Patch set 17 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #16

Updated by Gerrit Code Review almost 10 years ago

Patch set 18 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #17

Updated by Gerrit Code Review almost 10 years ago

Patch set 19 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #18

Updated by Gerrit Code Review over 9 years ago

Patch set 20 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #19

Updated by Gerrit Code Review over 9 years ago

Patch set 21 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #20

Updated by Gerrit Code Review over 9 years ago

Patch set 22 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #21

Updated by Gerrit Code Review over 9 years ago

Patch set 23 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #22

Updated by Gerrit Code Review over 9 years ago

Patch set 24 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #23

Updated by Gerrit Code Review over 9 years ago

Patch set 25 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #24

Updated by Gerrit Code Review over 9 years ago

Patch set 26 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #25

Updated by Gerrit Code Review over 9 years ago

Patch set 27 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/35191

Actions
Copy link
 #26

Updated by Stephan Großberndt over 9 years ago

  • Status changed from Under Review to Resolved
  • % Done changed from 0 to 100
Actions
Copy link
 #27

Updated by Gerrit Code Review over 9 years ago

  • Status changed from Resolved to Under Review

Patch set 1 for branch TYPO3_6-2 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/37478

Actions
Copy link
 #28

Updated by Gerrit Code Review over 9 years ago

Patch set 2 for branch TYPO3_6-2 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/37478

Actions
Copy link
 #29

Updated by Stephan Großberndt over 9 years ago

  • Status changed from Under Review to Resolved
Actions
Copy link
 #30

Updated by Benni Mack about 6 years ago

  • Status changed from Resolved to Closed
Actions
Copy link

Also available in: Atom PDF