Project

General

Profile

Actions

Feature #83134

open

Re-implement Update storage index [File Abstraction Layer]

Added by Pawel Cieslik over 6 years ago. Updated over 6 years ago.

Status:
New
Priority:
Could have
Assignee:
-
Category:
File Abstraction Layer (FAL)
Start date:
2017-11-28
Due date:
% Done:

0%

Estimated time:
PHP Version:
Tags:
Complexity:
easy
Sprint Focus:

Description

Indexer should work based on the whitelist and iterate over all sys_file records in db and check if file exists in file system, if file doesn't the record should be deleted. If file's modification_date was changed the record should be updated. This operation should be divided into small chunks.

class related to this task: \TYPO3\CMS\Scheduler\Task\FileStorageIndexingTask


Related issues 1 (1 open0 closed)

Related to TYPO3 Core - Bug #91934: File abstraction layer: works odd with reindexing / extractingNew2020-08-05

Actions
Actions #1

Updated by Frans Saris over 6 years ago

Records are already updated by the task. And missing files are marked as missing.

What exactly do you want to approve?

Actions #2

Updated by Pawel Cieslik over 6 years ago

currently indexer iterate over all files in specific storage folder and later it updates database, GC task can have really big table with IDs of records which exist in filesystem and database. Later GC task is making query to database and choose all records from sys_file which are not in this really big table with IDs.

such task is really memory and resource consuming. changing order will reduce memory and cpu usage.

Actions #3

Updated by Wouter Wolters over 6 years ago

  • Assignee deleted (Manuel Selbach)
Actions #4

Updated by Susanne Moog over 6 years ago

  • Target version changed from 9.0 to Candidate for Major Version
Actions #5

Updated by Thomas Sam Wittich over 3 years ago

  • Related to Bug #91934: File abstraction layer: works odd with reindexing / extracting added
Actions

Also available in: Atom PDF