Task #53467

Improve flush by tag performance for the file cache backend

Added by Tymoteusz Motylewski about 6 years ago. Updated about 2 years ago.

Status:
Accepted
Priority:
Should have
Category:
Performance
Target version:
-
Start date:
2013-11-08
Due date:
% Done:

0%

TYPO3 Version:
6.2
PHP Version:
Tags:
Complexity:
Sprint Focus:

Description

currently the "flush by tag" command is painfully slow when using file cache backend.
This can be improved e.g. by using tag index (one file for each tag, containing id's of the cache entries)


Related issues

Related to TYPO3 Core - Bug #72043: File cache clearing inefficient causing backend timeout Closed 2015-12-03

History

#1 Updated by Gerrit Code Review about 6 years ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#2 Updated by Gerrit Code Review about 6 years ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#3 Updated by Tymoteusz Motylewski about 6 years ago

you can test the performance of this file cache backend by using my tool
https://github.com/macopedia/cache_benchmark

For Patchset 2

Flushing is over 100times faster, but unfortunatelly write is 2x slower.

-----
Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 3 seconds

|   reads|  writes|  cleans
------------------------------------
Client 1|21369.76| 556.49| 1017.37
Client 2|21277.23| 1833.75| 278.43
Client 0|21314.86| 1797.12| 120.11
Client 3|22417.16| 1368.34| 110.95
------------------------------------
ops/sec |86379.01| 5555.70| 1526.86

Old file cache backend:

Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 26 seconds

|   reads|  writes|  cleans
------------------------------------
Client 3|21489.71| 2898.47| 2.75
Client 1|20706.24| 3049.82| 2.74
Client 2|21282.95| 2693.66| 3.31
Client 0|20981.27| 2851.33| 2.59
------------------------------------
ops/sec |84460.17|11493.28| 11.39

#4 Updated by Gerrit Code Review about 6 years ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#5 Updated by Gerrit Code Review about 6 years ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#6 Updated by Gerrit Code Review about 6 years ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#7 Updated by Tymoteusz Motylewski about 6 years ago

results for the patchset 5:

Old file cache backend

ops/sec |88916.18|11260.14| 8.22

New file cache backend (patchset 5)

ops/sec |92454.31| 6830.13| 2212.49

#8 Updated by Gerrit Code Review about 6 years ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#9 Updated by Gerrit Code Review about 6 years ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#10 Updated by Ernesto Baschny about 6 years ago

  • Parent task set to #52949

#11 Updated by Andreas Wolf almost 6 years ago

Is this issue still relevant despite the performance issues?

#12 Updated by Gerrit Code Review over 4 years ago

Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/25226

#13 Updated by Mathias Schreiber almost 3 years ago

  • Status changed from Under Review to Accepted

#14 Updated by Benni Mack about 2 years ago

  • Parent task deleted (#52949)

Also available in: Atom PDF