Project

General

Profile

Actions

Task #53467

closed

Improve flush by tag performance for the file cache backend

Added by Tymoteusz Motylewski over 10 years ago. Updated over 3 years ago.

Status:
Rejected
Priority:
Should have
Category:
Performance
Target version:
-
Start date:
2013-11-08
Due date:
% Done:

0%

Estimated time:
TYPO3 Version:
6.2
PHP Version:
Tags:
Complexity:
Sprint Focus:

Description

currently the "flush by tag" command is painfully slow when using file cache backend.
This can be improved e.g. by using tag index (one file for each tag, containing id's of the cache entries)


Related issues 1 (0 open1 closed)

Related to TYPO3 Core - Bug #72043: File cache clearing inefficient causing backend timeoutClosed2015-12-03

Actions
Actions #1

Updated by Gerrit Code Review over 10 years ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #2

Updated by Gerrit Code Review over 10 years ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #3

Updated by Tymoteusz Motylewski over 10 years ago

you can test the performance of this file cache backend by using my tool
https://github.com/macopedia/cache_benchmark

For Patchset 2

Flushing is over 100times faster, but unfortunatelly write is 2x slower.

-----
Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 3 seconds

|   reads|  writes|  cleans
------------------------------------
Client 1|21369.76| 556.49| 1017.37
Client 2|21277.23| 1833.75| 278.43
Client 0|21314.86| 1797.12| 120.11
Client 3|22417.16| 1368.34| 110.95
------------------------------------
ops/sec |86379.01| 5555.70| 1526.86

Old file cache backend:

Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 26 seconds

|   reads|  writes|  cleans
------------------------------------
Client 3|21489.71| 2898.47| 2.75
Client 1|20706.24| 3049.82| 2.74
Client 2|21282.95| 2693.66| 3.31
Client 0|20981.27| 2851.33| 2.59
------------------------------------
ops/sec |84460.17|11493.28| 11.39
Actions #4

Updated by Gerrit Code Review over 10 years ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #5

Updated by Gerrit Code Review over 10 years ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #6

Updated by Gerrit Code Review over 10 years ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #7

Updated by Tymoteusz Motylewski over 10 years ago

results for the patchset 5:

Old file cache backend

ops/sec |88916.18|11260.14| 8.22

New file cache backend (patchset 5)

ops/sec |92454.31| 6830.13| 2212.49

Actions #8

Updated by Gerrit Code Review over 10 years ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #9

Updated by Gerrit Code Review over 10 years ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions #10

Updated by Ernesto Baschny over 10 years ago

  • Parent task set to #52949
Actions #11

Updated by Andreas Wolf about 10 years ago

Is this issue still relevant despite the performance issues?

Actions #12

Updated by Gerrit Code Review about 9 years ago

Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/25226

Actions #13

Updated by Mathias Schreiber over 7 years ago

  • Status changed from Under Review to Accepted
Actions #14

Updated by Benni Mack over 6 years ago

  • Parent task deleted (#52949)
Actions #15

Updated by Tymoteusz Motylewski over 3 years ago

  • Status changed from Accepted to Rejected

Issue was solved by using simpler (no taggable file backend) when we don' need tags.

Actions

Also available in: Atom PDF