Project

General

Profile

Actions
Copy link

Task #53467

closed

Improve flush by tag performance for the file cache backend

Added by Tymoteusz Motylewski about 11 years ago. Updated about 4 years ago.

Status:
Rejected
Priority:
Should have
Assignee:
Tymoteusz Motylewski
Category:
Performance
Target version:
-
Start date:
2013-11-08
Due date:
% Done:

0%

Estimated time:
TYPO3 Version:
6.2
PHP Version:
Tags:
Complexity:
Sprint Focus:

Description

currently the "flush by tag" command is painfully slow when using file cache backend.
This can be improved e.g. by using tag index (one file for each tag, containing id's of the cache entries)

Related issues 1 (0 open — 1 closed)

Related to TYPO3 Core - Bug #72043: File cache clearing inefficient causing backend timeoutClosed2015-12-03

Actions
Actions
Copy link
 #1

Updated by Gerrit Code Review about 11 years ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #2

Updated by Gerrit Code Review about 11 years ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #3

Updated by Tymoteusz Motylewski about 11 years ago

you can test the performance of this file cache backend by using my tool
https://github.com/macopedia/cache_benchmark

For Patchset 2

Flushing is over 100times faster, but unfortunatelly write is 2x slower.

-----
Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 3 seconds

|   reads|  writes|  cleans
------------------------------------
Client  1|21369.76|  556.49| 1017.37
Client  2|21277.23| 1833.75|  278.43
Client  0|21314.86| 1797.12|  120.11
Client  3|22417.16| 1368.34|  110.95
------------------------------------
ops/sec  |86379.01| 5555.70| 1526.86

Old file cache backend:

Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 26 seconds

|   reads|  writes|  cleans
------------------------------------
Client  3|21489.71| 2898.47|    2.75
Client  1|20706.24| 3049.82|    2.74
Client  2|21282.95| 2693.66|    3.31
Client  0|20981.27| 2851.33|    2.59
------------------------------------
ops/sec  |84460.17|11493.28|   11.39
Actions
Copy link
 #4

Updated by Gerrit Code Review about 11 years ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #5

Updated by Gerrit Code Review about 11 years ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #6

Updated by Gerrit Code Review about 11 years ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #7

Updated by Tymoteusz Motylewski about 11 years ago

results for the patchset 5:

Old file cache backend

ops/sec |88916.18|11260.14| 8.22

New file cache backend (patchset 5)

ops/sec |92454.31| 6830.13| 2212.49

Actions
Copy link
 #8

Updated by Gerrit Code Review about 11 years ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #9

Updated by Gerrit Code Review about 11 years ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

Actions
Copy link
 #10

Updated by Ernesto Baschny about 11 years ago

  • Parent task set to #52949
Actions
Copy link
 #11

Updated by Andreas Wolf almost 11 years ago

Is this issue still relevant despite the performance issues?

Actions
Copy link
 #12

Updated by Gerrit Code Review over 9 years ago

Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/25226

Actions
Copy link
 #13

Updated by Mathias Schreiber almost 8 years ago

  • Status changed from Under Review to Accepted
Actions
Copy link
 #14

Updated by Benni Mack about 7 years ago

  • Parent task deleted (#52949)
Actions
Copy link
 #15

Updated by Tymoteusz Motylewski about 4 years ago

  • Status changed from Accepted to Rejected

Issue was solved by using simpler (no taggable file backend) when we don' need tags.

Actions
Copy link

Also available in: Atom PDF