Epic #93547

Collection of problems with large sites

Added by Sybille Peters 10 months ago. Updated 11 days ago.

Status:
Accepted
Priority:
Should have
Assignee:
-
Category:
Miscellaneous
Target version:
-
Start date:
2021-02-19
Due date:
% Done:

0%

Estimated time:
Sprint Focus:

Description

I used the following tags in sub-issues - where appropriate.

tags : "large-site", "memory hog", "prepared statement", "placeholderlimit", "memory", "performance", "throttle", "usability" (or UI related things)

All issues related to large site are tagged with large-site.


Can be many pages, many files, many directories, many categories, etc. or a combination.

The problems are mostly related to:

  • performance and resource (memory) problems.
  • exceptions, e.g. database query - “Prepared statement contains too many placeholders”
  • usability: e.g. long, unusable lists (see sys_filemount: long list of directories + performance issue, unable to filter for specific pages in pagetree filter etc.)

Can the question of large sites be addressed in general?

e.g.

  • consider large sites when creating concepts for new features
  • create a reference "large site"
  • test patches on “large sites”
  • define hard limits / soft limits (if possible) - e.g. are there specific known limitations, can we say TYPO3 easily runs with x number of pages (redirects, sites, files, be user groups etc.) in a typical installation (e.g. with a reference site)

Related issues

Related to TYPO3 Core - Bug #57953: Rendering time of HMENU is really bad, maybe bug?Closed2014-04-15

Actions
Related to TYPO3 Core - Bug #76581: Backend Performance FlawsNew2016-06-10

Actions
Related to TYPO3 Core - Bug #78258: List view CSV export goes out of memoryAccepted2016-10-12

Actions
Related to TYPO3 Core - Bug #92493: linkvalidator: scheduler task + list of broken links dies if too many pages ("Prepared statement contains too many placeholders")Resolved2020-10-06

Actions
Related to TYPO3 Core - Bug #36744: Workspaces are unusable on larger installationsAcceptedOliver Hader2012-08-12

Actions
Related to TYPO3 Core - Feature #89015: Lazy Loading for TCA / Backend View to improve performanceNew2019-08-26

Actions
Related to TYPO3 Core - Bug #81996: Read ony select field 'renderType' => 'selectSingle' renders all available itemsNew2017-07-28

Actions
Related to TYPO3 Core - Epic #89759: Performance improvements in Forms moduleNew2019-11-24

Actions
Related to TYPO3 Core - Bug #84558: TYPO3 sys_category problem with performance/slow opening category in BENew2018-03-29

Actions
Related to TYPO3 Core - Task #90143: Redirects: Poor performance of redirect matching for large redirects tableUnder Review2020-01-17

Actions
Related to TYPO3 Core - Bug #92033: "Page tree error: Got unexpected reponse" with filter - allowed memory size exhaustedNew2020-08-17

Actions
Related to TYPO3 Core - Bug #92036: New behaviour of page tree filter might more easily submit "monster queries" or too many queriesAccepted2020-08-17

Actions
Related to TYPO3 Core - Feature #78760: Make pagetree panel resizable/expandable on large screensClosed2016-11-21

Actions
Related to TYPO3 Core - Feature #92576: Page Tree filter: make it possible to explicitly filter by uidUnder Review2020-10-16

Actions
Related to TYPO3 Core - Feature #89762: Add pagination to forms listResolved

Actions
Related to TYPO3 Core - Bug #52374: Editing a sys_filemount is very slowNewRichard Haeser2013-09-30

Actions
Related to TYPO3 Core - Bug #88873: ext: form hangs (run into 500 error) when a lot of files are in the fileadminClosed2019-11-05

Actions
Related to TYPO3 Core - Bug #91372: Filelist module stops working if a lot of files in one directoryNew2020-05-12

Actions
Related to TYPO3 Core - Epic #88474: Page tree performance in 9.5Closed2018-11-16

Actions
Related to TYPO3 Core - Bug #88134: Lots a database queries to sys_refindex cause slow page savingNew2019-04-10

Actions
Related to TYPO3 Core - Bug #84051: SelectTree (Category Tree) - add horizontal scrollingNew2018-02-26

Actions
Related to TYPO3 Core - Bug #88672: SlugHelper->isUniqueInSite() slow for installations with many sites and similar URL structures Under Review2019-07-02

Actions
Related to TYPO3 Core - Task #93305: Long lists of parameters in QueryBuilder handled differently ("too many placeholders")New2021-01-18

Actions
Related to TYPO3 Core - Bug #93937: Live search really slow for non admin users in large TYPO3 websitesNew2021-04-16

Actions
Related to TYPO3 Core - Epic #95690: Performance issues when hosting a large amount of websites, and optimizations propositionsAccepted2021-10-18

Actions
Related to TYPO3 Core - Bug #86859: Search with indexed_search plugin throws exception: Prepared statement contains too many placeholders New2018-11-05

Actions
Related to TYPO3 Core - Bug #96042: Row update wizard may consume too much memory for tables with many records and contentUnder Review2021-11-20

Actions
Related to TYPO3 Core - Task #89287: Make linkvalidator crawling politeNew2019-09-26

Actions

Also available in: Atom PDF