Feature #92700

Add URL cache for linkvalidator

Added by Sybille Peters about 1 month ago. Updated about 1 month ago.

Status:
Under Review
Priority:
Should have
Category:
Linkvalidator
Target version:
-
Start date:
2020-10-24
Due date:
% Done:

0%

Estimated time:
PHP Version:
Tags:
Complexity:
Sprint Focus:

Description

It would be useful to have more control over the link checking.

Requirements:

  • make it possible to deactivate external link checking entirely (and e.g. let this be done by external task). Using the cache makes it possible - all external URLs to be checked are written to the cache, but not checked
  • do not check for an URL multiple times - store the result and reuse it. (this is currently already done but only within one batch - the result is stored in an array in ExternalLinktype). But when a new checklink task is started, all URLs are rechecked again.

In general there could be 3 different modes:

  • default: use URL from cache if not expired. If not in cache, check and write to cache
  • noCache: never use cache
  • cacheOnly : only use cache. If URL is not in cache, treat it like a valid URL - it is not written to broken links table.

see https://decisions.typo3.org/t/linkvalidator-when-to-do-the-link-checking/653

This would solve a number of other problems:

  • more checking could be done on the fly, e.g. when saving a record
  • in general, less external link checking would be performed
#1

Updated by Gerrit Code Review about 1 month ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

#2

Updated by Gerrit Code Review about 1 month ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

#3

Updated by Gerrit Code Review about 1 month ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

#4

Updated by Gerrit Code Review about 1 month ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

#5

Updated by Gerrit Code Review about 1 month ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Also available in: Atom PDF