Project

General

Profile

Actions

Feature #92700

open

Add URL cache for linkvalidator

Added by Sybille Peters over 3 years ago. Updated 10 months ago.

Status:
New
Priority:
Should have
Assignee:
-
Category:
Linkvalidator
Target version:
-
Start date:
2020-10-24
Due date:
% Done:

0%

Estimated time:
PHP Version:
Tags:
Complexity:
Sprint Focus:

Description

It would be useful to have more control over the link checking.

Requirements:

  • make it possible to deactivate external link checking entirely (and e.g. let this be done by external task). Using the cache makes it possible - all external URLs to be checked are written to the cache, but not checked
  • do not check for an URL multiple times - store the result and reuse it. (this is currently already done but only within one batch - the result is stored in an array in ExternalLinktype). But when a new checklink task is started, all URLs are rechecked again.

In general there could be 3 different modes:

  • default: use URL from cache if not expired. If not in cache, check and write to cache
  • noCache: never use cache
  • cacheOnly : only use cache. If URL is not in cache, treat it like a valid URL - it is not written to broken links table.

see https://decisions.typo3.org/t/linkvalidator-when-to-do-the-link-checking/653

This would solve a number of other problems:

  • more checking could be done on the fly, e.g. when saving a record
  • in general, less external link checking would be performed
Actions #1

Updated by Gerrit Code Review over 3 years ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Actions #2

Updated by Gerrit Code Review over 3 years ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Actions #3

Updated by Gerrit Code Review over 3 years ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Actions #4

Updated by Gerrit Code Review over 3 years ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Actions #5

Updated by Gerrit Code Review over 3 years ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Actions #6

Updated by Gerrit Code Review over 3 years ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/c/Packages/TYPO3.CMS/+/66279

Actions #7

Updated by Sybille Peters about 3 years ago

  • Assignee deleted (Sybille Peters)
Actions #8

Updated by Sybille Peters 10 months ago

  • Status changed from Under Review to New

patch is abandoned.

Actions

Also available in: Atom PDF