Project

General

Profile

Actions

Bug #25321

closed

getUrl crashes when trying to retrieve a big file

Added by Philipp Gampe over 13 years ago. Updated almost 13 years ago.

Status:
Rejected
Priority:
Should have
Assignee:
Category:
-
Target version:
-
Start date:
2011-03-14
Due date:
% Done:

0%

Estimated time:
TYPO3 Version:
4.6
PHP Version:
5.3
Tags:
Complexity:
hard
Is Regression:
Sprint Focus:

Description

This happens very likely with linkvalidator. Just link to an external video with bigger size then memory_limit.
Normally you could just fetch headers using getUrl($url,2) but some sites are responding differently to HTTP HEAD than to HTTP GET (for example Amazon returns 405 Method not allowed).

There is currently no way to limit retrieval of the HTTP message.

For TYPO3 4.5 I suggest to extend to second parameter to getUrl($url,3) which does the same as 2, but uses get.
However, if curlUse is enable, still head is used. CURLOPT_HTTPGET = 1 retrieves the body even if CURLOPT_NOBODY is set.

This one needs to go to 4.5 in order to fix linkvalidator issues.

Set link to big external file.
Check link with linkvalidator.
See crash.

Use http://forge.typo3.org/issues/13680 linkval-cleanup_2.diff to test.
See http://forge.typo3.org/issues/13756 for some discussions.

git patch attached
(issue imported from #M17943)


Files

geturl-headers-with-get.diff (1.53 KB) geturl-headers-with-get.diff Administrator Admin, 2011-03-14 23:50

Related issues 2 (0 open2 closed)

Related to TYPO3 Core - Feature #28344: Include HTTP Request2 for better HTTP handlingClosedPhilipp Gampe2011-07-202011-07-25

Actions
Is duplicate of TYPO3 Core - Bug #13756: External links to big files crash TYPO3ClosedPhilipp Gampe2011-03-10

Actions
Actions

Also available in: Atom PDF