Bug #25321
closedgetUrl crashes when trying to retrieve a big file
0%
Description
This happens very likely with linkvalidator. Just link to an external video with bigger size then memory_limit.
Normally you could just fetch headers using getUrl($url,2) but some sites are responding differently to HTTP HEAD than to HTTP GET (for example Amazon returns 405 Method not allowed).
There is currently no way to limit retrieval of the HTTP message.
For TYPO3 4.5 I suggest to extend to second parameter to getUrl($url,3) which does the same as 2, but uses get.
However, if curlUse is enable, still head is used. CURLOPT_HTTPGET = 1 retrieves the body even if CURLOPT_NOBODY is set.
This one needs to go to 4.5 in order to fix linkvalidator issues.
Set link to big external file.
Check link with linkvalidator.
See crash.
Use http://forge.typo3.org/issues/13680 linkval-cleanup_2.diff to test.
See http://forge.typo3.org/issues/13756 for some discussions.
git patch attached
(issue imported from #M17943)
Files