Bug #81644
closedGeneralUtility::getUrl() socket method doesn't support chunked Content-Encoding
0%
Description
With pageNotFound_handling set to the URL of a page the page not found handler uses GeneralUtility::getUrl() to retrieve the contents of the page. Because it requests the headers too the socket method is used if useCurl is not set.
After reading the headers the rest of the stream is simply read in a single operation. If the server has Content-Encoding set to chunked it will send the content in chunks and put the length of each block in hexadecimal before each chunk (plus a zero after the last chunk).
getUrl() fails to process the chunks correctly and the chunk sizes are simply included in the content.
It doesn't seem that guzzle handles chunked encoded data, but in most cases it will use cUrl internally which handles it. I'll have to test if with disabled cUrl v8/master has the same issue.
We can use a simple function to decode the chunked data.
Files