TYPO3 Core

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/47196

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/47196

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/47196

This issue is not related to XEE changes and is cause by a missing support for the zlib stream wrapper functionality in parsing XML contents:

• http://forums.zend.com/viewtopic.php?f=8&t=22108 (that one is from 2011 and mentions "TYPO3" as well)
• https://phabricator.wikimedia.org/T86036 (media wiki explicitly enables the entity loader which does not seem to be required in that case - besides of cross-thread artifacts in PHP)
• http://php.net/manual/de/wrappers.php (stream wrappers in general)

It would be more interesting which PHP versions with what configuration produced this behavior.

Same here:
when i open the language menu to update the languages.
Typo3 7.6.4
Extensions installed:
Realurl
dce
gridelements
youtubevideo

#Server
PHP 5.6.16 FASTCGI
php ini:

[PHP]
  engine = "1" 
  short_open_tag = "1" 
  date.timezone = "Europe/Berlin" 
  asp_tags = "1" 
  precision = "14" 
  y2k_compliance = "" 
  output_buffering = "Off" 
  output_handler = "" 
  unserialize_callback_func = "" 
  zlib.output_compression = "" 
  implicit_flush = "" 
  allow_call_time_pass_reference = "1" 
  safe_mode = "" 
  safe_mode_gid = "" 
  safe_mode_include_dir = "" 
  safe_mode_exec_dir = "" 
  safe_mode_allowed_env_vars = "PHP_" 
  safe_mode_protected_env_vars = "LD_LIBRARY_PATH" 
  disable_functions = "" 
  highlight.string = "#CC0000" 
  highlight.comment = "#FF9900" 
  highlight.keyword = "#006600" 
  highlight.bg = "#FFFFFF" 
  highlight.default = "#0000CC" 
  highlight.html = "#000000" 
  expose_php = "1" 
  zend_optimizer.optimization_level = "15" 
  zend_optimizer.enable_loader = "1" 
  zend_extension = "/usr/local/php5/ZendOptimizer.so" 
  max_execution_time = "360" 
  memory_limit = "240M" 
  error_reporting = "32759" 
  display_errors = "" 
  display_startup_errors = "" 
  log_errors = "" 
  track_errors = "" 
  variables_order = "EGPCS" 
  register_globals = "1" 
  register_argc_argv = "1" 
  post_max_size = "16M" 
  gpc_order = "GPC" 
  magic_quotes_gpc = "1" 
  magic_quotes_runtime = "" 
  magic_quotes_sybase = "" 
  auto_prepend_file = "" 
  auto_append_file = "" 
  default_mimetype = "text/html" 
  include_path = ".:/usr/local/lib/php" 
  doc_root = "" 
  user_dir = "" 
  extension_dir = "./" 
  enable_dl = "1" 
  file_uploads = "1" 
  upload_max_filesize = "16M" 
  allow_url_fopen = "1" 
  allow_url_include = "1" 
  max_input_vars = "1500" 
  always_populate_raw_post_data = "-1" 

Uncaught TYPO3 Exception
#1: PHP Warning: XMLReader::open(): Unable to open source data in /kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extensionmanager/Classes/Utility/Parser/MirrorXmlPullParser.php line 59 (More information)

TYPO3\CMS\Core\Error\Exception thrown in file
/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/core/Classes/Error/ErrorHandler.php in line 111.

23 TYPO3\CMS\Core\Error\ErrorHandler::handleError(2, "XMLReader::open(): Unable to open source data", "/kunden/47633/rp-hosting/71192/4320/halt-hamburg/t…ger/Classes/Utility/Parser/MirrorXmlPullParser.php", 59, array)
22 XMLReader::open("compress.zlib:///kunden/47633/rp-hosting/71192/432…amburg/typo3temp/ExtensionManager/1.mirrors.xml.gz", "utf-8")

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extensionmanager/Classes/Utility/Parser/MirrorXmlPullParser.php:
00057:             throw new \TYPO3\CMS\Extensionmanager\Exception\ExtensionManagerException('Unable to create XML parser.', 1342640820);
00058:         }
00059:         if ($this->objXml->open($file, 'utf-8') === false) {
00060:             throw new \TYPO3\CMS\Extensionmanager\Exception\ExtensionManagerException(sprintf('Unable to open file resource %s.', $file), 1342640893);
00061:         }

21 TYPO3\CMS\Extensionmanager\Utility\Parser\MirrorXmlPullParser::parseXml("compress.zlib:///kunden/47633/rp-hosting/71192/432…amburg/typo3temp/ExtensionManager/1.mirrors.xml.gz")

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extensionmanager/Classes/Utility/Importer/MirrorListUtility.php:
00065:     {
00066:         $zlibStream = 'compress.zlib://';
00067:         $this->parser->parseXml($zlibStream . $localMirrorListFile);
00068:         /** @var $objRepositoryMirrors \TYPO3\CMS\Extensionmanager\Domain\Model\Mirrors */
00069:         $objRepositoryMirrors = \TYPO3\CMS\Core\Utility\GeneralUtility::makeInstance(\TYPO3\CMS\Extensionmanager\Domain\Model\Mirrors::class);

20 TYPO3\CMS\Extensionmanager\Utility\Importer\MirrorListUtility::getMirrors("/kunden/47633/rp-hosting/71192/4320/halt-hamburg/h…amburg/typo3temp/ExtensionManager/1.mirrors.xml.gz")

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extensionmanager/Classes/Utility/Repository/Helper.php:
00248:             /** @var $objMirrorListImporter \TYPO3\CMS\Extensionmanager\Utility\Importer\MirrorListUtility */
00249:             $objMirrorListImporter = \TYPO3\CMS\Core\Utility\GeneralUtility::makeInstance(\TYPO3\CMS\Extensionmanager\Utility\Importer\MirrorListUtility::class);
00250:             $this->repository->addMirrors($objMirrorListImporter->getMirrors($this->getLocalMirrorListFile()));
00251:         }
00252:         return $this->repository->getMirrors();

19 TYPO3\CMS\Extensionmanager\Utility\Repository\Helper::getMirrors(boolean)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/lang/Classes/Service/TranslationService.php:
00066:     public function injectRepositoryHelper(\TYPO3\CMS\Extensionmanager\Utility\Repository\Helper $helper)
00067:     {
00068:         $this->mirrorUrl = $helper->getMirrors(false)->getMirrorUrl();
00069:     }
00070: 

18 TYPO3\CMS\Lang\Service\TranslationService::injectRepositoryHelper(TYPO3\CMS\Extensionmanager\Utility\Repository\Helper)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Object/Container/Container.php:
00232:             }
00233:             if (is_callable(array($instance, $injectMethodName))) {
00234:                 $instance->{$injectMethodName}($instanceToInject);
00235:             }
00236:         }

17 TYPO3\CMS\Extbase\Object\Container\Container::injectDependencies(TYPO3\CMS\Lang\Service\TranslationService, TYPO3\CMS\Extbase\Object\Container\ClassInfo)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Object/Container/Container.php:
00180:         }
00181:         $instance = $this->instanciateObject($classInfo, $givenConstructorArguments);
00182:         $this->injectDependencies($instance, $classInfo);
00183:         $this->initializeObject($instance, $classInfo);
00184:         if (!$classIsSingleton) {

16 TYPO3\CMS\Extbase\Object\Container\Container::getInstanceInternal("TYPO3\CMS\Lang\Service\TranslationService")

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Object/Container/Container.php:
00227:         }
00228:         foreach ($classInfo->getInjectMethods() as $injectMethodName => $classNameToInject) {
00229:             $instanceToInject = $this->getInstanceInternal($classNameToInject);
00230:             if ($classInfo->getIsSingleton() && !$instanceToInject instanceof \TYPO3\CMS\Core\SingletonInterface) {
00231:                 $this->log('The singleton "' . $classInfo->getClassName() . '" needs a prototype in "' . $injectMethodName . '". This is often a bad code smell; often you rather want to inject a singleton.', 1);

15 TYPO3\CMS\Extbase\Object\Container\Container::injectDependencies(TYPO3\CMS\Lang\Controller\LanguageController, TYPO3\CMS\Extbase\Object\Container\ClassInfo)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Object/Container/Container.php:
00180:         }
00181:         $instance = $this->instanciateObject($classInfo, $givenConstructorArguments);
00182:         $this->injectDependencies($instance, $classInfo);
00183:         $this->initializeObject($instance, $classInfo);
00184:         if (!$classIsSingleton) {

14 TYPO3\CMS\Extbase\Object\Container\Container::getInstanceInternal("TYPO3\CMS\Lang\Controller\LanguageController", array)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Object/Container/Container.php:
00124:     {
00125:         $this->prototypeObjectsWhichAreCurrentlyInstanciated = array();
00126:         return $this->getInstanceInternal($className, $givenConstructorArguments);
00127:     }
00128: 

13 TYPO3\CMS\Extbase\Object\Container\Container::getInstance("TYPO3\CMS\Lang\Controller\LanguageController", array)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Object/ObjectManager.php:
00097:             $instance = call_user_func_array(array(\TYPO3\CMS\Core\Utility\GeneralUtility::class, 'makeInstance'), $arguments);
00098:         } else {
00099:             $instance = $this->objectContainer->getInstance($objectName, $arguments);
00100:         }
00101:         return $instance;

12 TYPO3\CMS\Extbase\Object\ObjectManager::get("TYPO3\CMS\Lang\Controller\LanguageController")

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Mvc/Dispatcher.php:
00113:     {
00114:         $controllerObjectName = $request->getControllerObjectName();
00115:         $controller = $this->objectManager->get($controllerObjectName);
00116:         if (!$controller instanceof \TYPO3\CMS\Extbase\Mvc\Controller\ControllerInterface) {
00117:             throw new \TYPO3\CMS\Extbase\Mvc\Exception\InvalidControllerException('Invalid controller "' . $request->getControllerObjectName() . '". The controller must implement the TYPO3\\CMS\\Extbase\\Mvc\\Controller\\ControllerInterface.', 1202921619);

11 TYPO3\CMS\Extbase\Mvc\Dispatcher::resolveController(TYPO3\CMS\Extbase\Mvc\Web\Request)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Mvc/Dispatcher.php:
00082:                 throw new \TYPO3\CMS\Extbase\Mvc\Exception\InfiniteLoopException('Could not ultimately dispatch the request after ' . $dispatchLoopCount . ' iterations. Most probably, a @ignorevalidation annotation is missing on re-displaying a form with validation errors.', 1217839467);
00083:             }
00084:             $controller = $this->resolveController($request);
00085:             try {
00086:                 $controller->processRequest($request, $response);

10 TYPO3\CMS\Extbase\Mvc\Dispatcher::dispatch(TYPO3\CMS\Extbase\Mvc\Web\Request, TYPO3\CMS\Extbase\Mvc\Web\Response)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Mvc/Web/BackendRequestHandler.php:
00030:         /** @var $response \TYPO3\CMS\Extbase\Mvc\ResponseInterface */
00031:         $response = $this->objectManager->get(\TYPO3\CMS\Extbase\Mvc\Web\Response::class);
00032:         $this->dispatcher->dispatch($request, $response);
00033:         return $response;
00034:     }

9 TYPO3\CMS\Extbase\Mvc\Web\BackendRequestHandler::handleRequest()

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Core/Bootstrap.php:
00204:         $requestHandler = $requestHandlerResolver->resolveRequestHandler();
00205: 
00206:         $response = $requestHandler->handleRequest();
00207:         // If response is NULL after handling the request we need to stop
00208:         // This happens for instance, when a USER object was converted to a USER_INT

8 TYPO3\CMS\Extbase\Core\Bootstrap::handleRequest()

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/extbase/Classes/Core/Bootstrap.php:
00191:     {
00192:         $this->initialize($configuration);
00193:         return $this->handleRequest();
00194:     }
00195: 

7 TYPO3\CMS\Extbase\Core\Bootstrap::run("", array)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/backend/Classes/Http/BackendModuleRequestHandler.php:
00207:             // Run Extbase
00208:             $bootstrap = GeneralUtility::makeInstance(\TYPO3\CMS\Extbase\Core\Bootstrap::class);
00209:             $content = $bootstrap->run('', $configuration);
00210: 
00211:             $response->getBody()->write($content);

6 TYPO3\CMS\Backend\Http\BackendModuleRequestHandler::dispatchModule("tools_LangLanguage")

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/backend/Classes/Http/BackendModuleRequestHandler.php:
00090:         $moduleName = (string)$this->request->getQueryParams()['M'];
00091:         if ($this->isDispatchedModule($moduleName)) {
00092:             return $this->dispatchModule($moduleName);
00093:         } else {
00094:             // @deprecated: This else path is deprecated and throws deprecations logs at registration time. Can be removed with TYPO3 CMS 8.

5 TYPO3\CMS\Backend\Http\BackendModuleRequestHandler::handleRequest(TYPO3\CMS\Core\Http\ServerRequest)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/core/Classes/Core/Bootstrap.php:
00300: 
00301:         // Execute the command which returns a Response object or NULL
00302:         $this->response = $requestHandler->handleRequest($request);
00303:         return $this;
00304:     }

4 TYPO3\CMS\Core\Core\Bootstrap::handleRequest(TYPO3\CMS\Core\Http\ServerRequest)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/sysext/backend/Classes/Http/Application.php:
00092:         }
00093: 
00094:         $this->bootstrap->handleRequest($this->request);
00095: 
00096:         if ($execute !== null) {

3 TYPO3\CMS\Backend\Http\Application::run()

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/index.php:
00018: call_user_func(function () {
00019:     $classLoader = require __DIR__ . '/../vendor/autoload.php';
00020:     (new \TYPO3\CMS\Backend\Http\Application($classLoader))->run();
00021: });

2 {closure}()
1 call_user_func(Closure)

/kunden/47633/rp-hosting/71192/4320/halt-hamburg/typo3_src-7.6.4/typo3/index.php:
00019:     $classLoader = require __DIR__ . '/../vendor/autoload.php';
00020:     (new \TYPO3\CMS\Backend\Http\Application($classLoader))->run();
00021: });

Sebastian, thanks for your detailed feedback!
Can you please check to following and gimme some more feedback?

• Is the file physically available and accessible at typo3temp/ExtensionManager/1.mirrors.xml.gz? Just to be sure...
• Can you please paste the output of the "zlib" and "xml" section of your PHP configuration (e.g. by doing a "php -i" via CLI or "phpinfo();" in a script)?

On my environment I have something like this for instance:

xml

XML Support => active
XML Namespace Support => active
libxml2 Version => 2.9.2

zlib

ZLib Support => enabled
Stream Wrapper => compress.zlib://
Stream Filter => zlib.inflate, zlib.deflate
Compiled Version => 1.2.8
Linked Version => 1.2.8

Same Problem here
typo3temp/ExtensionManager/1.mirrors.xml.gz exists

PHP Version => 7.0.4
System => Darwin 15.3.0 Darwin Kernel Version 15.3.0: Thu Dec 10 18:40:58 PST 2015; root:xnu-3
248.30.4~1/RELEASE_X86_64 x86_64
[..]
xml

XML Support => active
XML Namespace Support => active
libxml2 Version => 2.9.2

zlib

ZLib Support => enabled
Stream Wrapper => compress.zlib://
Stream Filter => zlib.inflate, zlib.deflate
Compiled Version => 1.2.8
Linked Version => 1.2.8

Typo3 Version 7.6.4
Composer Installed
Composer mode activated

Stacktrace from xdebug:

Uncaught TYPO3 Exception
#1: PHP Warning: XMLReader::open(): Unable to open source data in /../typo3_src/typo3/sysext/extensionmanager/Classes/Utility/Parser/MirrorXmlPullParser.php line 59
TYPO3\CMS\Core\Error\Exception thrown in file /.../typo3_src/typo3/sysext/core/Classes/Error/ErrorHandler.php in line 111.

22 TYPO3\CMS\Core\Error\ErrorHandler::handleError(2, "XMLReader::open(): Unable to open source data", "/.../Classes/Utility/Parser/MirrorXmlPullParser.php", 59, array)
21 XMLReader::open("compress.zlib:///.../typo3temp/ExtensionManager/1.mirrors.xml.gz", "utf-8")

Note: paths are correct, shortened here for better display

Rest of the System runs without Problems. The PHP was installed via the Mac OSX port Package Manager. zlib and libxml are both linked from port packages, not from the base OSX System, which means they are compiled from the official sources.

Another note; identical System runs on a different server without Problems (in PHP 5.6.17 Debian Package) If needed I can provide the Setup for the working environment.

Same here,can't update TER

TYPO3: 7.6.4
PHP:

PHP 5.5.9-1ubuntu4.14 (cli) (built: Oct 28 2015 01:34:46)
Copyright (c) 1997-2014 The PHP Group
Zend Engine v2.5.0, Copyright (c) 1998-2014 Zend Technologies
with Zend OPcache v7.0.3, Copyright (c) 1999-2014, by Zend Technologies
with Xdebug v2.2.3, Copyright (c) 2002-2013, by Derick Rethans

Same here.

But sometimes it works, about 1 out of 4 times when I try EM update. However, translations are never completely updated.

Same Problems with Langmenu & Extensionmanager:

TYPO3 7.6.4
PHP Version 5.6.19

XML Support    active
XML Namespace Support    active
libxml2 Version    2.9.1

ZLib Support    enabled
Stream Wrapper    compress.zlib://
Stream Filter    zlib.inflate, zlib.deflate
Compiled Version    1.2.8
Linked Version    1.2.8

Same here...

Hi,
this also happens on our system:
PHP Version 5.5.9-1ubuntu4.14
ZLib Version 1.2.8
libxml Version 2.9.1

I also applied the patch and everything works fine.

Other installations on the same server running 6.2.x are working fine.

Same here but I could solve it by installing the Apache Mod "xml2enc". So no changes at the core system has been necessary for me.

It works with:

php: PHP Version => 5.6.20-1+deb.sury.org~trusty+1
libxml:libxml Version => 2.9.1
zlib: Compiled Version => 1.2.8
Ubuntu

and

PHP Version => 7.0.5
libxml Version => 2.9.3
Compiled Version => 1.2.8
Fedora 23

Sebastian Koch wrote:

I also applied the patch and everything works fine.

Other installations on the same server running 6.2.x are working fine.

Does that mean, that these 6.2.x installations are not affected at all on your side or should it read like "6.2 works fine after applying the patch"?

Marc Zimmermann wrote:

Same here but I could solve it by installing the Apache Mod "xml2enc". So no changes at the core system has been necessary for me.

Interesting. What settings did you use then in Apache, e.g. xml2EncDefault? Did you investigate further, what produced the problem, like byte-order-mark or specific file charset?

Christoph no-lastname-given wrote:

Same here...

Hi,
I have the same problem. I did not patched yet. If you need some information on my system, please give an advice. Can't update extensionmanager for 33 days.

Thanks
Martin

Oliver Hader wrote:

Sebastian Koch wrote:

I also applied the patch and everything works fine.

Other installations on the same server running 6.2.x are working fine.

Does that mean, that these 6.2.x installations are not affected at all on your side or should it read like "6.2 works fine after applying the patch"?

The 6.2 installation already worked as expected.
The 7.6. LTS did after applying the patch. --> The installation was upgraded from 4.5 LTS to 6.2 and 7.6 finally
!!! BUT i just installed another 7.6 (fresh installation without upgrade) and it did work without patch. ATM I have no clue at all why.

If I find time I could inspect the issue further.

@Sebastian Kurfuerst: Can you please compare the LocalConfiguration of both instances? Are those on the same server?

I came across this issue, too :-(

We have two TYPO3 CMS 6.2.19 instances with a very similar setup (extensions, etc.). Both on the same server, same PHP binary (via FastCGI).
One works, the other one had this issue. Both instances show no differences in php.ini or Apache config and no relevant differences in LocalConfiguration.php (except encryption key, DB access details, etc.).

It looks like a restart of Apache solved this issue for me: service apache2 stop ; service apache2 start (make sure all processes are really gone before restarting)

This seems to match Marc Zimmermann's experience when he installed the Apache module "xml2enc" (during this process, Apache gets restarted, too).

The server features:

• Apache 2.4.10-10+deb8u4
• PHP 5.6.19+dfsg-0+deb8u1
• FastCGI interface (libapache2-mod-fcgid 1:2.3.9-1+b1)

I updated the extension list several time since the Apache restart for testing purposes, and do not get the exception any more.

Patch set 1 for branch TYPO3_7-6 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/47589

Patch set 1 for branch TYPO3_6-2 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/47590

Patch set 3 for branch TYPO3_6-2 of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/47590