http://forge.typo3.org/http://forge.typo3.org/themes/typo3_forge/favicon/favicon.png?17058661692018-09-06T13:52:11ZTYPO3 ForgeTYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=3726012018-09-06T13:52:11ZRichard Haeserrichard@richardhaeser.com
<ul><li><strong>Category</strong> set to <i>SEO</i></li></ul> TYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=3900052018-11-01T20:58:34ZRichard Haeserrichard@richardhaeser.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Closed</i></li></ul><p>It is possible to add your robots.txt by a static route. See <a class="external" href="https://docs.typo3.org/typo3cms/CoreApiReference/ApiOverview/SiteHandling/StaticRoutes.html">https://docs.typo3.org/typo3cms/CoreApiReference/ApiOverview/SiteHandling/StaticRoutes.html</a> for more information.</p> TYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=3916442018-12-06T15:41:11ZRichard Haeserrichard@richardhaeser.com
<ul><li><strong>Status</strong> changed from <i>Closed</i> to <i>New</i></li></ul> TYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=3916462018-12-06T15:42:26ZRichard Haeserrichard@richardhaeser.com
<ul></ul><p>It still would be nice if TYPO3 can render a (configurable) robots.txt</p> TYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=3916472018-12-06T15:49:19ZAndreas Kienast
<ul></ul><p>What the robots.txt could do:</p>
<ul>
<li>Automatically add the sitemap.xml, if configured</li>
<li><del>Add <code>Disallow: foo</code> if page should not get indexed</del> (discussed with Richard, potentially dangerous as Google doesn't "forget" wrong configs so fast)</li>
<li>Add <code>typo3temp/var/</code> if in document root</li>
<li>Exclude <code>typo3/</code></li>
<li>Exclude <code>typo3conf/ext/*/Resources/Private/</code></li>
</ul> TYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=4064862019-09-24T12:19:47ZBenni Mackbenni@typo3.org
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Closed</i></li></ul> TYPO3 Core - Feature #85679: Add robot.txt functionalityhttp://forge.typo3.org/issues/85679?journal_id=4065162019-09-24T13:36:28ZRichard Haeserrichard@richardhaeser.com
<ul></ul><p>A little note why we closed it:<br />It is best practise to keep your robots.txt as minimal as possible. So that is why we will not include anything in core currently.</p>
<p>For more information see <a class="external" href="https://yoast.com/wordpress-robots-txt-example">https://yoast.com/wordpress-robots-txt-example</a> as well.</p>