TYPO3 Forge

2005-09-27

16:21 TYPO3 Core Feature #14798: Robots.txt and indexed search

Here's the RFC:
3.3 Formal Syntax
This is a BNF-like description, using the conventions of RFC 822 [5],
ex... Jody Cleveland

2005-06-14

18:27 TYPO3 Core Feature #14798: Robots.txt and indexed search

I would think anything listed in robots, as long as it was within the site. More like this one:
http://www.mysite.... Jody Cleveland

2005-06-06

18:45 TYPO3 Core Feature #14798 (Rejected): Robots.txt and indexed search

I've got a handful of those pdf files that I don't want
indexed. So, to satisfy google, and other search engines, I ... Jody Cleveland