TYPO3 Core

Very nice to see that indexed search will get a refresh!

One of the most important things that I think can be improved on indexed search is the documentation.
I have tried to deploy indexed search many times now in the past years and I still don't get it. It seems that indexed search can do a lot but I don't know how to unleash it.

Just a few things:
- what's up with the crawler configuration objects and indexing configurations? What's the difference? How do I use it in some typical cases? I've studied all available documentation for hours or even days and I don't get which one to use and if I should use them together.
- There are so many things to configure and documentation is scattered, again indexing configurations, crawler configurations, tsconfig, different crawler cli processes, etc.
- In many cases you have set up a nice website with for instance tt_news and a tt_news plugin limited to categories, maybe multiple tt_news plugins showing different categories. It seems very trivial that indexed search and the craweler should just be able to "crawl" your site like google does and respect the nice frontend that you have set up. Somehow it seems that indexed search and the crawler can't do this. As far as I get it you are limited to a special crawler configuration for one page where your tt_news will show up and all your news (regardless of categories etc.) will be indexed on that page.
- If I delete something it still in my search index, how do I prevent this?

I can name a few other things, but my point is that I just don't know how to set it up properly, specifically in combination with the crawler. And of course you will want this crawler as you don't want to rely on a user to visit your page in order to get it cached and get it in your index.

So I think that before adding new features it would be very important to have a good manual so that indexed search is easier to implement in the first place. I see that many people are looking for other search solutions just because they don't know how to set up indexed search.

Hope to hear your opinions on this! And I would like to help in making this manual, but as said before I'm lost too.

Best regards,

Bart Dubelaar