There’s something weird about the naming scheme here.
- Article about X0 (Air Bud)
- List of articles about X1 (Dogs playing basketball)
- Lists of articles about X2 (Dogs playing sports)
- List of lists of lists
Level 3 should have been “List of lists of articles”. And if 4 had been fully specified as “List of lists of lists of articles about X3”, it wouldn’t contain itself.
The one example could be flawless, but the output of an LLM is influenced by all of its input. 99.999% of that input is irrelevant to your situation, so of course it’s going to degenerate the output.
What you (and everyone else) needs is a good search engine to find the needle in the haystack of human knowledge, you don’t need that haystack ground down to dust to give you a needle-shaped piece of crap with slightly more iron than average.