"Human creativity is based on thousands of years of cultural evolution, many years of upbringing, and hundreds of hours of search and trial and error.
By the time a human reaches 18 years of age, they have been "trained" on approximately 20,000 to 70,000 Terabytes (20-70 Petabytes) of raw multimodal data.
All this happened while they were grounded in physical reality and received direct feedback from their actions.
And then there is the evolutionary prior, high-quality genetic data that has been fine-tuned over hundreds of millions of years.
So no, humans don't just magically pull out-of-distribution data from the platonic realm."
-- Alexander Kruel