Because they didn’t actually live in caves that often.

The image of these people living in caves arises from the fact that caves are where the preponderance of artifacts have been found from European Stone Age cultures. However, this most likely reflects the degree of preservation that caves provide over the millennia, rather than an indication of them being a typical form of shelter. Until the last glacial period, the great majority of humans did not live in caves, as nomadic hunter-gatherer tribes lived in a variety of temporary structures, such as tents[4] and wooden huts (e.g., at Ohalo). A few genuine cave dwellings did exist, however, such as at Mount Carmel in Israel.>

Wikipedia - Caveman

I agree, I’m looking for immersion and story. That said, I’m also willing to wait a few months for devs to fix all the bugs they should have removed before the rushed release dates.