To elaborate on your point, its not just chasing pointers, it’s that those pointers point into random heap locations, each of which needs to be allocated individually and garbage collected. Also, because of the haphazard locations of these objects in the heap, you have way more cache misses than you would with value types.

Julia comes fairly close.

And Julia's tuples, named tuples, and structs are value-types without pointers.