I do get some good ideas when I am not intensely trying to think of how to solve a problem.

Not only walking, but taking a shower, running errands, relaxing in bed, practicing a hobby, allows me to think outside the box, come up with novel ideas and strange hypothesis that might work once tested.

I think the idea is putting yourself in a mental state that allows you to explore "off the rails".