Thats just a distinction between the Observable Universe and the Universe. The observable universe should be labeled "Our" Observable Universe as what is observable depends on where you are. Imagine a sphere growing outward at the speed of light, this is what is observable this region is aka the Hubble Volume. Right beyond the edge there just hasn't been enough time for the light to reach our location. No woowoo required.
There are ongoing debates whether the actual Entire Universe is infinite or not.
There is only one Entire Universe; it's not a multiverse. And we observe it as a sphere, sized by the speed of light in every direction.
Trying to see beyond the edge would be like trying to peer out of a black hole. It would probably look blue, like Cherenkov radiation. (but I'm biased, due to having blue eyes).
If the Entire Universe is infinite, then it's eternal in time. And then we get philosophical again.
Again there needs to be a distinction between the Observable Universe and the Universe. No Physicist thinks the actual Universe ends at the edge of the Observable section. Most estimates put the Actual Universe as ~250x larger than the Observable Universe, if it is finite at all.
There are ongoing debates whether the actual Entire Universe is infinite or not.