At the speeds needed to reach the outer Solar System in the first place, you would need to intersect the planet's surface (atmosphere, whatever) to get anywhere near the slingshot effect needed to throw you back to where you came from. Essentially it would only be possible with a black hole or another anomalously dense object.