Were you being sarcastic? I've heard this before and it's usually considered that once someone gets married/has a family of their own, they simply will have to devote much less time to their profession/'hobbies' (like math) because of time constraints, and then they just start degrading due to lack of practice etc.
One of the times it was specifically brought up in reference to a known mathematician. The takeaway being that getting in a relationship, or even married, automatically disqualifies you from achieving anything of great importance in the future....made me pretty sad that it's such a common pattern of thought.
I'm not being sarcastic. Marriage and family gave me reason and impetus to get my crap together and focus. I am easily distracted by sophomoric pursuits--now I choose hobbies and what not that I can share with the kids. One we really enjoy is kite building.
But then, I started my family early. I didn't have much of an established pattern of productivity before. So my baseline comparison may be way off.