That's an incredibly thin argument (society loses because you don't let someone pay rent to live in your home). You have to deny the existence of second-order intangibles which seed first-order tangible economic value such as community and social cohesion. If you like, ownership-based behavioural incentives. A 'stake in society'.
You misunderstand my argument entirely. The problem isn't that society loses because you don't let someone pay rent in your home. Society loses because you don't let someone else live in your home for free, but you do let yourself do that. This is the value you extract from owning the land, which nobody else can extract.