You're not the only one. If you read the opinions in United States v. Jones, the supreme court makes a pretty big distinction between the kinds of surveillance a police officer could reasonably do on their own, versus the scaling up that technology allows, and how that might kick otherwise allowed surveillance without a warrant to requiring a warrant just about the sheer amount of information being acquired. And that's even with data that could be available from watching from public streets, if there were enough officers to watch everyone.