HN2new | past | comments | ask | show | jobs | submitlogin

It would be nice if IA could create a browser extension or TLS-intercepting proxy that end users can run over their own computers and connections, allowing crowd-sourced scraping. It would need an allow/deny-listing feature for sites to passively crawl, and I'm not sure how you could prevent data poisoning, but it would at least get around the issues of blocking.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: