Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

I've got a script for parsing my web logs which removes all the lines which match persistent indexers/bots/scrapers and any obvious automatons. Logs generally shrink to 40-50% of their volume, so I'd at least double CF's estimate.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: