nearly every http response is gzipped. unpacking automatically is a default feat... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

ruined 8 months ago | parent | context | favorite | on: Ask HN: How to stop an AWS bot sending 2B requests...

nearly every http response is gzipped. unpacking automatically is a default feature of every http client.

sim7c00 8 months ago [–]

Accept-Encoding i think would be logical on scrapers these days but maybe its not helpful idk. server should adhere to what client requests afaik.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact