Coming with proper user-agent sounds ethical. https://archive.org/details/archive.org_bot

Author/publisher are owning their content. Expecting work of others to always be free doesn't sound really ethical.