Seems to me this is just saying: log in via the browser (with the right password... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

		timf on Feb 24, 2009 \| parent \| context \| favorite \| on: How to scrape data from sites you can't log into Seems to me this is just saying: log in via the browser (with the right password), then use the generated cookie with the scraping code. You can also do that with wget --load-cookies

geoscripting on Feb 24, 2009 [–]

True, you can use wget as well, but this way you have more control over your code.

timf on Feb 24, 2009 | [–]

For sure, I was responding to the title, it sounded like a security thing.

geoscripting on Feb 24, 2009 | | [–]

What did you thought this will be about? :)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact