Of course there are frameworks to do this for you, and I'm sure jwebunit will wo... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

		apgwoz on Feb 24, 2009 \| parent \| context \| favorite \| on: How to scrape data from sites you can't log into Of course there are frameworks to do this for you, and I'm sure jwebunit will work perfectly well. I guess I'm disappointed that the author didn't understand the fact that Firefox doesn't perform magic, and that a login page is no different than anything else being scraped.

ewiethoff on Feb 24, 2009 [–]

I'm disappointed the author didn't realize that he doesn't need Cookie Monster to see Firefox cookies: Tools -> Options -> Privacy -> Show Cookies

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact