Hello,
I have scraped data from a lot of websites (including email addresses, company details, map data etc.). Some sites were public while others used authentication so I'm familiar with things like cookies, headers, sessions.
I use Python and various libraries like requests, tornado, mechanize.
If you like you can send me the Python script and I will take a look at it. Afterwards if you are satisfied with my ideas and approach we can continue collaborating on this project.
Thank you for your time!
Best wishes,
Ionut