Completed

Write a Python script to scrape a website and save data it to a single file

I need to scrape data from this website: [login to view URL]

The script must log in to the website, fill out a form, submit a request, then download data from a page that has links to futher pages that must be scraped for data.

I have included pictures of the pages that appear as someone would navigate through the process. I will describe it here as steps:

1. Log in to the website using a key (which I will provide)

2. Enter data into the form, some of which are text fields, and some of which are drop downs

3. Click on the Vessel Summary button

4. Scrape the data on the resulting Summary page

5. Click the detail button on each entry (row)

6. Scrape the data on the detail page

7. Move to the next row/entry

8. After getting the details for each entry/row on the first page, move to the NEXT summary page and repeat 4-7 until there are no more summary pages

Skills: Engineering, Javascript, Python, Software Architecture, Web Scraping

See more: web scraping python beautifulsoup, web scraping examples, python 3 web scraping, web scraping techniques, web scraping multiple pages python, web scraping tutorial, python get data from website, python web scraping to csv, python script scrape website, need help write python script operate telit module, need write python script telit gc864quad module, script scrape website, create save data excel file php script, php script parse email save data mysql, python script scrape web site, perl script scrape website, perl script scrape website rss, php script scrape website, python script crawl website, python script retrieving website data

About the Employer:
( 0 reviews ) Pittsburgh, United States

Project ID: #19642850

Awarded to:

jaimek91

Open chat fast, you are risk! I have a lot of experience in scraping as freelancer with scrapy/selenium/beautifulsoup (python) and Goutte (php). I also have developed a python script with implemented multithreading an More

$155 USD in 3 days
(20 Reviews)
5.0

29 freelancers are bidding on average $165 for this job

mingxiao2008

Hello, Dear How are you? I have read your project description and am ready for discussing with you about project. I have experienced in developing Engineering, Javascript, Python, Software Architecture, Web Scrapin More

$200 USD in 3 days
(112 Reviews)
8.0
ramzitra

Hi, I am interested in your project related to build a scraper to get data from marinetitle.com. I have checked the 4 screenshots, and have some questions/remarks : 1- What is the output format you need ( eg. CSV , SQ More

$280 USD in 7 days
(377 Reviews)
8.0
zhangyingtai

Hello sir Thanks for clear job description. I am a senior python developer with 9 years of experience about web scraping. I have fully understand the requirements and am confident with this project. I am using S More

$155 USD in 3 days
(112 Reviews)
7.5
PigtailXL

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Windows Desktop Apps Developer (C#, C++), Web Data Extractor & Automator (using d More

$250 USD in 5 days
(204 Reviews)
7.5
gangabass

First of all thank you for a detailed description! I'm one of the best Python and web scraping experts here (check my reviews) that's why I'm sure you'll be impressed with my work. I can provide you a Python scraping More

$180 USD in 2 days
(487 Reviews)
7.5
zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I can create you script in Python for ''[login to view URL] '' that will do all things that you More

$179 USD in 4 days
(92 Reviews)
7.2
polarjin2017

Hello? Nice to meet you. I am excited to work with you on this project. I am ready to start work immediately. So I think I can help you if you want. Here is on of my scrap with python working result. [login to view URL] More

$140 USD in 7 days
(112 Reviews)
6.9
schoudhary1553

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Pl More

$250 USD in 4 days
(76 Reviews)
6.6
brianconey

Hello How are you My name is Xu as python expert I have so scrpaer built before i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your postin More

$200 USD in 7 days
(62 Reviews)
6.3
stanislav103

Dear Hiring Manager. I am so excited to apply in your project. just went through the job description. I am an experienced web scraping and crawling expert using Python script. You can review my ability checking t More

$277 USD in 3 days
(51 Reviews)
6.5
hoisticdeveloper

Hi there, We understand your request because we build same project for our client we can provide you fast service Let me introduce our Company about .. Clientsoftech Solutions (Cs) is a leading Development professio More

$250 USD in 4 days
(20 Reviews)
5.9
alexwmsoft

Dear, employer. My name is Lee, I am an experienced web developer, and web scraping expert. I have good experiences in web scraping using PHP, Python, Java and so on. I read your job description, and I am interest More

$144 USD in 3 days
(22 Reviews)
5.8
narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects which involved Programming, scrip More

$140 USD in 4 days
(33 Reviews)
5.6
mrbrave

Hi, I have vast experience of developing tools for automating process on websites. I have 2 solution options for this process. a)Create python based script using selenium, which will automate Google Chrome. It wi More

$120 USD in 2 days
(60 Reviews)
5.3
mladenbiz

Hi, I'm a python dev specializing in web scraping and development, as well as in data processing and analysis. Site you need data from seems pretty straight forward on first glance, so i'm confident i can deliver the d More

$125 USD in 3 days
(28 Reviews)
5.4
BestService222

Hi, How are you? I am interested in taking up your project. I can complete your project on time and within your budget. I have worked on similar projects to what you are looking for, and I am confident I can exceed More

$140 USD in 3 days
(15 Reviews)
4.9
FreelancerTechX

Dear Sir/Madam, I fully understand your requirements. Ready to start ***************************************************************

$111 USD in 3 days
(9 Reviews)
4.2
shiyusun180409

*** I have checked your description, the link and attach file. I have good experience with scraping data from websites. I can do your project asap and as well. I want to discuss with you this project. Thanks.

$200 USD in 7 days
(14 Reviews)
4.3
tulga0911

Hi, Dear. Nice to meet you. I have rich experience in your project. I read your requirement in detail. I will complete your project within 2 days at most. Before I have been developed projects similar as your requireme More

$170 USD in 2 days
(3 Reviews)
3.5
lizzymoore8543

I'm a electrical engineer with over 8 years experience in Software & Web Development in both national and international market. My Expertise: Web Site - (PHP frameworks ,SPSS, Mintab, Joomla, Wordpress, Magento,Laravel More

$50 USD in 1 day
(1 Review)
2.6