Find Jobs
Hire Freelancers

Need python script which scrapes articles from industry publications

$30-250 USD

Completed
Posted over 4 years ago

$30-250 USD

Paid on delivery
I'd like to scrape Car and Driver articles on vehicles over the last five years. Expected deliverables: 1) A tested and proven python 3 code base, preferably using the Scrapy library, which crawls the website and pulls car reviews (example: [login to view URL]). Need car reviews for last 5 years worth of cars. 2) Codebase includes testing, full commenting, and descriptive error messages 3) Scraping is “polite,” meaning it scrapes as a human would browse. 4) Proxies are optional and are able to be used if necessary 5) Project scrapes the key facts, like horsepower, torque, curb weight, and dimensions listed at the bottom of reviews. 6) The output of this scraping would be to a local MySQL database. Fields to populate database are make of car, model of car, year of car, all key facts under respective columns, hyperlink to review, title, and car review wording. Only need the heading, and p tags for the car review. Please include tags as one body of text and exclude actual tags.
Project ID: 21870097

About the project

21 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi. I can implement python script (with scrapy framework) which will scrape all data needed. PS: implemented up to a thousand scraping scripts, ex.: [login to view URL], [login to view URL], [login to view URL] (about 4 millions records), [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL] (about 20 millions of records), [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL], etc.
$180 USD in 5 days
5.0 (4 reviews)
3.5
3.5
21 freelancers are bidding on average $186 USD for this job
User Avatar
Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$220 USD in 5 days
4.9 (168 reviews)
7.8
7.8
User Avatar
Greetings! I can develop an automation script with python. Proxies may be required. I have full experience with web scraping. I have developed 80+ web scrapers and automation scripts with python beautifulsoup, requests, selenium, csv, excel and panda packages. I can scrape target data from any website and save in csv, excel or sql database. Looking forward to hearing from you. Regards.
$140 USD in 2 days
4.9 (42 reviews)
7.1
7.1
User Avatar
Hi, there! I saw your description carefully and I think it best fits on my skill set. I'm a Web scraping expert, I have more experience in python web scraping. Scraping is my major skill and I can build your project using different modules like Beautifulsoup and scrapy in python according to your requirements. And I can make a result file in any file format you want including CSV or JSON. I will send you the exact data you want by scraping. I will make the price reasonable and I will perfect the assignment in the deadline. I will provide continued support after the delivery of the final product. Please discuss your detail in chat. I am looking forward to working with you. Thanks
$200 USD in 7 days
5.0 (27 reviews)
6.0
6.0
User Avatar
Hi, I'm experienced bot developer and I can create a script to fast and accurately fetch all reviews. I see that website is fetching images separately from the data, but this is no problem for me. The hardest part is the text mining (extraction of car's make, model and year), but I have few ideas. Lets have a chat. Regards, Borna
$550 USD in 3 days
5.0 (23 reviews)
6.2
6.2
User Avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,,  , ,
$100 USD in 3 days
4.9 (112 reviews)
6.0
6.0
User Avatar
Sir,      I am well versed in these kind of jobs and can do your project as per requirement. **I am ready to start Waiting to hear from you. Regards
$98 USD in 2 days
4.9 (39 reviews)
5.6
5.6
User Avatar
Hello, sir Thank you for your job posting. I am an expert with web scraping with python selenium, scrapy and beautifulsoap and nightmarejs. I have developed many scripts that get data from website such as Yelp, Amazon, Cinemark and so on to csv file, images, html file and so on. I can also make even bypass recaptcha. If you want to see my past working, i can share with you. Please contact me for more discussion. Best regards.
$140 USD in 7 days
4.9 (18 reviews)
4.7
4.7
User Avatar
Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I'll deliver the exactly the code that you want! I hope to work with you!
$250 USD in 7 days
5.0 (6 reviews)
4.2
4.2
User Avatar
Hi, I have checked the website it loads articles using ajax but I have a way to solve that problem, send me message to discuss details. Best regards.
$140 USD in 4 days
5.0 (11 reviews)
3.5
3.5
User Avatar
Hi, we are a team of 10 data scientists with a statistics background and with an average 5 years of experience. We joined Freelancer recently. We have done a good number of projects on data scraping. We have experience in Big data tools (MongoDB, Cassandra, Spark, Scala) to create a database of scraped data. Also, we have experience in R, Python and successfully completed many Machine Learning and Artificial Learning projects. We can create Visualizations too for scraped data. Further discussion will give more clarity on goals. We will be happy to work with you on this project. We can discuss further details. Looking forward to hearing from you soon.
$250 USD in 7 days
5.0 (1 review)
3.3
3.3
User Avatar
Dear Client! Thanks for your job posting. I'm a senior web developer with over 5 years of experience and very strong in this scrape. I can complete your job within a few days. please contact me so that we can discuss more. Regard.
$140 USD in 7 days
5.0 (3 reviews)
2.8
2.8
User Avatar
I will help you with your project. I have a long experience both in python and R. Will do it as soon as possible.
$100 USD in 7 days
5.0 (1 review)
0.0
0.0
User Avatar
I am experienced software professional having worked in complex and huge software systems. I have developed GUI based tools in python for my company. I like your project and interested to dwell into it.
$220 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Santa Clara, United States
5.0
1
Member since Oct 19, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.