Find Jobs
Hire Freelancers

Build Simple Scrapy Crawler

$30-250 USD

Closed
Posted over 7 years ago

$30-250 USD

Paid on delivery
We are hiring a Python developer to create a standalone crawler program for a specific website using Scrapy. Target website content: aggregated announcements for events or ticket gateway. Applicants will be asked to complete version 1.0 of this program, and deliver all source code to the client. Estimated budget is $200 with some room for negotiation. The program requirements: - Built using Scrapy, callable from Scrapy CLI. - When executed, program must scrape ALL desired data from target website. Crawler may need to follow links within the target website. - Crawled data items should be cleaned using a simple format (specified by client). - Program MUST include a toggle-able test mode, which should check whether markup changes in the target website break the crawler. Please include a 1 to 2 line summary of how you would accomplish this with your proposal, in the format: "MY TEST MODE: (write your explanation)". - [Extended] Exclusive rights to numerous followup project opportunities will be considered if the project is completed satisfactorily. The applicant requirements: - Strong communication skills, proficient with English, and comfortable speaking on [Offsite communication is prohibited in the site]. - Required programming languages: Python (HTML, CSS is an advantage). - Strong preference given to those demonstrate previous experience with Scrapy. - More consideration will be given to applicants who either 1) provide links to their own open source projects, 2) provide links to contributions to Python community via tech blogs, Q&A forums, etc 3) provide references for past clients.
Project ID: 11287324

About the project

7 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
7 freelancers are bidding on average $195 USD for this job
User Avatar
I am an expert in scraping and crawling with a proven track record and would be an ideal choice for the project
$200 USD in 3 days
4.9 (74 reviews)
6.8
6.8
User Avatar
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$187 USD in 5 days
4.9 (119 reviews)
6.7
6.7
User Avatar
A proposal has not yet been provided
$200 USD in 2 days
5.0 (3 reviews)
3.9
3.9
User Avatar
I have an experience in web scrapping. About python: you are able to see such program in my portfolio, with mechanize module. Actually, I have more web crawlers I can show you, if you want to see it.
$200 USD in 3 days
5.0 (4 reviews)
2.9
2.9

About the client

Flag of KOREA, REPUBLIC OF
Gangnam, Korea, Republic of
0.0
0
Payment method verified
Member since Aug 3, 2016

Client Verification

Other jobs from this client

Hire a Web Scraping Specialist
$440 USD
Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.