Find Jobs
Hire Freelancers

Website Crawler

₹600-1500 INR

Closed
Posted about 1 year ago

₹600-1500 INR

Paid on delivery
Hi! I'm looking for a freelancer to create a website crawler for my project. While I'm not completely certain at this time, I believe that I need the crawling process to be automated. I would like this crawler to be able to traverse both static and dynamic websites, and extract text from them. If you have the expertise necessary to help me with this project, I'd love to hear from you!
Project ID: 36301093

About the project

5 proposals
Remote project
Active 1 yr ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
5 freelancers are bidding on average ₹2,040 INR for this job
User Avatar
Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg
₹600 INR in 7 days
4.9 (9 reviews)
4.1
4.1
User Avatar
Dear client, Thank you for considering my bid for your website crawler project. I am a professional freelancer with extensive experience in web scraping and data extraction. Based on your project requirements, I suggest using Puppeteer, a powerful Node.js library, for developing the web crawler. Puppeteer provides a high-level API to control headless Chrome or Chromium browser, which can be used to interact with websites dynamically. I have worked extensively with Puppeteer, and I am confident that I can deliver the results you need efficiently and effectively. With Puppeteer, we can automate the crawling process to traverse both static and dynamic websites and extract text from them. I will work closely with you to determine the best approach for your specific requirements and ensure that the crawler is configured to extract the relevant data you need. I will also provide the data to you in a usable format. I am committed to delivering high-quality results within the given timeframe and budget. I am also happy to provide regular progress updates and answer any questions you may have during the development process. Thank you for considering my bid. I am excited to work with you and help you achieve your goals. Best regards, Akhmadjon
₹1,050 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
As a self-employed, reliable, and highly experienced Freelancer with expertise in web/graphic design, social media, and brand messaging, I am certain you will find my skills and talents to be of value. With this in mind, I invite you to consider the enclosed resume detailing my experience and credentials as you look to fill Roundup Media’s needs. From consulting with clients and developing initial ideas and concepts to managing all facets of projects and coordinating with cross-functional team members, my experience has prepared me to excel in this freelance capacity with Roundup Media. With my impressive professional achievements in graphic design and marketing, my additional strengths in business development, project scheduling and budgeting, and superior client service position me to thrive in this challenging and creative position. Highlights of my background include… More than 13 years of excellent freelancing experience supporting a range of clients in visual identity/branding, web and graphic design, social media consulting, marketing communications, copywriting, and editing. Consulting with and managing special projects from inception through execution for global and emerging brands across diverse industries. Building organizational websites using knowledge of coding, design principles, SEO/SEM
₹1,050 INR in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
Mumbai, India
0.0
0
Member since Mar 31, 2023

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.