Web Crawler and Scraper

Hi, Nice to meet you. As a scraping expert, I can bypass any bot-detection service and I have strong experience with Amazon scraping. I can satisfy you in the end. please send me a message. thanks

Hey Good afternoon , Just finished reading the brief details and currently going through attached files . I see you have been looking for someone who has experience with these tech stacks Java, Python, C# Programming, PHP and Web Scraping. I will request you to review my profile, skills, projects and customer feedbacks to confirm that I will be good fit for this job. I would like you to start the chat so we can discuss the project in detail and we will see how it goes. Questions: 1. These are all the requirements? If not, Please share more detailed requirements. 2. Do you currently have anything done for the job or it has to be done from scratch? 3. What is the timeline to get this done? Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) Thanks and regards, Awais

Hi, my name is Selim. I am the Director of ANC, registered in the UK. I read your "Web Crawler and Scraper" project descriptions carefully before bidding. I checked the target url, and attached document as well... I got what you need and keen to discuss details when you are available... I am 5-star web scraping expert here at freelancer.com. Pls check my profile and 400+ reviews I received to have some idea about the quality of work we do offer... We had many similar web scraping tasks, including extraction and processing of large sized data from various sources, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply... Kind Regards, Selim

Hi there, I'm George and I'm an experienced web crawler expert. I have extensive experience in developing web scrapers from scratch and customizing automated web scraping solutions according to customer requirements. Recently, we created a custom web scrapping tool to scrape Amazon's top-selling products from selected categories and managed to bypass their robust anti-bot systems. The proposed project seems right up our alley. I would be more than happy to work on it and deliver a successful outcome. My team and I can develop a tailored system that will achieve your desired objectives. To proceed, I have the following questions: 1. What data sources are to be scraped? 2. How frequently do you want to scrape data? 3. What output format do you require for the scraped data? 4. Is there any specific software on which the scraper should work? 5. Do you prefer to host the web scraper on-premises or on the cloud? Thanks for your consideration and I look forward to hearing from you soon. Best regards, George

Hello, Hope you are doing great, i am expert in web scraping , I can easily scrape all the target data from the website using Python or any other script so you don't have to spend any time or effort doing it manually. Plus, I provide quality results quickly and efficiently within your budget. Lets connect through chat for further detailed discussion, i can start the work right after the discussion., thank you Gaurav D.

" Build a web scraping system for Amazon's top-selling products " sir i read your project brief and I will do your project Please review my similar portfolio https://www.freelancer.com/u/nabeelawais83 My Experience in this field for last 10 years and i m very consistent in my work i work almost 20 hours a day i am highly professional and master in Web designing and developing websites/ Apps field and i will do a great job on your project if you give me the chance and will make you 100% satisfy from my work . Please come to chat for discuss in details. I'm ready to start your project now. Nabeel

Hi, I am Senior Python script developer with 10 years of experience. I can build a script/bot by python with your instructions very short time. Can we discuss please? Thanks

We propose to develop a custom web crawler and scraper solution tailored to your data extraction needs. Our expertise in web scraping technology ensures accurate and efficient data retrieval from websites of your choice. We prioritize data integrity, scalability, and security throughout the process. Let's collaborate to empower your organization with valuable data insights and gain a competitive edge in your industry. A.S

Proposal for Web Crawler and Scraper Objective: Build a robust web scraping system for Amazon's top-selling products in selected categories, allowing configurable scraping frequency to meet specific requirements. Description: We propose developing a cutting-edge web scraping solution tailored to collect data from Amazon's product pages for top-selling items within designated categories. Our system will provide the flexibility to configure the scraping frequency, enabling data extraction twice a day or as desired. Additionally, it will be equipped to bypass advanced website anti-bot systems, ensuring seamless data retrieval. Why Choose Us: With over 10 years of experience in web scraping and data collection, I, Keshav Kalra, am confident in our ability to deliver exceptional results. Our team possesses the necessary technical expertise and in-depth knowledge of web crawling methods to overcome any challenges that may arise. We have a proven track record of successful web scraping projects and have consistently met client expectations. Our commitment to strong communication ensures that we understand and fulfill our clients' requirements precisely. We believe in maintaining transparent and efficient communication channels throughout the project's duration, providing regular updates and addressing any concerns promptly. Furthermore, our extensive experience in web scraping has honed our skills in identifying patterns, trends, and valuable insights from scraped data. This, combined with our analytical approach and sharp attention to detail, allows us to deliver accurate and actionable information. In conclusion, with our expertise, professionalism, and dedication to excellence, we are confident in our ability to develop a top-tier web scraping system for Amazon's top-selling products. We look forward to the opportunity to discuss this project further and demonstrate how our skills can benefit your organization. Note: Bid Amount And timeline is just a placeholder actual value would be provided after 1 to 1 discussion over chat

Hello, I will code a Python script using Scrapy. The data will be saved in a MySQL, SQLite, or MongoDB database; however, it can be changed later relatively easily. Since we're not going to use browser automation, the scraping won't be resource-intensive, and it can be hosted on a cheaper VPS. I will design a simple desktop GUI to input the configuration - categories, scraping frequency, the number of products to scrape, etc. Since most categories have a slightly different structure, it will take some time to make the scraper work in every case. What is the expected number of products to be scraped daily ? Considering that the bottleneck while scraping Amazon is obtaining enough quality proxies. The Amazon captcha can be solved automatically. As for the data points, I am not sure how to scrape the "# of products sold in the last month." Thank you for your time.

Dear Employer, I'm expert in web scraping, web automation and data mining projects. I have done many similar tasks. I will build a web tool to setup the scraping logic, configurations etc and manage the whole scraping system and the underlying scrapers will be run by cron jobs. Please, get in touch to discuss and understand all the details of your requirement. I will get each and every detail for you. I would love to help you and be the person who adapts to what you need. Thanks and Regards, DEBDULAL ROY

Hello, We are excited to hear about your project. As your required web scraping solution, we at Themexsoft can provide the best solution with our experienced team. We have a strong track record of successful projects internationally and we guarantee that our level 20 skillset is up to the task at hand. We understand that you are looking for a system that can collect data from Amazon's product pages for top-selling items in specific categories that bypasses advanced website anti-boy systems. We believe our expertise in PHP, Java, ASP, C# /.Net, MySQL/SQL Server, Joomla, WordPress template design jQuery JSON animation Android & iOS development SEO SEM integration make us the perfect fit for this project. Thnaks John

Hello! I understand exactly what you need for this project. This web scraping solution can collect data from Amazon's product pages for top-selling items in specific categories that bypass their advanced website anti-bot systems. I am the best fit for this project because of my extensive experience in web scraping, web application development, software development, and desktop app development. If interested, let us discuss it further and do your job. Thank you-

Hi there, I'm bidding on your project "Web Crawler and Scraper " Being an expert in C, and C++ programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .

Hello Paul O., We went through your project description and it seems like our team is a great fit for this job. We are an expert team which have many years of experience on PHP Please come over chat and discuss your requirement in a detailed way. Thank You

Yes,I can build this scraper for you.I have good working experience with Python,Data Scraping,APIs,Database,Django,JavaScript. Message me here.I am available to discuss more & start the work. Regards, Shalu

Hi I'm an expert in web scraping I have read your project description i can develop a web scraping solution that can collect data from Amazon's product pages for top-selling items in specific categories I worked on projects like yours I think I can finish more quickly than others.i will take less than 2 days I wait for your reply, I can start work now Thanks

Hello, my name is Asaduzzaman and I am an experienced software engineer with over 15 years of expertise in creating custom-made, user-centric websites and applications that help businesses achieve their goals. I understand that you are looking for a way to build a web scraping system for Amazon's top-selling products in selected categories with configurable scraping frequency. My specializations include SaaS, microservices, databases, and cloud computing with proficiency in cloud providers such as AWS and GCP. I would be more than happy to assist you with building this system. I have extensive experience in programming languages such as Go, PHP, TypeScript, JavaScript and Node.js which allows me to adapt to any project's requirements. Additionally, I provide complimentary support and bug fixes for 15 days following project completion. I believe that my skillset and experience make me the perfect fit for this project - please feel free to contact me if you would like more information or would like to discuss further!

Dear Client, First and foremost, we would like to express our appreciation for considering N&T Negocios y Tecnologias s.r.l. as your potential partner for this project. With over 20 years of experience in the IT industry, we have established ourselves as a leading company in the development of web, mobile, blockchain, and AI projects. In regards to your project titled "Web Crawler and Scraper," we have carefully reviewed the project description and objectives. Our team of experts has identified several proposal solutions that we believe will meet your requirements and deliver the desired outcomes. These solutions include: 1. Customized Web Scraping System: We will develop a tailor-made web scraping solution that will collect data from Amazon's product pages for top-selling items in specific categories. This system will be designed to meet your specific needs and configurations. 2. Configurable Scraping Frequency: Our solution will enable you to configure the scraping frequency as per your requirements. This flexibility will allow you to scrape the data twice a day or at any other frequency that you deem necessary. 3. Advanced Anti-bot Bypassing: Our system will be equipped with advanced techniques to bypass Amazon's anti-bot systems. This will ensure uninterrupted and efficient data scraping without any disruptions. In terms of architecture and technology, our experts have identified the best-suited options for this project. We propose the use of a distributed architecture that will ensure scalability, reliability, and high-performance. Additionally, we recommend utilizing Python programming language along with powerful scraping libraries and frameworks such as Scrapy and BeautifulSoup for efficient data extraction. Please note that the provided budget is approximate and subject to further discussion based on the specific requirements and complexities of the project. We kindly request you to review our proposal and provide us with any additional insights or requirements you may have. We are confident that our team's expertise and our proposed solutions will exceed your expectations. Thank you for your time and consideration. We eagerly await your response and the opportunity to work with you on this exciting project. Sincerely, N&T Negocios y Tecnologias s.r.l.

Hello Paul! I hope you're well. I'm a senior Scraper developer with experience in developing scraper using scrappy and headless browsers. I can deal with bypassing IP throttling limit, ban and captcha solve, storing the result in JSON, CSV and excel files. I've delivered more than 100 projects over time with 5* rating. Here are some of my skills necessary for this task. ➢ Python: Deep understanding of Python and libraries like Scrappy, Proxy, Beautifulsoup, lxml, Captcha ➢ Tools: Headless Browser, Selenium, Playwright ➢ Databases: MySQL, Postgres, Oracle, MongoDB ➢ Source Code Management: Git, GitLab, Bit-bucket, SVN ➢ Cloud Providers: AWS, GCP and Azure ➢ Containerisation: Docker, Kubernetes Best, Sonu

I understand you are looking for someone to build a web scraping system for Amazon's top-selling products in selected categories with configurable scraping frequency. I believe I am the best fit for this project because of my extensive experience in web development, specifically with PHP and Python, as well as web scraping. My skillset includes working with APIs, payment gateways and other necessary components to create an effective web scraping system that can collect data from Amazon's product pages without bypassing anti-bot systems. Additionally, my background in database management and Android/Ionic/Xamarin development makes me well suited to analyze and design coding for small, medium and big projects.