Django web scraping app jobs

...looking for a highly skilled Django developer who can help me build a social networking site with a focus on user engagement, similar to Facebook. The site will have the following main features: - User Registration and Login: The registration and login process should be seamless. Users should be able to register using their email and a password. - News Feed: The news feed should display posts primarily from the user's friends. This is a crucial feature for the site, and it should be designed to encourage user engagement and interaction. - Messaging System: The site should have a robust messaging system that allows users to communicate with each other privately. Ideal Skills and Experience: - Proficiency in Django: I need someone who is well-versed in Django...

...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...

...spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch with your relevant exper...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including ...

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501

I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in...and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio that demonstra...

I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.

...skilled web developer to improve and update our existing Django-based website. The project involves: Menu Bar: Update and ensure consistency with multilingual support (Swedish, Danish, English). Contact Form: Implement validation, translations, CAPTCHA, and backend management. Multilanguage Support: Set up inputs for Swedish, Danish, and English without auto-translation. Articles and Blogs: Improve layout, image handling, and formatting consistency. Search Function: Enhance search to include titles and body text. Main Picture: Add functionality to change the main picture with size guidelines. Home and About Pages: Ensure consistent formatting and editable content. DNS and Email Setup: Correct domain pointers and enable email functionality on server. Proven experience with...

I'm seeking a skilled web developer to assist with the creation of an informational website. I have a strong background in web development myself but am currently swamped with other tasks, so I need someone to take the helm on this project. Here are a few pertinent details: - Expertise: As I too am knowledgeable in web development, I'm looking for someone who can not only develop a website from scratch but also brainstorm and come up with innovative ideas to make the website more engaging and user-friendly. - Flexibility: I didn't specify a preference for a specific framework, so whether you are skilled in Django, ReactJs, or AngularJS, you're welcome to apply. This means you have a certain amount of freedom to choose the tools you'd l...

We are in the final stage of migrating an existing Django Project to a new machine in a docker compose stack. The database is already moved over. We are stuck with python dependency issues. You need to have good knowledge in - Django and Python3 - Docker, especially Compose stacks - Postgresql You will be working with a system admin who is in the middle of the migration and take over the dependency part, tmate will be used to work together. If you have read this, please add "HDJX34K" to your bid or it will be considered spam, ignored and removed. Your job: - docker compose build - have a look at the python dependency issues - try to resolve them and rebuild. - eventually adjust Django's accordingly. We want this work done now, and you must be able to star...

...and user experience. - Maintain high standards of code quality and push for continuous improvement. **What You Need:** - BS/MS in Computer Science, Engineering, or related field. - 2-3 years of full-stack development experience, with significant focus on mobile apps. - Strong proficiency in Flutter or similar, front-end technologies (HTML5, CSS3, JavaScript), and backend development (Node.js, Django). - Experience with databases (SQL & NoSQL), cloud services (AWS, Google Cloud, Azure), and versioning tools like Git. **Why Join Us?** - Flexible working hours and a chance to work in a dynamic, fast-paced environment. - Continuous learning and professional development opportunities. ? **Apply Now!** Send your resume, a cover letter, and work samples/portfolio demonstrating ...

Hello, I'd like to correct an error I have on our Python/Django website hosted on PythonAnywhere. Here are the logs: If you think you can fix this bug, please contact me via Freelancer.

I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...

...need of a competent Python Django developer who can handle complex backend development and database integration tasks and run code as offline. Key Responsibilities: Develop, test, and maintain robust, scalable, high-quality software solutions. Design and implement new features and functionality. Write clean, maintainable, and efficient code. Develop RESTful APIs to support front-end functionality. Integrate user-facing elements developed by front-end developers with server-side logic. - In-depth understanding and experience of backend operations using Python Django. - Managing and integration of the database with the application. - Maintenance and improvement of existing codebase for optimal functionality. Desirable Skills: - Proven experience in Python Django ...

I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.

Our project aims to enhance the Django website running on Ubuntu by addressing several key issues. We will streamline Google registration, fix email registration to avoid redundant data requests, and update the logo. We'll verify email confirmation, resolve logout errors, and ensure the machine names display fully. We'll adjust font sizes, reorganize dashboard boxes, correct console errors, and fix icon colors. Additionally, we'll refine machine information display, adjust button states, and update dropdown menu functionality. Finally, we'll correct API settings visibility and fix data display issues on the profile page and other sections.

I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.

I'm looking for a skilled AI, Flutter, and Django, python, developer to work on a project with the following key aspects: - AI Integration: The primary focus will be on implementing machine learning technology in the application. You should have a solid understanding of AI principles and how they can be leveraged in a mobile application, in this case using Flutter. - Cross Platform Development: The Flutter application will be targeted for both Android and iOS platforms. You should have experience in developing cross-platform applications and understand the nuances of each platform. - Django for CMS: The Django framework will be used to create a robust Content Management System (CMS) for the project. You should be proficient in Django and have exper...

...that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool that c...

...of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant should not only have the required technical skills but also the capability to deliver quality and timely results. Please showcase your experience in web scraping and the relevant tools you intend to use to ens...

I am in need of an experienced Django developer to debug and troubleshoot issues within my existing Django project. Specifically, I have been encountering issues with the nginx server. Key Responsibilities: - Debug and troubleshoot existing Django project - Resolve issues related to the nginx server Ideal Skills and Experience: - Proficient in Django web framework - Expertise in troubleshooting and debugging Django projects - Experience with nginx configuration and troubleshooting - Strong understanding of database models, views, and templates in Django - Ability to efficiently integrate third-party libraries if necessary Please note that this project is primarily focused on fixing issues within an existing project rather than creating ne...

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

I want to create a nutritional analysis software that helps manufacturing companies, restaurants, or other food service businesses manage nutritional information. The software should allow users to input an ingredient from a database, customize data, and quickly break down its nutritional values. Example of tools and technologies needed: Programming Languages: - Backend: Python (Django, Flask), Node.js (). - Frontend: JavaScript (React, Vue.js, Angular) Testing: - Selenium, Jest Version Control: - Git (GitHub, GitLab, Bitbucket)

I'm looking for a...Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I value clear communication and timely delivery. Looking f...

I'm seeking a talented Python Django developer to work on my project. Skills and Experience: - Proficiency in Python and Django framework

I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

I'm currently in search of a seasoned Django developer to assist me in integrating our project with Stripe's API. This is a crucial element of our application, and I'm looking for someone with a proven track record in this specific area. Key Responsibilities: - Develop a seamless, secure and efficient integration with Stripe's API - Ensure the integration is scalable and can handle a growing user base - Regularly test and monitor the integration to ensure its reliability and performance Skills and Experience: - Extensive experience working with Django, particularly on API integrations - Proven expertise in integrating applications with third-party APIs, with a particular focus on Stripe being highly desirable - Strong understanding of security protocols...

We are in the middle of migrating Django to a new server. - Both servers run Ubuntu 20.04, postgres 12, python2.7 - The Django Project is already transferred over - Nginx has been configured - Postgresql has been setup Our struggle is to get the actual application up and running again. Your job will be to: - help to perform a clean export of the postgres database on old server - help to import the postgres database on the new server - ensure the Django application is coming back up smoothly The work will be done using shared tmate ssh sessions.

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handl...and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store d...

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise....

...in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpages, indicating what needs to be extracted/copied to set up the new flow bymyself in the future. For example, on this web page, by pressing F12, yo...

...data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - Proficiency in web scraping

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I would li...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous ex...to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or auto...

Start your offer with the word in the attachment, otherwise we dropp you out. We are looking for a database with websites, HAVING EMBEDDED YOUTUBE Videos on their sites. Prepare a list with : Name of the company, youtube Channel, Link to the first youtube video you find on the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we have a longterm Partnership. To decide who is our partner and to see your un...

scrape data from darty site and export it into excel file.

I'm looking for a Python developer to assist with a variety of tasks on a medium-scale project. This would include web development, data analysis, automation scripting, and web scraping. Your responsibilities would cover: - Web Development: Creating and maintaining web applications using Python frameworks. - Data Analysis: Handling and analyzing data to derive insights. - Automation Scripting: Developing scripts to automate manual tasks. - Web Scraping: Extracting and structuring data from websites. Communication is key, and I'd prefer to receive regular updates and progress reports via email. The ideal candidate for this position will have experience with each of these tasks and be able to work on a medium-sized project.

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I require an experienced Web Developer to undertake a project we have. The website we need is a comparison website for Coach hire. This will entail a booking system where Coach companies (Operators) will bid/tender for work etc. Below are the features. User Registration and Authentication: • Users can sign up using their email or social media accounts. • User accounts store personal information, trip history, and preferences. Operator Registration and Authentication: • Coach operators can register and provide details about their services, pricing, preferred locations, etc. User Dashboard: • Users can submit trip details including location, and passenger count. • Users receive quotes from multiple operators. • Users can view and manage their tri...

I am currently in need of an experienced Django developer to assist me in deploying my Django web application on a VPS hosting provider. To bid on this project, you should: - Have intermediate to advanced level experience with Django and its related technologies. - Be proficient in MySQL, as this is the specific database system that my Django application is built with. - Understand VPS hosting thoroughly. Your role will be to guide me through the deployment process, ensuring that the application runs smoothly and functions as expected on the VPS host. Please show proof of similar projects handled in the past. Your time commitment should be immediate and full-time until completion of deployment. Your proposal should include a plan of action detailing ...

I'm in need of a skilled freelancer who can perform daily scraping of job titles from Indeed. Ideal Skills and Experience: - Proficient in web scraping, particularly from Indeed - Able to automate the scraping process on a daily basis - Competent in delivering data in CSV format Data Update Frequency: - It's essential that the scraping is carried out daily Delivery Format: - The scraped data should be provided in a CSV file Looking forward to your proposals.

We are seeking a Flask (Python) developer to set up a dashboard for our project using the following template: Please provide a...Contains one disabled “Buy now” component with Free plan • /admin o Table of users with 3 fields (email, name, phone) and pagination All features should be implemented with server and client side input data validation, adhering to best practices for security, performance, and extensibility. Key Requirements: - Strong proficiency in Python - Experience with relevant frameworks/libraries such as Django, Flask, or Pandas - Strong problem-solving skills and the ability to work independently Please apply if you're a Python expert with a diverse skill set and are looking for a flexible, ongoing opportunity.

I'm seeking a skilled Senior Python Developer to assist with a project that involves a blend of web scraping and data analysis, with a focus on the following tasks: - Extracting data from multiple websites - Automating data extraction and parsing - Analyzing and visualizing scraped data The ideal candidate should have: - Proficiency in Python, with a strong understanding of AI and Machine Learning - Hands-on experience with web scraping, particularly working with diverse data sources - Ability to automate data extraction and processing efficiently - Adept at data analysis, with the ability to visualize and interpret data Although I haven't specified any particular tools or libraries, your familiarity with tools like BeautifulSoup, Scrapy and Selenium...