Scraping multiple pages python scrapy jobs

I'm in need of someone to help me scrape a website daily, note down a list of traders and run some checks on them. Qualifications: - Knowing how to use a computer. Tasks Involved: - Visit the website daily, note down a list of traders, and run some checks on them. - This needs to be done by hand, as it cannot be automated due to Cloudflare.

I'm seeking a skilled data analyst to evaluate head count turnover within my company on a weekly basis. I'd like to conduct this analysis using multiple measures - by percentage, number of employees, and over various time periods. As the ideal candidate, you'll have: - Proficiency in data analytics - Experience with employee data and turnover metrics - Ability to offer insights based on complex data - Capabilities to deliver weekly reports and insights Your task will include: - Parsing sales, customer, and financial data - Calculating turnover rates in terms of percentages, numbers, and durations - Producing a report every week with a detailed analysis of findings. Your ultimate goal will be to use data to help understand and reduce our turnover rate. Solid experi...

...market trends in specific regions. This will help inform business decisions and strategies. Responsibilities: Collect housing data from multiple sources, ensuring all data is accurately gathered in compliance with all applicable laws and website terms of service. Analyze data related to rental amounts, property types, locations, and amenities. Provide detailed reports comparing market trends, prices, and available amenities. Create visualizations that clearly illustrate market dynamics. Requirements: Proven experience in data collection and analysis, particularly in real estate or similar markets. Strong proficiency with data analytics tools (Excel, Python, R, etc.). Ability to interpret large amounts of data and to multi-task. Strong analytical skills with attention to...

...project: 1. Develop a web scraping script using Python (e.g., BeautifulSoup, Scrapy) to extract data from relevant grant databases and websites (if possible, considering anti-scraping measures). Sites to be scraped: 2. Design a database schema to store the extracted data. 3. Write scripts to clean, transform, and load the data into the database. 4. Design a WordPress directory listing interface with search filters to display the grant information. 5. Develop a user interface to query and display the grant information based on customer criteria 6. Create a Python plugin for WordPress to automate the scraping work, using tools like WP-Python or PyWP. This plugin would allow for scheduled scraping, data updates, ...

Overview: Our company is a provider of IT and Managed Service Provider (MSP) solutions, committed to delivering top-tier services to our clients. We are seeking a dynamic and driven Outbound Sales Representative to join our team. This individua...experience in outbound sales, preferably in the technology or MSP space. Strong understanding of IT services, including managed services, cloud solutions, and cybersecurity. Exceptional English communication skills, both written and verbal. Ability to work effectively in the US EST time zone. Proficient in using CRM software and sales tools. Strong organizational skills with the ability to manage multiple tasks and priorities. Self-motivated and results-oriented with a proactive approach to sales. Ability to work independently and as part ...

As the owner of an advanced security level website, I am seeking professional ha...professional hacking services to conduct thorough penetration testing. The key focus areas would be: - User Authentication Process: Probe for any weak links in our login and authentication systems. - Data Encryption: Assess the robustness of our data encryption protocols. - Server Security: Evaluate potential weaknesses in our server security. Ideal applicants would have significant experience with Python-based hacking tools and a proven track record in cybersecurity. Knowledge of advanced security measures and the ability to recommend improvements after testing is highly desirable. Please provide evidence of your skills and previous work in your application. Make sure your proposals are competitive...

...create a sophisticated SERP analysis tool specifically for Google. - Your main task will be to develop a tool that can accurately analyze Google's search engine results pages (SERPs). - I'm looking for someone who has experience in developing software that can parse and interpret SERP data effectively. - While I'm not looking for a full suite of features, ensuring that the tool can provide a comprehensive SERP analysis is crucial. - The tool should be user-friendly, intuitive, and capable of generating clear and concise reports based on the analysis conducted. Given the nature of the project, expertise in web scraping and data analysis would be highly beneficial. Familiarity with Google's search algorithms and ranking factors would also be advant...

Attach a self-introduction Engli...back-end technologies, then we want to hear from you! ? What We Offer: Exciting projects in a collaborative environment Opportunity to work with cutting-edge technologies Competitive compensation package Room for professional growth and development ? Requirements: Strong proficiency in both front-end and back-end development Experience with technologies such as JavaScript, HTML/CSS, React, Node.js, Python, etc. Solid understanding of web development principles and best practices Excellent communication skills in US English (native fluency preferred) If you're ready to take your career to the next level and become an integral part of our company, don't hesitate to reach out! Send your resume and portfolio to me. Let's build somethi...

...2016 Proficiency**: A thorough understanding of Microsoft Dynamics GP 2016 is essential for this project. Previous experience working with this ERP system is a must. - **Database Manipulation**: Given the preference for direct database manipulation, the selected freelancer should be proficient in creating secure, efficient, and reliable integrations. - **Data Formats**: The ability to work with multiple data formats, such as CSV, XML, and JSON, is crucial. - **API Development**: Knowledge and experience in developing custom APIs will be an added advantage for the successful execution of this project. If you have experience in ERP integrations, particularly with Microsoft Dynamics GP 2016, and a proven track record of delivering similar projects, we would love to discuss this ...

I'm a beginner looking for a tutor to help me learn and understand Git and Python, with a focus on branching, version control, Python syntax and functions, as well as building Machine Learning (ML) and Artificial Intelligence (AI) models. My preferred learning style is through hands-on projects. The ideal candidate should have the following skills and experience: - Proficiency in Git and Python - Experience with version control, branching and merging - Strong understanding of Python syntax and functions - Background in building ML and AI models - Ability to teach through hands-on projects.

I'm in search of a WordPress expert to integrate LiveChat service on specific pages of my website. My requirement is detailed below: - A seamless integration of LiveChat on certain key pages of my website. - Integrate LiveChat with a rest endpoint Here are the specifics: - The LiveChat service is to be integrated only on specific pages. The specific page is a 'Get rate now' page. - Rest endpoint REST endpoint is Skills required: - Proven experience with WordPress and LiveChat integration. - Understanding of website layout and design principles. - A keen eye for detail and commitment to providing top performance. If this aligns with your skill set, I'd love to have a conversation. Looking forward to working with a professional

I'm in need of a freelancer who can help me parse my VCF file a...my VCF file and convert it to a different format. The main goal of this task is to extract the genotype information from the file. input will be VCF file (from ONT whole genome run) and csv file with columns containing rsID, chromosome number, position. output will be same as input csv file, with extra column showing genotype from VCF at the given position can run on Mac shell so either perl or python would be fine. Ideal Skills & Experience: - Proficient in parsing VCF files and understanding genotype data - Experience in converting files to various formats like CSV, TXT, and XLS - Attention to detail to ensure accurate extraction of the data - Knowledge of any data validation methods would be a plus. shou...

I'm in need of a Stable Diffusion expert who can create a set of workflows for my web application. The main goal is to achieve the highest percentage of character and image consistency possible The workflows should: - Creating a character from a chatbot prompt/preset selections - Inserting characters (user can insert multiple) into images given but a chatbot image description, in different poses, interacting with prompts etc.. Please let me know the highest percentage of detail consistency you can achieve using Comfy ui workflows.

Please Sign Up or Login to see details.

I'm looking for a proficient web scraper who can extract text content from a specific website on a daily basis. The scraped data should be compiled and delivered in a spreadsheet. Key requirements include: - Daily scraping of text content from the designated website - Compilation and formatting of this data into a spreadsheet Your experience in web scraping, data compiling, and spreadsheet management will be greatly valued for this project. Accuracy, timeliness, and consistent daily delivery are crucial aspects of this job. Understanding of automation tools for data scraping would be a big plus. I am looking to collate some data from this website and need an ongoing scrape of this website to set up an ever-updating excel spreadsheet with the fields as per the...

I'm in need of a Python GUI software to automate sending messages through Google Voice. The software should be able to perform the following functions: - Send messages to individual contacts on Google Voice - Support precise date and time scheduling for these messages -Automated Sending with customized message example: message example {name} and {adsress} -Custom delay settings for each message -Multiple Profile Sender (custom threads) with multiple Proxy support (enable/disable proxy) -Auto login accounts - Auto Skip Terminated Accounts -License system for users -Sending reports Ideal Skills and Experience: - Proficient in Python programming - Experience in developing GUI applications - Familiarity with Google Voice API is a definite plus - Strong under...

...management system for PC, which is installed in the Windows operating system and allows editing solutions and playing the solutions on LCD or LED displays. - The software will be SAAS Based, On which multiple clients will be added, and the APIs of the device sold will be integrated into the Software. - This software will have a variety of media: you can add general windows, cut-to-display windows, Office documents, images, videos, GIFs, text, colorful text, digital clocks, analog clocks, timers, weather, RSS, and streaming media. The only change from the demo software is that it will be SAAS-based, Multiple clients will be added based on plans and packages, and APIs of the devices will be integrated for the clients added. The user Manual for the software is attached, ...

...Functionality Description Authentication and User Management User Authentication with NextAuth and Google: Integration with NextAuth to enable user login via Google. Secure OAuth2 authentication flow to ensure user data protection. User registration through Google account, streamlining the sign-up process. Account and Subscription Management: Each account can manage one school, which can have multiple locations (campuses). Admin dashboard to manage subscriptions and assign school management capabilities to each account. Ability to sell subscriptions, where each subscription corresponds to a single school with its own set of locations, teachers, and resources. Role-based access control: Admin Role: Full access to manage the school, including locations, teachers, classes, and sch...

I'm seeking a dependable freelancer for a weekly web data extraction task. The primary purpose of this extraction is for market research analysis. Key Responsibilities: - Conduct weekly web data extraction for market research purposes - Deliver the extracted data in an Excel spreadsheet format Ideal Skills and Experience: - Proficiency in web scraping and data extraction - Previous experience with market research data - Strong attention to detail and reliable turnaround time

Description We are seeking an experienced and creative jewelry artist/designer to collaborate with us on creating unique tungsten ring designs for our business. The ideal candidate will have expertise in CAD software, a strong understanding of materials and manufac...SolidWorks) and other design tools. *Strong knowledge of materials, and manufacturing techniques relevant to jewelry production. *Creative flair and ability to translate conceptual ideas into tangible design concepts. *Good communication in English, and ability to work collaboratively in a remote way. Additional Information: * This is a freelance position with the potential for ongoing collaboration on multiple design projects. *Remote candidates are welcome . Budget: *Budget is negotiable based on experience and proj...

Help with repetitive data entry tasks. As a potential programmer, this project involves creating a local program capable of extracting a single line of data with multiple fields from a Google Sheet and transferring it to 10+ different multi-page website forms that require unique login information. Additionally, the program should generate PDF documents on the target websites based on the transferred data and save them with named files corresponding to the original Google Sheet. It is crucial to incorporate error handling, data validation, mapping, and security measures into the program. If you are interested in working on this project, please provide details of your relevant experience and approach for ensuring its successful completion. The program must be compatible with the MAC...

I'm seeking an experienced professional in the field of Electrode Impedance Tomography to work on a project with a focus on analyzing tissue conductivity. Key Requirements: - Ability to conduct Electrode Impedance Tomography with a focus on tissue conductivity - Experience in interpreting and analyzing the collected data - Strong background in medical imaging and/or related fields P...Impedance Tomography to work on a project with a focus on analyzing tissue conductivity. Key Requirements: - Ability to conduct Electrode Impedance Tomography with a focus on tissue conductivity - Experience in interpreting and analyzing the collected data - Strong background in medical imaging and/or related fields Proven experience with Electrode Impedance Tomography using EIDORS (Matlab) or pyEIT ...

...and technologies to implement best practices Requirements: - Proven experience in WordPress and WooCommerce development - Strong understanding of PHP, HTML, CSS, JavaScript, and MySQL - Experience with theme and plugin customization - Knowledge of SEO best practices - Ability to work effectively in a team environment - Excellent communication skills and attention to detail - Ability to manage multiple projects and meet deadlines Preferred Qualifications: - Experience with RESTful APIs and third-party integrations - Familiarity with version control systems like Git - Knowledge of web performance optimization techniques - Experience in developing custom WooCommerce extensions If you have a team that meets the above criteria and are interested in a long-term collaboration, please...

I am in need of a professional who can develop a comprehensive Visa Application System to support appointments and applications for different types of visas, mostly for employment purposes. Key Requirements: - The system must be able to process 2-5 different types of visa applications. - It should support multiple European languages. - The system should handle appointment scheduling for Visa Application Centers (VFS). Ideal Skills/Experience: - Proficiency in developing web-based systems, especially appointment and application systems. - Experience in multilingual system development, especially European languages. - Knowledge of the Visa Application process and system requirements is a plus.

I'm looking for a developer with Cordova expertise to help resolve a specific issue in my Android app. Key Responsibilities: - Troubleshoot and fix the issue of javascript making multiple server requests - Run through the build and identify other potential issues Requirements: - Strong experience with Cordova, especially with versions 10 or newer - Solid understanding of javascript and its behavior in Cordova environment - Ability to navigate and troubleshoot complex app codebases - Familiarity with identifying and resolving app build issues - Excellent communication skills and a collaborative mindset You'll be provided with: - Full access to the app's source code - Any additional information or resources you may need to understand the app's architecture and ...

Post a testimonial on Google Business Link below from the Text file along with your own comments from ChatGPT. Google Maps link: Multiple Winners possible!!

...Profile: An individual profile for each user, where they can manage their reviews, profile information, and settings Game Review Content: Each game review should include: - The Game Title - A Detailed Description of the Game - A Rating Ideal Skills and Experience: - Proficiency in web development, particularly in creating dynamic and interactive websites - Experience in creating websites with multiple user roles and permissions, and user-generated content - Understanding of UI/UX design principles to ensure a user-friendly experience - Knowledge of security practices to maintain the integrity of the platform - Strong communication skills to coordinate effectively with the client and possibly other team members - Previous experience developing review websites or platforms will ...

I'm in need of a Python Jupyter expert who can support me in the development of a machine learning model. Here are the specifics: - **Task**: The primary task revolves around machine learning, specifically model development. - **Current Project Stage**: The project is currently focused on model development, so we've already completed the data collection phase. - **Model Type**: The model type we're focusing on is classification. Ideal candidates should have solid experience in machine learning, particularly in classification models. Expertise with Python and Jupyter is also a must. If you have a good handle on data analysis and statistics, that would be a huge plus.

I'm seeking a professional to build a system that creates aggregates Google business ratings for security installation services and Reviews for my site pages. Key Requirements: - Aggregating Business Ratings: The system should specifically focus on collecting the business ratings of security installation services available on Google. Data Points: The key data points that need to be collected include each business's overall rating and star reviews listed on Google SERPs. for Ideal Candidate: - Proficient in Web Scraping: Experience extracting and aggregating data from websites is essential. - Familiar with Google API: Knowledge of Google's API for harvesting ratings and review stars would be a plus. - Data Analytics Skills: Ability to process and analyze l...

...Types: The player should support both mp3 and mp4 files. A seamless experience for both audio and video is crucial for my website visitors. - Required Functions: The primary functions I need are Play/Pause, Volume Control, and Playlist Management. The player should be user-friendly and intuitive to operate. - Integration: The player will be embedded on multiple pages of my website. It is important that it functions consistently across all pages and devices. The ideal candidate for this project will have: - Proficiency in web development - Experience in creating media players - Strong understanding of user experience and interface design If you have a strong portfolio that showcases similar projects you've worked on, please include it in your bid. I'm ...

...experts - Admin can sync several calendars (of team member/experts) to one calendar booking form and the form will show availability for all the hours any of the linked expert calendars show available time. • Blog section - All type of Users can read, like, share on multiple social media platforms, and add comments on posts (only logged in user), - Admin: content creators can login to write and publish blogs in their desired design and format. Blog contents could be videos hosted on YouTube and other platforms • University data and pages - Admin: o can update university data in bulk using excel or other supported file formats o can update individual university data from university page (separate login for data entry operators, data is published online once vali...

In need of a unique and creative ...This project is a gift intended for a school community friend. The goal is to craft a meaningful symbol of resilience, as the recipient has had a tough year. Key Elements: - Cartoon-like appearance - Coherent incorporation of a Bulldog and a Phoenix -the colors orange, black and white are the school colors Ideal Skills: - Highly skilled in cartoon illustration - Experience in incorporating multiple elements into one harmonious piece. - Ability to convey concepts symbolically - Able to communicate and interpret client's vision efficiently. The perfect freelancer would have an eye for detail and a creative approach to symbolic representation, offering their innovative ideas during the project to ensure the final design is meaningful and m...

...with my face and above that there will be text showing my emotion. - Add AI voice (right now im using google voice which is robotic) - Use chatgpt api for conversation with the chatbot (leave blank for api keys, i will provide it myself, right now im using predefined inputs and outputs) Ideal Skills and Experience: - Proficient in UI/UX design and web application development - Experience with Python and relevant web development libraries - Prior experience in developing chatbots or similar AI-driven applications - Strong understanding of user behavior and interactivity - Ability to implement UI component libraries and proven track record of successful UI/UX design - Strong problem-solving skills and attention to detail If you possess the above skills and are passionate about c...

I'm looking for a skilled professional to scrape and collect specific sports-related statistics from Website A. The template is made, its really jsut a copy and paste exercise. Code is already written. Key Responsibilities: - Extract sports statistics from Website A. Your Skills and Qualifications: - Proficiency in web scraping and data extraction. - Previous experience with similar projects. - Understanding of sports statistics is a plus. This is a one-time project with the potential for future work if successful. I look forward to discussing the project further with you.

We're looking to recruit a rockstar virtual assistant to execute admin tasks with SPEED. Plenty of room for advan...sheets - Basic knowledge of Wordpress - Flexibility with working time and hours Job roles include but are not limited to… - Scraping basic information from website lists - Navigate Wordpress and add needed information Note - put the number ‘88’ in your application so we know you’ve taken the time to read this description!! Required personal attributes: - Strong work ethic - Focus and efficiency - Great English skills Expect a long term role with plenty of room for growth. Approx 2-4 hours per day to start, but this can grow if you are good! Ideal candidates should be detail-oriented, able to work with speed, and have a good grasp ...

...for a skilled professional to design and develop an innovative multi-vendor e-commerce platform, where multiple sellers can sell products directly from their respective warehouses. While PrestaShop has been a consideration, I'm keeping an open mind to different platforms that would best serve this concept. We will also need features to accommodate seasonal products available during specific times of the year. Key skills and experiences for the task include: - Proficiency in various e-commerce platforms. PrestaShop expertise is a bonus but not a requirement. - Experience in developing multi-vendor e-commerce platforms. - Understanding inventory management systems, particularly with multiple sellers each managing their own stocks. - Ability to implement features for...

...product information and pricing from various websites. Key Requirements: - The scraper should be able to collect data from multiple websites and be easily scalable as we might need to add more websites in the future. - The data to be scraped includes product title, description, and price information. - The scraper will need to be able to navigate through the websites and accurately collect the required data. - The scraper should be able to work efficiently and provide timely data updates. Ideal Skills and Experience: - Proficient in web scraping techniques. - Experience working with product data and pricing. - Familiarity with tools and technologies used for web scraping. - Ability to develop a scalable and reliable data scraper. Please let me know if you hav...

I require an expert in web scraping. The project involves extracting content, images, and product details from Amazon, eBay, and Craigslist. Key Project Requirements: - Extracting text content, images, and product details from Amazon, eBay, and Craigslist - Timely completion is crucial - the deadline is set as ASAP Skills Required: - Proficiency in web scraping tools and techniques - Experience in scraping from various types of e-commerce websites - Ability to deliver results quickly and efficiently This is a time-sensitive project and I'm looking for a professional who can deliver high-quality work promptly.

I'm looking for a proficient NLP programmer to help me implement a Spell Checki...The ideal candidate should have expertise in NLP and should be comfortable working with the following requirements: - Expertise in NLP: Proficiency with BERT model in particular - Programming Language: Comfortable working with Python - Accuracy Expectation: The spell checking algorithm should provide balanced accuracy and performance, particularly for large texts. The project's main goal is to deliver an efficient and effective spell checker that can handle large datasets. This will require a nuanced understanding of NLP, particularly the BERT model, as well as Python programming skills. The balance between accuracy and performance is crucial, as the spell checking algorithm should ...

I'm on the hunt for an experienced logo designer who's capable of creating an engaging screen image for my property rental company: A&K Properties LLC. Though I am open to all...itself should be vibrant, professional, and truly capture the spirit of the real estate industry. Ideal Skills and Experience: - Proficiency in the latest graphic design software and technologies - A good understanding of the property rental industry - Previous experience designing logos/screen images in the business sector would be a plus For applications: - Please provide image options in multiple formats Deliverables: - I'd like the final logo delivered in JPEG, PNG, and SVG formats. Your creativity and ability to translate our company's identity into a powerful logo will be t...

I need a seasoned expert to scrape data from a specific website for data analysis. The scope of the project, types of data to be scraped, and further details will be discussed once we move forward. Ideal Skills: - Strong understanding of web scraping techniques - Proficiency in data scrapers (ex: Octoparse, Content Grabber) - Understanding of data analysis Your application should highlight your experiences in these areas, provide examples of past projects, and present a brief proposal on how you'd tackle this project. Creativity, clarity, and specificity will be highly appreciated.

Timeseries forecasting with Python

I'm looking for someone to edit a series of short videos for me. The total duration of the videos is less than 30 minutes in total. Key Responsibilities: - Cut and trim clips accordingly - Add text overlays - Merge multiple clips into one video Requirements: - Proficiency in video editing software - Experience in adding text overlays - Ability to cut and trim clips effectively - Familiarity with merging multiple clips into a single video Please reach out if you have the necessary skills and are interested in this project.

I need a Junior Python Coder who may teach the kids I shall prefer the Female Coders I need work for long term

I'm looking for an experienced developer to create an Android app and website to effectively manage orders, returns, and payments across multiple marketplaces including Amazon, Flipkart and Meesho. The project should essentially mirror the functionality of Wisdom OMS. Key Features: - Order Tracking: Real-time tracking and monitoring of all incoming and outgoing orders from the aforementioned platforms. - Inventory Management: Integrated inventory system that automatically updates stock levels in response to orders, ensuring accurate and timely management of product availability. - Payment Processing: Smooth and secure payment processing capabilities to facilitate transactions and revenue collection. - Returns Management: Effective returns management system that tracks, process...

I'm looking for someone to deliver 4000 YouTube views across two of my video links within 24 hours. The views need to be split evenly between the two links. The main purpose of this project is to simply increase the view count on these videos. Ideal Skills and Experience: - Experience with increasing YouTube views - Ability to deliver views within a tight timeframe - Understanding o...to deliver 4000 YouTube views across two of my video links within 24 hours. The views need to be split evenly between the two links. The main purpose of this project is to simply increase the view count on these videos. Ideal Skills and Experience: - Experience with increasing YouTube views - Ability to deliver views within a tight timeframe - Understanding of evenly distributing views across mult...

I am in urgent need of an experienced developer who can create email templates that can work seamlessly across multiple platforms notably Gmail, Outlook, Apple Mail, and others within a month. We need these emails to render properly in these platforms. We will have our own designs. We have one standardized base template, with about 6-10 variations of that base template that we’d like to think of as “components”. Those templates will be put into SendGrid for use. * **Skills and Experience** * A demonstrated experience in creating robust email templates * In-depth knowledge of various email platforms including Gmail, Outlook, Apple Mail * Proven ability to deliver projects within a stipulated timeline In your application, please only include your experi...

I'm in need of a skilled web scraper who can extract product details from Website 1 and deliver them to me in an Excel spreadsheet. Key requirements: - Extracting specific product details from Website 1. - Organizing and delivering this data in an Excel spreadsheet. Ideal skills and experience: - Proficiency in web scraping. - Strong understanding of data organization and delivery methods. - Experience in working with Excel for data delivery. Your role will be crucial in helping me access and utilize specific product data from Website 1. The neat and organized delivery in Excel will ensure I can efficiently work with this information.

- Person detection using yolov7tiny or yolov8tiny, but only detecting one person - Only measuring the x,y,z position of one person. Initially, the person first detects, so when another p...Windows Reference video Remarks of the client: "When starting the program, it should detect and only measure the first person it sees and if I want to change that then I can click on another person who is also in the frame and then it should start measuring him. And all of that should be during the live video feed. And like I said if another person or multiple people walk in the live video feed it should only still measure the x,y, and z position of the first person it initially detected when starting the program or the person we clicked on the live video feed."