Web crawling jobs

Create AGI that autonomously crawls the web, learns from its interactions, and makes decisions is an ambitious endeavor. Let's break down the key components and challenges involved in creating such a system: 1. **Web Crawling and Data Collection**: - The AGI needs to crawl websites to collect data. - Techniques like **web scraping** can extract information from web pages. - Consider using AI-powered web scraping tools that adapt to changing website designs and dynamic content³. 2. **Adaptive Learning and Decision-Making**: - The AGI should learn from the data it collects. - **Adaptive scraping** techniques allow the bot to adjust to website redesigns and structural changes. - Use machine learning (e.g., convolutiona...

Certainly! Building an **AGI that autonomously crawls the web, learns from its interactions, and makes decisions is an ambitious endeavor. Let's break down the key components and challenges involved in creating such a system: 1. **Web Crawling and Data Collection**: - The AGI needs to crawl websites to collect data. - Techniques like **web scraping** can extract information from web pages. - Consider using AI-powered web scraping tools that adapt to changing website designs and dynamic content³. 2. **Adaptive Learning and Decision-Making**: - The AGI should learn from the data it collects. - **Adaptive scraping** techniques allow the bot to adjust to website redesigns and structural changes. - Use machine learning (...

...optimization, content enhancement, and SEO strategy, we want you on our team. Responsibilities: Meta Tag Optimization: Ensure captivating and relevant titles and descriptions for increased click-through rates. URL Structure: Develop and maintain user-friendly URLs to enhance site navigation and SEO performance. Technical SEO: Generate and manage files for efficient search engine crawling. Develop and maintain User Sitemaps and XML Sitemaps for effective website indexing. Content Enhancement: Add valuable content to pages with thin content, improving user experience and SEO rankings. Header Tag Optimization: Implement effective header tag strategies for improved page structure and readability. Keyword Mapping: Perform thorough keyword mapping to prevent Keyword Cannibaliz...

I need an expert to diligently crawl and mine data from an ecommerce website. The specific types of data to be handled are: - Product details: This involves descriptions, pricing figures and other related information. Urgency is key; I require the project to be completed as soon as possible. Therefore, a professional who can deliver high-quality work in...crawl and mine data from an ecommerce website. The specific types of data to be handled are: - Product details: This involves descriptions, pricing figures and other related information. Urgency is key; I require the project to be completed as soon as possible. Therefore, a professional who can deliver high-quality work in a quick timeframe will be most suited for this task. Experience in web crawling and data mining is ...

I'm looking for a skillful programmer who can efficiently block Google and other search engine robots from crawling the entire content of my business website. This task is significantly vital in maintaining the privacy of my site's content. The ideal candidate would possess the following skills and experience: - Profound knowledge of website development and architecture - Extensive experience with rules and no index meta tags - Expertise in search engines and how they interact with websites - Understanding of the potential impact on site visibility and performance Please, only apply if you're able to completely prevent Google and other search engine bots from accessing my website while ensuring a smooth user experience. Thank you.

I am in need of a highly skilled and experienced SEO expert who is well-versed in WordPress to enhance the technical SEO on my website. This is aimed at improving site indexing, crawling, seo aspects which need to be fixed, ensuring the technical seo, onsite and offsite seo, content optimisation increase number of calls, online bookings, conversions and rankings. We are looking for someone who spends time and is dedicated to improve search rankings with the attention to detail towards conversions, calls, bookings and search positions. Target google domain: Home Page: Keywords and URLs to be optimised. Forensic Cleaning Services in UK Hazmat Cleaning Services

Hello there, I'm seeking an expert in Search Engine Optimization (SEO) to help elevate the performance of my website across all crucial areas. A comprehensive SEO strategy to boost traffic, improve rankings, and increase my website's online visibility is my main goal. Ideal Skills and ...to help elevate the performance of my website across all crucial areas. A comprehensive SEO strategy to boost traffic, improve rankings, and increase my website's online visibility is my main goal. Ideal Skills and Experience: • Onsite SEO • Offsite SEO • Technical SEO Our website may require changes on search console/analytics, html and xml sitemap, onsite, offsite and technical seo such as crawling and indexing.. It requires good quality backlinks, content opt...

...be responsible for extracting product information, product videos, and product reviews based on product Ids. Key Responsibilities: - Crawl and extract product details from Taobao based on provided product Ids. - Obtain corresponding product videos. - Extract all relevant product reviews. Skills and Experience Required: - Proven experience in data scraping and extraction. - Familiarity with web crawling tools and techniques. - Ability to handle complex and large sets of data. - Strong attention to detail and accuracy. Please include in your application a detailed project proposal outlining your approach to the project, the tools you intend to use, and any potential challenges you might foresee. I look forward to your bids. Ensure you have a track record of successfully c...

This project involves conducting a dark web websites crawl with the primary objective of gathering dynamic intelligence and monitoring online activity. Key Details: - ACHE Crawler needs to be used to crawler dark web and collect available websites urls Required Skills and Experience: - You need to be proficient in Python programming and have previous experience in web crawling, especially on the dark web. - Familiarity with network security and understanding of dark web dynamics is highly preferred. - Familiarity with ACHE Crawler, Docker and Scrapy is needed. On completion, a detailed report of the findings, as well as the script code used, will be expected.

...image alt tags • Voice search optimization • Google search console account setup and configuration • Google analytics account setup and configuration. • Structured data markup • Optimizing blog available in the site. • Implementing page url structure in the website. • Fixing website indexing issue. • Eliminating of non-index able attributes. • Implementing external and internal links for better crawling & it will help to improve ctr. • Eliminating canonicalization issue in the website. • Eliminating broken links in the website. • Creating and uploading file. • Creating and uploading xml sitemap. • Implementing fevicon in the website. • Highlighting duplicate contents in the website & suggesting un...

Python Script of web spiders to fetch Mempool Transaction Fees I am in need of a Python script which can fetch the transaction fees from the Mempool website at specific intervals. crawling the web data。familiar with BeautifulSoup Key Requirements: - Develop a script using Python to gather web site data - The script must be able to pull the data at specified time intervals Deliverables: - End product must generate a report containing the fetched data Ideal Skills and Experience: - Strong experience in Python - Understanding of API interactions - use python lib to fetch web site data ,the code is as simple as possible * website code is at * Every 2 seconds to get TRANSACTION FEES which is include 3 section Low Priority , Medium

I am seeking a competent web crawling specialist who can efficiently extract text content from a specific website's news updates. Here’s what I require: • Extract information from news updates within the target website. • Save the extracted data in Excel format. • Deliver clean, organized, and structured data. Ideal skills and experience: • Expertise in web crawling and scraping tools. • Previous experience working with news or media websites. • Proficiency in data extraction and Excel. • Strong attention to details. I appreciate a freelancer who can show some examples of their previous data extraction projects, especially in a news context.

...need to ensure that it collects unique data between multiple sites, it should be capable of crawling links and building complete information records. All data will be written in MongoDB using Mongoose and built in Vite with React and MUST be Typescript based. The tool will perform the following tasks: - Crawl 5-7 different websites which I will specify. - Collect user specific data from these sites that will consist of: Text content, images, and links. The tool should be developed using Vite (), Typescript, and Puppeteer, MongoDB and Mongoose. As such, the ideal freelancer for this project should have: - Proficiency in Vite (), Typescript, and Puppeteer - Proven experience in web scraping - Attention to detail to ensure the correct and specific data is scraped - Ava...

I'm looking for an SEO expert to increase my roofing company's website traffic, improve search engine rankings, and generate leads. Previously, some SEO work has been done, but the results have been l...improving the website's authority, while also managing the company's online reputation. 3. **Technical SEO:** Evaluate and improve the site's technical aspects such as website speed, mobile responsiveness, and XML sitemaps for better search engine crawling and indexing. The ideal freelancer should have proficient knowledge in these areas, a track record of successful SEO projects, and a keen understanding of the latest SEO trends and algorithms. Your main objective will be to significantly enhance our online visibility, consequently attracting more web...

I am looking for an adept developer to create a data crawler that can efficiently harvest text data. The main area of focus for this project is to extract data from the MCA (Ministry of ...registered companies. Expected Results: The solution should result in an efficient, accurate extraction of data from the designated sources, presented in a convenient, readily usable format. Timeline: The project needs to be completed within a month. Ideal Candidate: The ideal candidate for the project will have: • Extensive experience in data crawling and programming. • Demonstrated ability handling similar projects. • Proficiency with web scraping tools and techniques. • Knowledge of data extraction processes. • Familiarity with MCA and company registration d...

...build a job aggregator with robust web scraping capabilities. This platform will be instrumental in collecting job listings from different job sites into one overarching catalogue, facilitating an efficient job hunting experience for users. Key Functionalities: - Develop complex scraping tools to extract job listings daily from LinkedIn, Jobstreet, and Google Jobs. Strong experience in web scraping and dealing with CAPTCHAs, AJAX, and dynamic websites is required. - Implement functionality for new job postings to be submitted via a form on the website. Deep understanding of user-interface and experience in form design and submission is a plus. The successful freelancer must have a good understanding of job search engines, aggregator platforms, and web crawling...

Please Sign Up or Login to see details.

I need a creative designer to build an indoor play space specifically for various age groups little kids (6 months to 2years old), (2-4) preschool-aged children (4-5 years old). This "Little Town" themed space should serve multiple functions: -Encourage active play, with elements for crawling and climbing -Incorporate learning and exploration activities -Include rest and relaxation areas You will ideally have experience in children's play space design. Knowledge about what engages this particular age group is essential. Familiarity with the theme and what it entails will be a bonus. Please showcase any similar projects you've worked on in your proposal.

...both on-page and technical SEO. Technical SEO: Regular Audits: Perform ongoing audits to identify and rectify issues related to site speed, mobile optimization, crawl errors, and site architecture. Page Speed Optimization: Employ advanced strategies to guarantee swift loading times across all platforms. XML Sitemap and Optimization: Fine-tune these elements for optimal search engine crawling and indexing. On-Page SEO (First Month and Ongoing Adjustments): Keyword Research: Execute a comprehensive keyword strategy encompassing a wide array of keyword types such as short-tail, long-tail, short-term, long-term, product defining, customer defining, geo-targeting, and intent targeting. Content Optimization: Guarantee the optimization of site content for SEO relevance, utilizing s...

I'm in need of an email scraper to build and expand my email list. Currently, my method of collection is manual, which can prove to be quite time consuming. Key Requirements: 1. You have to find e...sample work of the same project of 100 emails must be done for awarding of the project. 5. You have to complete the sample work in 1 hour. 6. Only interested and skilled freelancers must apply. Ideal skills and experiences: - Extensive experience in building or working with email scraping tools - Proficiency in Google Sheets or other spreadsheet software - Strong understanding of web crawling techniques and web data extraction - Solid background in data management and data cleaning This project will greatly improve the efficiency of building our email list. Looki...

I am seeking a proficient web scraping professional to extract specific contact information from a website. The ideal individual should be experienced in data scraping, lead generation, and data entry. - Your core responsibility is to gather email addresses and company names accurately from the website I will provide you - I'm looking for a quick and effective execution of this task as time is of the essence. - Export data in excel sheet - Ensure each contact information correlates with the right company name. This project requires someone who is meticulous, well versed in web data crawling techniques, and has a knack for meeting tight deadlines.

I am looking for a freelancer who can assist me in creating a tool to load Website A. The key functionality required is to seamlessly load the website within the tool. This tool is to use for my team member. Just wanted to hide the website url/username pwd and the header part in the tool. * Experience in web development * Knowledge in website crawling. Please include examples of similar projects you have undertaken and explain why you believe you're the perfect fit for this project. Thank you.

I'm currently dealing with several issues regarding my website, specifically with some pages not appearing in search results and experiencing crawling errors. There's some uncertainty as to whether recent changes made may have affected its indexing. The goal here is to resolve these problems, in addition to redirecting backlink juice from some expired pages to new ones. Given that my website is built on WordPress, I am looking for someone who's familiar with this platform. Here are some required skills: - Proficient in SEO practices, specifically regarding indexing and crawling - Knowledgeable in handling WordPress platforms - Experience in backlink redirecting Although I'm on a tight budget at the moment, successful completion of this task will open p...

Please Sign Up or Login to see details.

...performance by resolving specific indexing and crawling snags that are currently impeding my website's visibility and performance. **Requirements:** - Expertise in diagnosing and enhancing website indexing and crawling. - Proven track record of managing and improving site crawl rates. - Ability to identify and fix broken links and redirects efficiently. - Skill in optimizing website architecture to ensure seamless crawling by search engines. - Insight into on-page SEO optimization to bolster organic traffic and improve website rankings. **Ideal Skills and Experience:** - Proficient in SEO tools and analytics software. - Experience with website performance improvement tactics. - Knowledge of the latest SEO practices related to indexing and c...

...prices as efficiently as possible. - Sources: Focus on well-known e-commerce platforms and social media sites where product listings are prevalent. - Essential Skills: Proficiency in web scraping tools, data extraction techniques, and handling bot detection mechanisms. - Experience: Past projects involving e-commerce or social media data scraping are highly beneficial. - Output Expectation: The data should be organized and provided in a structured format such as CSV, JSON, or Excel for further analysis. The perfect candidate will have a strong background in data scraping, understand the nuances of web crawling, and ensure a high level of accuracy while adhering to the legalities of data collection. If you are up to the challenge, I look forward to your bid and a di...

...platforms, specifically iOS and Android. **Key Requirements:** - Develop a crawler that targets live stream links dedicated to entertainment content. - Ensure the retrieved live stream links are live and functional 24/7. - The solution must be operational and fully compatible with iOS and Android platforms. **Ideal Skills and Experience:** - Proficiency in programming languages suitable for web crawling and automation (e.g., Python, JavaScript). - Experience in working with APIs and understanding of how to manipulate them for live stream data retrieval. - Knowledge in mobile platform compatibility, specifically iOS and Android. - Ability to implement a monitoring system to constantly check the validity of the links. - Strong problem-solving skills to ensure the system�...

I need a skilled web crawler expert to extract specific information daily from a designated grocery website and deliver the collected data in a spreadsheet format. My primary focus is on the following details: - Product names - Prices - Images - Descriptions (including size and other relevant information) Ideal Skills and Experience: - Proficiency in web crawling tools and technologies - Experience in extracting and parsing large datasets - Ability to schedule and automate crawling tasks on a daily basis - Expertise in data formatting and spreadsheet management The extracted data should be neatly organized and presented in a spreadsheet, with clear and distinct columns for product names, prices, images, and descriptions. This job requires a high level of atte...

I'm seeking an experienced developer to create a web crawler specifically for the bookmaker site. The primary task for the crawler is to efficiently and accurately extract odds information focused on football events. Required Skills & Experience: - Proficiency in Python or another scripting language suitable for web crawling. - Previous experience working with or creating web crawlers. - In-depth understanding of the bookmaker betting industry, specifically for football. - Proven ability to extract data from complex websites effectively. Project Specifics: - The main data point to extract will be the betting odds. - The crawler should primarily focus on football events. - It is key that the crawler is designed to handle changes in the website struct...

...requirements and what I'm hoping to achieve: - **Comprehensive SEO Services:** - **On-page SEO:** Optimize content and HTML source code to improve relevance and authority. - **Off-page SEO:** Develop strategies to enhance the website's external footprint through backlinks, social media presence, and more. - **Technical SEO:** Ensure the website is structured well for search engine indexing and crawling, with a focus on site speed, mobile optimization, and secure connections. - **Target Audience:** The focus is on a global audience, so strategies should be adaptable and resonant with diverse cultures and languages, if possible. - **Primary Goal:** The main aim is to significantly increase website traffic. Strategies should be innovative and aligned with the late...

I would like to create a platform where I could compare different prices per store... compared to my online store. I know it's possible to do web scraping or crawling... There's no problem if it's in Excel but I would prefer it to be on a platform with constant updates. I also want a dashboard that tells the best prices of the 6 online stores vs mine.

...ensuring better crawling and indexing by search engines. Optimize site attributes including Title Tag, Description Tag, Meta Keywords, Header Tags, Image Tags, Robots Optimization, Hyperlinking Analysis, Webpage Content, External Links Optimization. Implement the on-page suggestions to enhance keyword relevancy and technical SEO aspects. Off-Page SEO and Brand Awareness Develop a strategy and create backlinks through appropriate white-hat off-page activities, adhering to quality criteria for backlinks to maintain SEO integrity. Post content as needed across various platforms to create brand awareness, utilizing tactics such as Social Bookmarking, Social Profile Creation, Image Sharing, Classified Submission, Business Listing, Document Sharing, Article Submission, Web...

...(full-time/part-time/internship) - Direct job URL - **Update Frequency:** - The data should be updated and delivered weekly to capture the most current job openings and details. - **Preferred Delivery Format:** - All the extracted data should be neatly organized into an Excel spreadsheet for easy access and manipulation. **Ideal Skills and Experience:** - Proficiency in data scraping and web crawling, specifically with Indeed and LinkedIn. - Expertise in scripting languages (e.g., Python) and tools (e.g., BeautifulSoup, Selenium) for effective data extraction. - Strong experience with Excel and data organization. - Understanding of job market trends to precisely identify relevant data fields. - Time-management skills to ensure regular, weekly updates without delay...

I need an experienced web scraping and data extraction expert for a continuous engagement that will entail web scraping, web crawling, data mining and extraction. You will also upload and publish the relevent data to the website, preferably through automation. The data is to be extracted from multiple sources and pages (websites and social media pages) and will include both text and images. Requirements: - Experience with web scraping tools and software. - Ability to navigate and scrape text and images from different sites and social media. - Knowledge of ethical scraping practices, especially for social media sites. - Proficiency in data cleaning and organization for analysis. - Capability to deliver the project within the specified timeframe. Ideal S...

I need an experienced web scraping and data extraction expert for a continuous engagement that will entail web scraping, web crawling, data mining and extraction. You will also upload and publish the relevent data to the website, preferably through automation. The data is to be extracted from multiple sources and pages (websites and social media pages) and will include both text and images. Requirements: - Experience with web scraping tools and software. - Ability to navigate and scrape text and images from different sites and social media. - Knowledge of ethical scraping practices, especially for social media sites. - Proficiency in data cleaning and organization for analysis. - Capability to deliver the project within the specified timeframe. Ideal S...

I am seeking a highly skilled freelancer to develop an AI-powered internet search tool tailored for my business needs. This tool should excel in web crawling and indexing, alongside performing intricate sentiment analysis. Here’s a breakdown of what I expect: **Core Functions:** - Efficiently crawls and indexes content from websites, social media platforms, and online forums. - Conducts sentiment analysis to understand the emotional tone behind the data it collects. **Data Sources to Target:** - Websites: From news to niche industry blogs. - Social Media Platforms: Major players like Twitter, Facebook, etc. - Online Forums: Including specialized forums relevant to my business sector. **Desired Features:** - **Advanced Filtering and Sorting:** Capabilities to easily s...

We are seeking an experienced SEO Specialist focused on the technical aspects of SEO, particularly in diagnosing and resolving crawling and indexing issues for dynamic pages in a application. Our primary goal is to enhance our website's visibility in search engine results, ensuring that all dynamic content, including blog pages, is effectively crawled and indexed. Key Responsibilities: Diagnose Crawling and Indexing Issues: Verify that Googlebot and other search engines can crawl our site without issues. This includes reviewing and optimizing the file and ensuring that our sitemap is accessible and correctly linked. Google Search Console Integration: Successfully integrate our application with Google Search Console, submit our sitemap, and ensure it accurately

...Optimize metadata effectively. - Strengthen mobile-friendliness. - Ensure functioning caches. - Resolve Search Console errors. - Boost Core Web Vitals scores. - Amplify page loading speed. - Make sure all sitemaps including keywords and Google News sitemap (most important) are feeding properly. - Fix website's general which is not updating. - Eliminate unnecessary plugins. - Ensure that Google Analytics (GA4) is working properly. Search Console Concerns: - Correct Coverage errors. - Improve Mobile Page Experience ratings - currently listed as "Poor" and no URLs are listed as "good" in Core Web Vitals - Validate forums for Google crawling. Ideal Candidate Skills: - Proven SEO success stories. - Experience rectifying Google Search Console i...

I'm on the lookout for a skilled professional to elevate my website, which consists of approximately 400,000 pages, to the pinnacle of SEO perfection on Google. My mission is to polish our well-optimized website to near perfection, focusing squarely on improving its search engine rankings through enhanced crawling and indexing strategies. **Key Requirements:** - **SEO Expertise**: Profound understanding of the latest SEO strategies and Google algorithms to navigate the complexities of a high-volume website. - **Technical SEO Skills**: Experience with technical SEO aspects, such as crawl budget optimization, site structure improvement, and rich snippets, to enhance our site's visibility and indexing. - **Analytical Skills**: Ability to analyze current SEO performance, ide...

...elevating low-ranking websites. My primary goal is to significantly increase website traffic through strategic improvements. **Key Issues:** - Currently experiencing low search engine rankings. **Primary Goal:** - To ramp up website traffic effectively and efficiently. **SEO Focus Area:** - The website requires improvement in Technical SEO, especially the structure to facilitate better indexing and crawling by search engines. **Ideal Skills and Experience for the Freelancer:** - Proficient in Technical SEO including a deep understanding of sitemaps, files, and URL structure. - Experience in diagnosing and fixing indexation issues, and in optimizing website load times. - Knowledgeable in the latest SEO tools and practices to analyze and boost a website's visibility. - Ab...

... the ideal candidate should have a deep understanding of SEO strategies, specifically focusing on on-page techniques. Key Requirements: - Extensive experience in implementing effective on-page SEO strategies. - Ability to analyze and optimize meta tags, including title tags and meta descriptions, to boost search engine rankings. - Expertise in refining URL structures for better indexing and crawling by search engines. - Strong understanding of content optimization to ensure keyword relevancy and density. - Knowledge of the latest SEO trends and Google algorithms to stay ahead in the SEO game. The project timeline was not specified, so I'm open to discussions on how quickly these optimizations can be realistically implemented without compromising quality. Please include yo...

I am experiencing multiple issues with my E-commerce website's Google search console indexing. These include: - URLs not being indexed - Indexing errors - Crawling issues You'll be tasked with diagnosing and fixing these issues, optimizing my website's visibility to search engines and ensuring smoother functioning. Ideal Candidate: - Proven experience in resolving Google Search Console Indexing problems - Familiarity with E-commerce websites - A track record of successful onsite SEO optimization NB: Please include your past experiences and similar projects you have worked on while submitting your application.

...Excel spreadsheet for my analysis. **Requirements:** - Proficiency in webscraping technologies and tools. - Ability to identify and extract specific text content. - Expertise in data formatting and Excel spreadsheet manipulation. **Ideal Skills and Experience:** - Strong background in Python, particularly with libraries like BeautifulSoup or Scrapy. - Experience with data extraction and web crawling. - Proficient in Excel formatting, including creating tables, applying filters, and using formulas. - Attention to detail to ensure accurate data extraction and formatting. - Good communication skills to clarify details or requirements. **Project Deliverables:** - A comprehensive Excel spreadsheet containing the scraped text content. - The structure of the spreadsheet sh...

...engine rankings. It's currently not visible on the first page, and I want that to change. - **SEO Services Required:** - **On-page SEO:** Optimizing the content and structure of the site for relevant keywords. - **Off-page SEO:** Building quality backlinks to increase domain authority. - **Technical SEO:** Ensuring the website is technically optimized to facilitate better indexing and crawling by search engines. - **Skills and Experience Needed:** - Proven track record in successfully ranking websites on the first page of search engines. - Strong knowledge in all three areas of SEO mentioned. - Ability to conduct comprehensive keyword research and implement findings. - Experience with SEO tools (e.g., SEMrush, Moz, Ahrefs) and Google Analytics. - Problem-...

I'm looking to populate a database of investors and products they bought by extracting the information from websites, newsletters, news and PDF reports. Relevant skills: - Web scraping - Data extraction - Web crawling Spanish speaker is a plus, but not a requirement.

...image alt tags • Voice search optimization • Google search console account setup and configuration • Google analytics account setup and configuration. • Structured data markup • Optimizing blog available in the site. • Implementing page url structure in the website. • Fixing website indexing issue. • Eliminating of non-index able attributes. • Implementing external and internal links for better crawling & it will help to improve ctr. • Eliminating canonicalization issue in the website. • Eliminating broken links in the website. • Creating and uploading file. • Creating and uploading xml sitemap. • Implementing fevicon in the website. • Highlighting duplicate contents in the website & suggesting un...

I need skilled freelancers to develop web crawlers that will gather specific sets of data from various job search and stock market websites. These crawlers must be efficient, accurately collect data, and deliver the information in a structured Excel format. Canadian Job Seekers Indian Stock Market Brokers Requirements: - Extract job titles, company names, and job descriptions from job search websites. - Collect stock prices, company information, and related news articles from stock market websites. Ideal Skills: - Proficiency in web crawling tools and software. - Solid understanding of data mining and web scraping principles. - Experience with Excel and data organization. - Knowledge of Canadian job markets and Indian stock markets is a big plus. - Strong att...

We will resolve the following errors/issues/notices based on SEMrush: Errors (2) 370 internal links are broken 7 pages returned 4XX status code Issues(6) 384 issues with unminified JavaScript and CSS files 117 pages have low text-HTML ratio 115 page...status code Issues(6) 384 issues with unminified JavaScript and CSS files 117 pages have low text-HTML ratio 115 pages don't have meta descriptions 108 pages don't have an h1 heading 30 pages have a low word count 2 pages have too much text within the title tags Notices (7) 117 issues with blocked external resources in 36 links have non-descriptive anchor text 22 pages are blocked from crawling 7 orphaned pages in sitemaps 6 resources are formatted as page link 3 pages have only one incoming internal link 1 link has no a...

...python script that i need to add the following features. 1. use scrapy or botasaurus 2. handle errors 3. captcha bypass (using third party api) 4. correct proxy handling 5. fix script to start crawling w new website it has currently these features 1. I need to crawl any website. 2. Create a CSV file sitemap with parent URL and all children URLs in each parent. 3. Indicate if the child URL is an internal or external link. 4. Do not crawl external links. 5. Indicate the status of the parent URL (200, 404, etc). 6. Use cache. 7. Use proxy rotation. 8. Use multiple browsers simultaneously to make the crawling fast 9. use pyppetter / selenium / or anything similar to it to be able to read java based websites 11. implement script continue where it left off 12. implement make...

...e-commerce website's visibility due to indexing and crawling issues that have surfaced in Google Search Console. These problems are hindering my product listings from being found in Google's search results, directly impacting my business's online presence and potential revenue. Ideal Skills and Experience for Freelancers: - Proven expertise with Google Search Console - SEO and e-commerce background - Technical know-how on website indexing - Experience in resolving crawl errors - Familiarity with e-commerce platforms Freelancer Responsibilities: - Diagnose indexing and crawling problems. - Develop a strategy to resolve the issues. - Implement solutions to ensure all product listings are indexed. - Optimize the website to improve crawling speed. - Pro...