Ruby rail web data extraction jobs

I'm in need of a skilled data miner who can help to extract certain details from a vast range of Shopify products. Your mission, if you choose to accept it, is as follows: - list products that contain non-English writing or words in text and videos - Organise and sort these findings for simple review - Identify and list any products filled with non-English language in the description, pictures or images - Compile lists of products that aren’t currently making top-seller lists - List any products can not be delivered in eight days or less. Please note that tractors and food vans may take up to two months to deliver. - List any products that are not suitable for industrial purposes/non-commercial products. Ensure that the products you are considering are meant for commerci...

...someone experienced in web scraping and data collation. The project will involve scraping blog articles in HTML format and compiling desired information into an Excel file. Key Project Requirements: * The extraction will be from specified URLs, using their individual patterns for efficient and accurate scraping. * For each blog article, I need the title, the full text, and the publish date extracted. * This scraped data must be properly arranged in an Excel file for easy analysis. * List of articles is here: Ideal Candidate Expertise: * Proven experience in web scraping is a must, preferably with full understanding of HTML structures. * Proficiency in Excel and data organization. * Attention to detail to ensure accuracy of the scraped dat...

I require an efficient solution to extract contact details, specifically phone numbers and email addresses, for newly sold residential properties.

I require your expertise for an end-to-end testing of my Ruby on Rails application. Inclusive of all the components, which are Models, Controllers, and Views. Knowledge and usage of MiniTest, Simplecov, and Capybara for the testing frameworks are also required for this project. Key features for testing: - User Authentication - Database Queries - Form Validation The ideal candidate would be someone experienced with Ruby on Rails applications, fluent in the use of multiple testing frameworks, and specializes in identifying and rectifying potential pitfalls.

...consolidating and analyzing data from spreadsheets. • Creating dashboards, reports and charts in Analytics tools. • Working on financial and other types of modeling projects. • Having knowledge Dashboard Creation, Mainframe automation through VBA. • Good Technical knowledge of VBAs, Macro, MS Office skills to drive automation opportunities. • Well-versed with dynamic loops, data extraction from images. • Work with users and team members at all levels for performance improvement and suggestions. • Understand and prepare Ad hoc reports. • Identify the opportunities of automating reports, snapshots and dashboards using advanced formulas, Advanced Excel, Python and other techniques • Consolidate, sort, organize and summar...

I'm looking for a talented freelancer who can assist with scraping automobile ads from website. Key Requirements: - Scraping specific automobile ads. - Extracting ad titles, descriptions and prices. The ideal candidate should have: - Experience in web scraping. - A strong understanding of data collection from websites. - Attention to detail to ensure accurate extraction of data. Please note that the exact websites and the car details are not provided yet, so the freelancer should be able to work with changing parameters.

I want to scrape daily leads from LinkedIn Jobs, Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference will be given to those who have previously performed lead extraction tasks for recruitment websites.

I'm in need of a developer who can create a n8n script to login to a specific website and extract stock data for multiple companies. Key features of this project include: - Extraction of table data: You should have knowledge and experience working with web data extraction, specifically with table data. - Selection of stocks data: The script should have the ability to select and extract information from the stock table. - Capability for multiple companies: The tool should be versatile to handle data extraction for multiple companies, not limited to just one. Experience in the use of n8n for data extraction from websites, especially in the finance sector, will be a significant advantage for this p...

I need a professional to mine data for me. I need you to download and extract the submissions and comments from a public Reddit dataset for 40 subreddits that I will give you. - Data Collection: Please extract the submissions and comments from this academictorrents link: https://academictorrents.com/details/56aa49f9653ba545f48df2e33679f014d2829c10/tech&filelist=1 I only want the comments and submissions for specific subreddits that I will supply to you. Please save the extracted data as csv file. - Frequency: This is a one-time job. Skills and Experience: - Torrent download and extraction.

We are in search of a skilled freelancer proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categorie...

I'm in dire need of a seasoned data analyst, capable of working proficiently with Power BI, to delve into our recent financial data. The objective of your analysis will be the understanding of our customer's purchasing behavior within the last month. Key areas to focus on: - The extraction and interpretation of relevant purchasing behaviors from our financial data - Creating accessible visual representations of these findings through Power BI Ideal Skills And Experience: - Proven data analysis skills - Proficiency with Power BI - Familiarity with financial data interpretation - Insightful about purchasing behaviors and able to spot trends - Experience working with data from the past month would be great.

I have 50-100 articles that I need data extracted from. The data to be extracted includes brand name, country of origin, franchisor's company name, person's name, title, franchisee's name, company name, their person's name, contact details, and the country. Skills and experience required: - Excellent data entry skills - Proficient in reading and understanding articles - Attention to detail to ensure accurate extraction of data - Familiarity with working on a project that requires extracting specific information from multiple sources.

...tracking visitor data, and can help me in capturing contact information of potential customers who do not complete any forms on the site. Key Requirements: - Advanced Visitor Data Collection: The system should be able to capture details like device type, referral source, behavior patterns, and time on page for all visitors. - Contact Information Extraction: The primary goal is to extract the contact details (Name, Address, Phone, and Email) of the visitors who do not submit any form on the site. Ideal Skills and Experience: - Proficiency in Third-Party Tracking Services: The selected freelancer should be well-versed with various third-party tracking services and should be able to recommend and integrate the most suitable one for my website. - Expertise in Visito...

...have a substantial number of legal contracts that I need to analyze and retrieve specific information from. This is a two-fold task and requires proficiency with Microsoft Azure and its document intelligence capabilities. Your primary responsibilities will be: - Utilizing OCR to transcribe the contents of the legal contracts. - Harnessing Microsoft Azure's information extraction feature to sift through the transcribed data and retrieve key information. A successful candidate should have: - Proven experience in working with Microsoft Azure document intelligence. - A clear understanding of OCR. - Background in handling and analyzing legal documents. Hi, I want to create a proof-of-concept of a model that can search and retrieve information using microsoft document...

I am looking for a skilled developer or team to create a Python program designed for the efficient detection of surface defects on railway tracks. This tool is essential for ensuring the safety and operational efficiency of rail network covering high-speed and freight tracks. The program needs to be robust, capable of real-time defect detection and analysis, and capable of generating maintenance recommendations. Requirements: - Develop a Python program capable of converting video to images and image enhancement through filter and noise reduction. - It should capable of labeling of images and recognizing various surface defects including cracks, wear, corrosion, fractures, head-checks, wheel burns, rolling contact fatigue (RCF) defects, spells, squats, shelling, and flaking. - Impl...

I'm searching for a proficient .NET developer to design and build an MRZ scanning plugin for Windows utilizing the device camera. The plugin must be able to handle the following documents: - Passports - ID Cards - Emirates ID Card (National ID of United ...currently preferred, so I welcome any suggestions. Ideal skills and experience for the job: - Proficiency in .NET language - Experience working with MRZ scanning plugins - Familiarity with different types of ID documents - Ability to integrate this plugin into Windows systems successfully - Experience with device camera utilization - Strong understanding of MRZ data extraction I am anticipating a product that efficiently captures the MRZ data from the aforementioned documents and integrates seamlessly into a...

I'm in need of an expert who can carry out a task that involves eavesdropping ...eavesdropping on Thuraya satellite communications using a Hack RF receiver. This task is for research and analysis purposes. Your main responsibilities will include: - Real-time eavesdropping on Thuraya satellite communications. - Extracting specific information including location data, voice communication, and details of data transfers. The ideal freelancer for this project should have: - Proficiency in working with satellite communication systems. - A strong understanding of Hack RF receivers. - Experience in data extraction and analysis. Please be sure to include any relevant experience in your proposal. This is a complex task that requires specialized skills, so releva...

Please Sign Up or Login to see details.

Project Description: I am looking for a skilled Data Analyst to help develop a system for classifying email messages as SPAM or HAM. This involves downloading data from a public source, processing it to extract and compute various features, and analyzing these to determine patterns indicative of SPAM. Responsibilities: Download email data from a specified public archive. Create R functions to extract and calculate over 20 variables from each email, such as the number of recipients, percentage of capitals, and URL presence. Analyze this data to explore variable relationships and determine SPAM/HAM status. Generate visual representations of the data and analysis findings. Provide a detailed report on the methodologies used, results obtained, and insights g...

I'm looking for an experienced web scraper to access and download specific information and images from the Used Inventory section of the White Rock Honda website. Here are the specifics of what I need: - Car make and model - Year of the car - Price of the car For each car listing, I need ALL available images downloaded. Furthermore, I require the images in JPG format. Candidates applying should have successful experience in web scraping, data extraction, and handling myriad images. Efficiency and accuracy are critical for this project.

I'm currently seeking a skilled backend developer who has proven expertise in Python, Java, and Ruby. I need someone who can guide me through whether to use the current source code or start from scratch, a decision that we can make together as the project evolves. As our project's main responsibility is to handle authentication and server configuration, the perfect candidate should be experienced in: - Setting up, managing, and sustaining server configurations - Handling various authentication tasks - Expertise in Python, Java, and Ruby - Decision-making skills concerning source code development This project will be rewarding for someone who enjoys tackling unique challenges and has a flair for problem-solving. If you're up to the task, please don’t ...

I'm in need of an expert who can perform photo extraction from a PDF file. The key requirements for this task are as follows: - The extracted photos need to be saved as a single PDF document. I don't require individual image files. - The resolution quality of the extracted photos must be high - 300 DPI or more. Please ensure this whilst extracting as it's essential for the final output. - The photos extracted should ideally follow a random naming convention. The order doesn't necessarily need to adhere to the page number or alphabetical rule. The ideal freelancer for this task would have experience in handling image data extraction, particularly from PDF files, and should be adept at maintaining high-quality outputs. Familiarity with PDF and imag...

We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful ...

...Requirements: - Extract data from PDF files: The freelancer should have experience in data extraction from PDFs. The goal is to extract content like questions, answers, and any other relevant details. This extractor should be able to be used for different exam boards - Organize data by year, subject, and difficulty level: The extracted data should be categorized based on these parameters. This is crucial for our business as it will help us create a user-friendly interface for our educational platform. - Be able to build an extractor that can be run in a google collab notebook, using whatever packages required, even if large language models are needed. Ideal Skills: - Proficiency in Python - Familiarity with Large Language models for data ext...

Hello, I'm looking for someone to create a Google Sheets spreadsheet filled with YouTube URLs that meet the following criteria: * License: Must be Creative Commons licensed. * Visuals: - Full face visible, speaking directly to the camera; the rest of the body can be included. - Only one person in the shot and speaking throughout the entire video (no cuts to other people). * Quality: High definition (HD or better), not grainy. * Editing: Minimal editing; should be a single take (intro and fade out are acceptable). * Audio: Clear speech; background noise or music is okay if it does not overpower the speech. * Occlusions: No obstructions, such as hands or microphones, in front of the face. * Emotion: Videos displaying significant emotional expression are preferred. * Cam...

...business directories, and various websites. Unfortunately, the purpose of this project hasn't been specified, but the successful freelancer must be capable of performing high-quality data scrapings, potentially for lead generation, market research, or data analysis. As a dedicated data professional, you should have a strong background in web scraping, data extraction, and data analysis. Please be sure to include in your application: - Your previous experience and samples of past work - A detailed project proposal outlining your approach. Your proficiency in using software and tools for data scraping, knowledge of data protection laws, and understanding of various databases will make you a top contender for this projec...

I'm in need of someone with the expertise, resourcefulness and knowledge to draw up an email lead list from public domain databases. The focus of this project is identifying professionals, specifically those with active websites for contact. Key requirements: - Extraction of email leads from public domain databases - Target demographic: Professionals of various walks with active websites - Experience with large-scale data extraction - Proficiency in managing information databases Your past work in email lead generation will be beneficial for the successful completion of this project. Your ability to provide clean, organized, and verified email lists will also be very important. Please only bid if you have the experience and know-how to deliver on the stipulate...

I'm looking to integrate Azure AI Studio with my existing system to enhance our data analysis capabilities. The ideal candidate should possess the following skills: - Proficient in Azure AI Studio and AI development - Experienced in integrating AI technologies into existing software systems - Strong background in data analysis, machine learning, and natural language processing The project will involve: - Adding Textual data, Image data, and Video data to the Azure AI Studio for analysis - Implementing Sentiment analysis, Entity recognition, and Keyphrase extraction functionalities for textual data. Please provide samples of your previous work and detail your experience with Azure AI Studio in your proposal.

Exporting survey data using a xsl template (template for export survey data inside "Stake rail" or "Check rail"). It is necessary to edit the template to export only the selected points within job (currently the template exports all points, even deleted points).

I need a Python expert to create a robust parser for extracting data from large JSON files, each exceeding 10 MB. Key Requirements: - Comprehensive knowledge of Python - Strong grasp of JSON data structures - Experience in handling and processing large data files - Familiarity with data extraction techniques The parser should be highly efficient and capable of managing substantial JSON files seamlessly, without compromising on the speed of execution. I value your expert advice on the most suitable Python libraries to use for optimal results.

In this project, I'm needing assistance to extract text data from printed documents and entering it into Google Sheets. This task involves meticulous attention to detail to ensure the accuracy of the data entered. The project requires a freelancer with strong data entry skills and the following qualifications: - Proficient in Google Sheets and Microsoft Excel - Excellent typing speed - Previous experience with data extraction - Ability to work with printed documents - Good at data categorization and organization - Proven track record of accuracy - Strong attention to detail If you have these skills, please bid for this project. Thanks in advance for your time and effort.

I need a skilled developer to create an automation bot for Telegram Channels. This bot will have the essential functions of: - Auto-joining channels - Extracting basic channel information including the description and lin...Extracting basic channel information including the description and links I want the bot to be able to extract the following specific information from the channels it joins: - Channel Name - Channel Description - Channel Links - Member Count The frequency of this extraction should be set to a weekly basis. Ideal skills and experience for this job would include proficiency in Python or a similar programming language, previous experience with Telegram's API, and prior experience creating chatbots or automation bots. Expertise in web scraping techno...

As an ETL Expert Data Engineer with Airflow expertise, I require a professional who can take on a sophisticated data integration task. Key Responsibilities: - You will be responsible for data integration. - The data will be pulled from various APIs. - The processing logic required is advanced, aimed at facilitating analytics and machine learning. You should possess: - Extensive ETL experience. - Deep knowledge of Apache Airflow. - Proven track record in handling complex data integration tasks. - Capability in building data pipelines for advanced analytics. - Familiarity with APIs, ensuring efficient data extraction. - Strong problem-solving skills and attention to detail. I am looking for someone who can take this project and del...

I'm seeking a professional who can develop a web scraping tool with the following specifications: - The tool should be able to scrape text content from a specific website. - It will need to log in to the website in order to access the data. - The data should be extracted in real-time, meaning that the scraping should be continuous and up-to-date. Ideal candidates should have: - Proficiency in web scraping tools and techniques - Experience in developing real-time data extraction tools - Familiarity with log-in processes in web scrapers - Ability to work efficiently and deliver on time If you have the skills and experience required for this project, please get in touch. Thank you.

I need to gather emails from: https://alaskabar(.org)/for-lawyers/member-directories/ Need it in CSV

Looking for an experienced character animator/ game programmer that has the skills to polish and finish an existing game coded in Unity. You must be very proficient in Unity game engine. Rigging and animation experience is a must. I need a rigging and animation expert as a matter of fact. We are working on a AAA on the rail game game in 1st person shooter style. I need someone who is good at taking existing assets and customizing them and making them better or using the existing animations very nicely. No rookies please. You will be asked to perform a test animation upon getting the full job, so if you are lying about expertise you will be wasting both of out time. You will also be working in Github with another Dev that is programming the rest of the game.

...search of a skilled Python developer to deliver a solution capable of scraping specific data from websites like and Makemytrip. The chief aim is to collate the room type and rates, along with rates applicable for specific dates. Ideal Skills and Experience: - Extensive Python programming skills, particularly in web scraping - Prior experience with data extraction from travel or hotel booking websites - Familiarity with various data extraction techniques and handling dynamic web content Your role will involve programming a robust and efficient scraper that can collect and deliver the desired data in a structured format. Familiarity with and adherence to legal and ethical aspects of data scraping is necessary. Efficiency...

...only to individuals. Agencies need not apply. Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is...

Project Details: We are looking to find a way to match extracted data from a document to certain specific fields in our own system. For example, a data extracted from a document can be [Customer Name: Company ABC PVT LTD], but in our system the field may be called [Client Name]. We want the LLM to help match Customer name and Client name, so that the data gets filled into the field in our system. I am looking for a long term freelancer with database development, LLM and AI experience to help us achieve highly accurate results using OpenAI API, and ideally speaking some experience in google cloud AI products. Specific requirements for the project include: - Experience with LLM models, particularly the specified model - Strong understanding of programming language...

I am looking for a proficient freelancer with a strong background in data scraping from LinkedIn, various social media platforms, and websites. The objective of this project involves harvesting old leads interested in job-oriented training courses in areas such as programming, digital marketing, business, and finance. The skillset and experience required include: - Excellent knowledge of data scraping techniques - Familiarity with LinkedIn, and other social media platforms for data extraction - A good understanding of programming courses, digital marketing, business, and finance topics The targeted audience for these training courses are students, working professionals, and entrepreneurs. I am expecting high-quality leads, so experience in targeted scraping is...

I am in immediate need of a Python expert who can extract data from external website and store in an MS SQL database. freelancer with extensive experience in data extraction from varied sources would be highly desirable. The skills and experience required for this job includes: - Extensive knowledge on Python-based data extraction methods - Proven experience with managing and manipulating MS SQL databases - Ability to adapt to multiple and potentially unexpected data sources - willing to work via anydesk for final installation of the project Given the urgent nature of this project, only those who can demonstrate a commitment to quick turnaround times need apply.

I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity f...scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intell...

I am seeking an...transfer of TikTok users' video data into a Google Spreadsheet immediately upon posting a new video. Key Focus Areas: - Integration: The automation has to be seamless, with video data transferred automatically into the spreadsheet after a new video is posted by the user. - Data Extraction: The data to be fetched includes: Username, Likes, Views, Date Posted, Total videos to date and whether the weekly goal has been met. - Visualization: Data should be visually represented with Bar Graphs. Ideal Candidate: - Should have experience with automation software. - Should have proficiency in coding, preferably with a background in data extraction. - Should have good understanding of TikTok's API. - Should have e...

...Type: Full-time / Part-time Job Duration: 3 months Job Description: As a Full Stack Developer, you will be responsible for developing and designing front end web architecture, ensuring the responsiveness of applications, and working alongside graphic designers for web design features, among other duties. Roles and Responsibilities: • Develop front end website architecture. • Design user interactions on web pages. • Develop backend website applications. • Create servers and databases for functionality. • Ensure cross-platform optimization for mobile phones. • Ensure responsiveness of applications. • Work alongside graphic designers for web design features. • See projects through from conception to finished product. &...

Scrape license data from the FL DBPR website and deliver into an excel spreadsheet. Two counties: Osceola and Polk. Two license types: Vacation Rental - Dwelling and Vacation Rental - Condo. In the attached spreadsheet the required fields to identify the license type and county are shown in screenshots and the second tab as an example. The extracted data is then to put into tabs for each county and license type. Multiple rental locations for a primary name should have multiple entries (rows) with the license details repeated and only the rental location being different each row. There maybe some dynamic features in the website that complicates data extraction. Website:

I need an experienced data scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus on: - Stock prices - Company financials - Last 5 Years ROE - Last 5 Years EPS - NAV - P/E Ratio - P/B Ratio -Net Cash Flow Other economic indicators(US & HK) -Interest rate -Unemployment rate -Inflation rate The ideal freelancer for this job should have experience in data scraping and familiarity with financial data. The requirements involve pulling data from the past five years. All data should be delivered in a CSV file format. The ability to achieve high-accuracy and precision in data extraction is critical for this role.

...only to individuals. Agencies need not apply. Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is...

Everyday I have to extract some da...always the same in every file - does not affect the extraction. The only difference you'll see between the invoices is that most of them (maybe 90% or more) have only 1 product, but a few invoices can have 3, 4, 5 or even more different products on the same invoice. Attention: I'm not looking for someone to do the extraction for me daily. I'm looking for someone who can help me build a tool where I'll be able to automatically process these files on my computer by myself, since these are sensitive invoices with personal information from customers. Ideal skills for the job: - Proficiency in automation software tools - Experience working with PDFs and Excel - Excellent attention to detail - Understanding of invoice struc...

...access artist reports from Spotify and manage playlists easily. Key requirements and tasks include: - Desktop Application: The application should be desktop-based, enabling me to efficiently access and interact with Spotify artist data. - Playlist Management: The application will be designed to build and maintain playlists from a FileMaker database, which I have already set up. The tool should allow for seamless playlist management based on the data present in the database. - Spotify Artist Report Access: The primary functionality of the application will be the extraction of artist reports from Spotify. The reports will be related to a variety of indie bands. It's crucial that the developer can integrate the necessary Spotify APIs and have experience with inte...

I'm looking for a professional to scrape website content for market research purposes. Key Responsibilities: - Scrape content from specific websites Ideal Candidate: - Experience with web scraping tools - Proficient in data extraction and analysis - Able to deliver a detailed data set suitable for market research The project requires a one-time scrape and the data extracted should be relevant and comprehensive for market research purposes.