Scrapy feed export csv example jobs

I'm seeking a skilled Senior Python Developer to assist with a project that involves a blend of web scraping and data analysis, with a focus on the following tasks: - Extracting data from multiple websites - Automating data extraction and parsing - Analyzing and visu... with a strong understanding of AI and Machine Learning - Hands-on experience with web scraping, particularly working with diverse data sources - Ability to automate data extraction and processing efficiently - Adept at data analysis, with the ability to visualize and interpret data Although I haven't specified any particular tools or libraries, your familiarity with tools like BeautifulSoup, Scrapy and Selenium would be a bonus. Your ability to recommend and justify the use of specific tools and methods wi...

I'm seeking an experienced developer to create an online script that can automate the conversion of CSV files. Script must be browser based and linux based. No preference on programming language. Source file will need to be uploaded to CSV converter, and script will sort data and rename columns based of pre-existing requirements. Once conversion is finished, download link generated to download updated CSV.

I'm seeking a seasoned Excel VBA developer to create a script that will regularly manipulate data within my Excel sheets. I have vba code run each 5 hours to export my excel sheets as pdf photos, but the problem here is my pdf photo sometimes not shown correctly, and sometimes its shows correctly. here is my vba code: For i = 1 To 57 '54 ' = False sheetxx(i).Select (Now + TimeValue("0:00:05")) ' "({1068})", True 'DoEvents pdffilename = fname2 & "" & sheetxx(i).Name & ".pdf" jpegfilename = fname2 & "" & sheetxx(i).Name & ".jpg" Shell ("D:khalid savescreenshot " & jpegfilename) ' (Now + TimeValue("0:00:01")) ...

We need someone to generate tr...basic: Subject posts: a few lines of text and some tags. (subject posts are often placeholders for the more interesting content: problems and ideas) Problem posts: a few lines of text, tags, a few statistics with sources cited, and a section for "potential harm". Idea posts: : a few lines of text, tags, and a few statistics with sources cited. One last thing, we're bulk uploading to Needpedia using csv files so we need you to pass us the training data in that format. AI can do that pretty easily once the content's generated but getting it to do everything all on its own has been hard. So far we've gotten the best result from our custom gpt by inputting one 'tri-prompt' at a time (a related subject, problem, and ide...

...around 500 products still needing to be done. The focus will be on using the Yoast Plugin to enhance Product titles. Increasing the word count of Product descriptions to around 230 words (sometimes creating from scratch using other sites as reference and or using AI to help), then creating search engine title and focus keywords and repairing URL structures if needed. If working through CSV is easier, a data export can be sent with relevant data columns. Key Responsibilities: - Enhancing product descriptions for improved SEO performance - Optimizing meta tags to drive more organic search traffic - Restructuring URLs to align with best SEO practices - Utilizing Yoast Plugin to ensure optimal SEO efficiency for delivery area audience Please submit a detailed project propos...

I'm seeking a skilled developer to create a logo editor which allows users to choose from pre-designed templates, customize text, and adjust colors. The editor should be able to export logos in PNG, JPEG, and Vector (SVG) formats. Key features: - User-friendly interface - Pre-designed templates - Text customization - Color picker for custom color selection - Export options for PNG, JPEG, and Vector (SVG) formats Delivery time is flexible, so quality is my main priority. Please apply if you have experience in creating similar tools or design applications.

I'm looking for a skilled developer who can create a custom API for Instagram. Key Requirements: - **Data Access**: I aim to gather all public data from Instagram users, including their feed, stories, highlights, and posts. - **Authentication**: I'd like to authenticate users using an API key for accessing their data. Ideal Skills and Experience: - Proficient in API development and integration. - Familiar with Instagram's API policies and practices. - Knowledge on how to work with user data, such as profiles, media content, stories, and highlights. - Prior experience in similar projects would be a great advantage. Will using on site like this The goal of this project is to access and organize Instagram data in a specific way, ensuring the highest standards of d...

I'm in need of a proficient data scientist who can assist me in obtaining targeted gene expression data from the web-based database Culling specific gene expression characteristics, such as expression levels in different tissues and co-expression networks are the ma...scientist who can assist me in obtaining targeted gene expression data from the web-based database Culling specific gene expression characteristics, such as expression levels in different tissues and co-expression networks are the main focus. I require the downloaded data to be in CSV format. Ideal Skills: - Data extraction capabilities - Familiarity with gene expression databases - Proficient in handling large datasets - Ability to deliver data in CSV format

I'm in need of an experienced WooCommerce developer who can help me integrate a selective product feed from into my WooCommerce website, deripet.ro. This will be focused on products in the "Pets" category. Key Requirements: - The product feed should include all necessary information from the source, such as titles, descriptions, prices, SKU numbers, images, and product availability. - The integration should be seamlessly done and products should be correctly categorized under Same Categorys and subcategory like original on my WooCommerce site. - The integration should only include products from the "Pentru animale" category on and exclude other categories such as Furniture, Home Decor, and Garden & Outdoor. Ideal Skills and Experience: - Prof...

Hello, I need mapping a CSV that contains many information and put all words in each column

My Shopify store with less than 100 products is experiencing an unidentified issue on Google Merchant Center. I am seeking an experienced freelancer to: -Diagnose the specific problem Misrepresentation -Provide effective, lasting solutions to get my account back on track, -Ensure my products comply with Google Merchant Center's policies, -Resolve future product disapprovals, data feed errors and prevent account suspension, -Optionally help me understand how to prevent similar issues in the future. Ideal candidates will have proven experience in troubleshooting Google Merchant Center issues, particularly for Shopify stores, and a data-driven approach to solving ecommerce problems.

I'm in need of a customizable point-of-sale software tailored for my retail store. The software should offer various features including: - Import/export functionality: The software should support the import and export of products and customer data to enhance efficiency. - Scanning and printing receipts: I need the software to allow for scanning products and printing receipts with thermal printers. - User login for separate staff: It should also have a feature to allow separate logins for different users or staff members. - Inventory management: The software should include inventory management features for tracking stock levels and products. - Customer management: I need a system that can handle customer data and history, to help with marketing and future sales. - Tax ca...

I need to change the way my web site updates schedules for tv channels. Right now my site scrapes external sites and pickle dumps and returns data to the site. I want a json or csv to upload to updates all channels manually or we can use my admin to update with file.

Villa Silvana Building IFC Model with BlenderBIm Export Ifc and FBX. Ifc File import in UNREAL Engine and setup location map with Cesium plagin.

Riabilia Building IFC Model with BlenderBIm Export Ifc and FBX. Ifc File import in UNREAL Engine and setup location map with Cesium plagin.

...websites. This will include Facebook, Twitter, Telegram, blogs, and websites, as well as sites such as substack and Patreon. Key Features: - Combined Feed: The core function of this dashboard is to provide a unified feed of social media content. - Analytics and Insights: Your design should incorporate analytics and insights. I particularly prefer these to be presented in graphs and charts, allowing me to easily interpret data. Ideal Skills: - Proficiency in UI/UX design - Experience in social media integration - Strong understanding of data visualization - Knowledge of Facebook, Twitter, and Telegram APIs - Ability to implement real-time data feed This project requires a creative approach to data presentation, melding efficiency with visual appeal. The successfu...

I'm looking for a Google Sheets expert to help me automate a process involving day by day data input process I'm seeking a freelancer who can streamline and automate the repetitive task of data import and export in Google Sheets. The ideal candidate should possess the following skills and experience: - Proficient in Google Sheets: You should have in-depth knowledge of Google Sheets and be able to manipulate data effectively. - Automation Skills: Experience in automating processes in Google Sheets is essential. Feel free to ask any questions, and please provide relevant examples of your past work. Thank you.

I'm seeking a data operator skilled in the analysis and visualization of numerical data. The primary task is to handle the numerical data in my CSV file. Key responsibilities include: - Data Analysis: You'll be responsible for performing thorough data analysis on the numerical figures in the file. - Data Visualization: In addition to the analysis, I need engaging visualizations of the data to be created. This will help to communicate the insights effectively. Specific tasks I need help with include: - Descriptive Statistics: You should be able to calculate and present descriptive statistics for the data. - Trend Analysis: You'll also need to identify and represent any trends present in the numerical values. Ideal candidates for this project should: - Have experi...

I'm looking to expand the export capabilities of my OsTicket installation. Specifically, I need to add a feature that allows me to export ticket information to a CSV file. Key requirements include: - Implementation of an additional export feature in OsTicket - This feature should specifically allow for exporting ticket information - The exported file format should be CSV The ideal freelancer for this project would have: - Strong experience with OsTicket and its customization - Proficiency in PHP for making changes to the system - Familiarity with CSV file handling Please provide examples of similar work in your proposal.

I'm in need of a skilled professional who can scrape data from Google. The project requires the extraction of names and email addresses for specific profiles to be used as a potential leads database. Upon successful extraction, the data needs to be presented in an Excel spreadsheet, CSV, etc. Ideal Skills and Experience: - Proven experience in data extraction from websites - Proficiency in Excel - Strong attention to detail and accuracy - Experience in extracting usernames and emails is a plus Deliverables: - The extracted Data - The data must be clean, organized, and formatted in an Excel spreadsheet I look forward to receiving your proposals!

...sources for job scraping, including Google jobs. # Comprehensive Job Details: Extraction of all details included in the job listing, such as job title, company name, location, job description, requirements, etc. # Web Interface: A user-friendly web interface where users can enter the URL of the job listings page and initiate the scraping process. # Downloadable in .csv Format: The scraped job data should be downloadable in .csv format for easy analysis and storage. # Filtering Options: Ability to filter job listings based on old vs. new jobs for specific job verticals (e.g., technology, finance, healthcare) and support for Middle East/GCC countries. # Scalability: The scraper should be able to handle a large volume of job listings from multiple sources without perform...

...software, with specific attention to: - Inventory management: Ensuring that the software effectively tracks the inventory of returned products - Reporting & Analytics: Enhancing the software's capability to generate insightful reports about warranty returns. - User access control: Improving the control measures for different user permissions within the software. - Ticket creation, Data Import and Export: Aptitude in handling these features are considered a plus. The overriding purpose of this software is to track and manage warranty returns effectively. Ideally, you should have previous experience in software creation and maintenance for tracking and managing products. The purpose of this project would be Bug fixing and improvement of the software tool already existi...

...with access to/familiarity with all of them (at least the background removal function). This is how it would work: - We give you a single clip - You use each tool to remove the background best you can while screen recording each process and making note of how many clicks it took to select the whole object - For controlled conditions, you have 30 seconds to select the foreground in each tool - Export as is (no further clean up) - Then using whatever editing tool you like the most, take these outputs (and one we'll prvide) and create identical vertical videos for each where it shows the outputs and process side by side - This would show the whole clip, then zoom into areas such as edges and hair, it would also time laps the selection process (why we wanted to record it) T...

I need assistance in scraping the entirety of Grainger's online catalog and compiling it into a CSV. The CSV will need to include specific details about each product, including but not limited to the product name, description, price, manufacturer, Grainger number and SKU number. Key Responsibilities: - Scraping the Grainger website for all product details. - Compiling the scraped data into a CSV file. - Ensuring that the data is organized and categorized correctly. Ideal Skills for this Project: - Proficiency in web scraping tools and techniques. - Experience in organizing and compiling large datasets. - Understanding of CSV file format and its use. - Familiarity with Grainger's website and the ability to navigate it effectively. It's importan...

I have an Oracle database configured with WE8ISO8859P1 character set (call it DB1). The database needs to be updated to character set WE8MSWIN1252. I need to preserve the DB1 database, so I've created a new database with WE8MSWIN1252 (call it DB2). I would like someone to do this for me: 1. Export entire DB1 including data 2. Import the DB1 export into DB2 Communication and control will be done with Zoom

...app can deliver accurate measurements regardless of the complexity of the space. Simultaneous video recording is another critical facet of this application. The developer must integrate a robust video capturing feature that works in tandem with the LiDAR scanning process. This feature is not merely about recording visuals but is intricately tied to the app's core functionality, providing a live feed of the scanning process and capturing the real-world environment as the LiDAR sensor gathers data. This integration must be seamless, with the video and scanning data synchronized to offer a comprehensive view of the scanned area. Audio transcription adds another layer of complexity and utility to the app. As the app scans and records, it should also listen, capturing every wor...

...retrieve numbers from a text (TXT) file. 2. Ability to view statistics for numbers (overall): - Answered - Unanswered 3. Ability to assign a call campaign to each agent individually: - Other agents cannot see each other's campaigns. 4. Ability for the main agent to assign one campaign to all of their agents. 5. Exporting statistics by agents: - Export a text (or any other) file with answered/unanswered numbers specifically for that agent. - Export statistics for a specific campaign or overall for the day. 6. Integration with Magnus Billing based on Asterisk 13: - Login credentials for the auto-dialing module correspond to Magnus Billing users. 7. It will be web-based. 8. Easy connection to another Magnus Billing server and transferring the module to another server...

I'm looking for an experienced CAD/CAM professional with a solid grasp of Autocad and CNC programming for 3-axis milling machines. Key responsibilities include: - 2D Drafting using Autocad: Proficiency in 2D drafting is crucial, as you will be required to draft architectural drawings and then export them into the ArtCam software. - CNC Programming: You must be able to work with CNC programming for 3-axis milling machines. This will involve creating efficient toolpaths for the machine to follow based on the 2D drawings. Ideal candidates will have: - Extensive experience in using Autocad for 2D drafting - Demonstrable experience with CNC programming for 3-axis milling machines - Ability to communicate and work effectively with the rest of the team - Knowledge of ArtCam softwa...

I'm seeking a talented app developer to create a cross-platform mobile application focused on enabling users to rent various items like cars. Key Features: - User Profiles: Users should be able to create and manage their profiles, which would include personal information, rental history, and ratings. - News Feed: The app should provide a dynamic news feed where users can discover new rental listings and updates from the platform. - Messaging: A secure in-app messaging system is crucial for facilitating communication between renters and owners. Ideal Skills: - Proficiency in cross-platform development, with a focus on iOS and Android. - Experience in building social networking apps, especially those with user profiles and messaging functionalities. - Previous work on e-...

I'm in need of an experienced SQL Server data warehouse designer to help with a project of integrating and ...needing integration and consolidation is between 1GB and 10GB, so experience handling medium-sized data sets is ideal. Your main aim will be to ensure that the data warehouse is efficient and can handle the needs of our data integration and consolidation. Experience in similar projects is essential. You will be working with roughly 5 databases, some direct access, some via API (including basic XML feed in 1 instance). We do not have expectations on the total timeframes (may be up to 3 weeks for 2-3 days per week) as this is firstly dependent on capabilities and secondly on design / good hourly rates. If you complete the original intended work quickly this may lead to l...

I'm looking for a logistics sales executive who specializes in air and sea freight in the Chennai region. Main Tasks: - Develop and manage relationships in the manufacturing, export, and import sectors. - Target businesses who could utilize our freight services for their operational needs. - Increase brand visibility and leverage existing networks to generate sales. Key Skills and Experience: - Proven sales experience specifically in air and sea freight logistics. - Strong network within manufacturing, export, and import sectors in the Chennai region. - Excellent interpersonal, negotiation and networking skills. - Proactive with solid business acumen to identify new opportunities. The right candidate will have a sound knowledge of the logistics industry and be able ...

I'm looking for an expert to engineer an Asana project with a focus on workflow automation. The project should have robust features such as: - Task management: I need a proper setup to facilitate the creation, allocation, and tracking of tasks. - Collaboration tools: The Asana pr...Asana project creation, especially in the field of workflow automation, will be preferred. Your experience in creating an intuitive, professional, and sleek UI will come handy. A solid understanding of efficient task management, collaboration, and tracking tools is also essential. Finally, your ability to understand and translate requirements into action will set you apart. I have attached the CSV file i'm hoping to import and would like suggestions on including templates to use across multipl...

I'm looking for a skilled back-end developer with experience in Replicate or Huggingface AI image gen...generator models, with expertise in MongoDB or similar, and core proficiency in integrating various APIs. Core Tasks: - Setting up Replicate or Huggingface model/space for a new website - Implementing database integration with MongoDB in the back-end - Incorporating social media and data feed APIs. Skills and Experience: - Past experience in back-end development, specifically Replicate or Huggingface - A fully-fledged understanding of MongoDB or similar - Familiarity with various social media and data feed APIs - Aptitude for troubleshooting and proffering efficient solutions. This project demands precise attention to detail and great technical know-how. Looking...

I have a specific custom Google map that I need data from. The data I require includes: Business name, Customers name, Address, City, State, Postcode, website, phone. Key points: - You will be scraping a specific custom Google map - The data needed includes Business name, Customers name, Address, City, State, Postcode, website, phon... Key points: - You will be scraping a specific custom Google map - The data needed includes Business name, Customers name, Address, City, State, Postcode, website, phone Ideal Skills: - Proficient in web scraping techniques - Expertise in data extraction from Google Maps - Experience in handling large datasets - Attention to detail for accurate data gathering. Ideally i would like this in a CSV format. There are aprox 720 records in the custom g...

Proposal for publication calendar with copy writing and hashtags. Content feedback meetings. Editing of story format content. Creation of feed pieces (images, reels, videos, carousels) Creation of a TRELLO board to manage the calendar and approve the pieces. Content scheduling and publication. Design and feed proposal (includes color palette, font, tone, emojis). Contribution and content ideas suggestions. Benchmark, investigation of the competition.

Proposal for publication calendar with copy writing and hashtags. Content feedback meetings. Editing of story format content. Creation of feed pieces (images, reels, videos, carousels) Creation of a TRELLO board to manage the calendar and approve the pieces. Content scheduling and publication. Design and feed proposal (includes color palette, font, tone, emojis). Contribution and content ideas suggestions.

Our existing CGI script is encountering issues when importing the exam's section breakdown from a .dat file. Due to this, we are unable to import the breakdown of results per section of the exam into the SQL database. We are seeking a proficient developer who can: - Analyze our existing CGI script an...the cause of the breakdown import issue. - Provide actionable advice and steps to troubleshoot and resolve the problem. - Ensure the script effectively imports the section breakdown from the .dat file as intended. The ideal candidate for this project should have: - Extensive experience in CGI scripting and SQL database management. - Proficiency in handling and troubleshooting data import/export issues. - Ability to work quickly and efficiently, as we need this probl...

I'm looking for a professional who can set up an automatic download of mainly .csv files from FTP, SFTP, https and webscraping-login. The script should be configured to run daily/weekly at pre-defined time - configurable for each file. Requirement: Check after each download that the download has actually been downloaded. Notify user if any errors occur. Key Requirements: - Configure FTP download automation on Windows enviroment or hosted. - Schedule the download to occur at defined day/hour. - Check if download has been succesful. - Clear commented code. I only respond to bids where the bidder clearly has read the description...sorry (not really sorry, lets not waste each others time :) ) I prefer fixed price, but have entered hourly - let me know your suggestion.

...interaction and content sharing among users. Primary Features - Messaging: A platform for private communication among users. - User Profiles: Allows users to create personalized detail-oriented profiles. - News Feed: Display of content dependent on user's actions and friends' activity. - Chat: Enables real-time communication. - Video Streaming: Option for live broadcasts and video sharing. - Marketplace -login/register Ideal candidates will have experience in multi-platform app development with an emphasis on social networking apps, and impeccable knowledge in implementing messaging, chat, news feed, video streaming, and user profile creation capabilities is essential. Other skills such as proficiency in Firebase for back-end processing and a good understandin...

I am seeking a talented developer to build a social networking website and accompanying application with a major focus on user profiles. Key Requirements: * Creation of user profiles: This element is crucial to the project. Profiles should contain the user's personal information and display their activity feed. * Implement a social networking system that is user-friendly and intuitive. Ideal Skills: * Proven experience in social networking site and application development. * Familiarity with creating detailed user profiles. * Understanding of information security and privacy is important as user profiles will contain personal information. * Strong UI/UX design skills to enhance user experience. Your proposal should detail your experience with similar projects, your unders...

...using API Platform (Symfony); however, this role does not require API development work. Mission: 1 - Post Enhancement (See attached file): - Implement Text overlay on videos and images like TikTok. - Add functionality to trim video durations like TikTok. - Add functionality to resize image. - Address existing bugs and optimize the upload process including improved loader management. 2 - Feed Improvements (Using Flatlist): - Handle poor network connections by locking swipe actions and displaying an informative message, similar to TikTok. - Enhance the smoothness of the video player and slider. - Resolve issues with swipe gestures, especially the right swipe to access profiles. - Optimize post loading with caching and preloading strategies. 3 - Track Player Fix: - Ad...

I'm looking for a skilled web designer and developer who can help me create a website for my natural products export company. The website needs to serve as a product catalog with detailed descriptions. Key Requirements: - Design Style: The website should follow a modern and minimalist design style. The design should be clean, sleek, and visually appealing. - Product Catalog: The main feature of the website will be the product catalog. Each product should have a detailed description to attract and engage potential buyers. - International Appeal: This website will target international clients, so it should be designed with a global audience in mind. Skills and Experience: - Proven experience in web design and development, especially in creating product catalogs. - Proficiency i...

...should allow for group conversations. - File Sharing: Users should be able to exchange different types of files. - Voice and Video Calls: The platform should support voice and video calls. In addition to these Telegram features, I also want the platform to have typical social network features such as: - User Profiles: Users should be able to create and manage their profiles. - News Feed: There should be a news feed where users can post and view updates. - Messaging System: The platform should have a messaging system for private conversations. It's important to note that the project should be scalable, as I plan to add more features in the future. An understanding of Telegram's functionalities and the ability to implement them in a social network setting is cruc...

Looking for a Python & Active Directory Expert to create a script and test data to capture all meta data linked to and which describes the confined parameters of an AD account, group policy etc. and export to a MS Excel File. More information attached.

We are in search of a skilled freelancer proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories

...two-week timeline. The Laravel-specific requirements are as follows:- 1. Fix the Home Dashboard to display real data instead of dummy data in Laravel. 2. Implement form data transfer from the website to the CRM Enquiry Menu in Laravel. 3. Ensure that won enquiries are correctly displayed after conversion to contacts in Laravel. 4. Highlight the current menu item on the left in Laravel. 5. Correct CSV download functionality in Contacts, ensuring filters, headers, and special characters are handled properly in Laravel. 6. Enable clicking anywhere on the contact data table to open the view of that particular contact in Laravel. 7. Remove the display of the last date from the top of the contact view in Laravel. 8. Adjust calendar functionality to match design specifications in Larav...

I am in need of a seasoned DevOps engineer who has hands-on experience in working with Elasticsearch and Grafana. Although I have already set up and configured both systems, I need to fetch key metrics from an on-premise Windows machine and feed them into Elasticsearch. Key Tasks: - Fetch specific metrics: I need the DevOps engineer to configure the system in a way that it can fetch CPU usage, memory usage, and disk usage metrics from the on-premise Windows machine. - System optimization: While I have already set up the system, I am looking for someone who can optimize the performance of the system and make it more efficient. Ideal Skills: - Proficient in Elasticsearch and Grafana: The freelancer should have proven experience in working with these systems. - Windows System Profi...

I'm in need of a programmer well-versed in TIA (V18) Unified and JavaScript to assist with a specific task. - **Skillset**: Proficiency in TIA (V18) Unified and JavaScript is crucial. Experience in data manipulation and handling would be an added advantage. Your primary responsibility will be to help me export a datalogfile created in TIA (V18) Unified to a CSV file using JavaScript. The purpose of this export is for archiving, as the datalogfile is stored locally. Please reach out if you believe you have the right skills and experience for this task.

I am looking for a proficient C# developer who can build a .Net 8 Console application with in-depth CSV handling capabilities. You will need to be able to: - Import CSV files; - Validate CSV data, specifically focusing on data format and range checks; - Convert validated CSV data to a c# DTO format; - Post the converted data to an API. Responding to errors is a significant part of the project. The application should be able to handle any issues encountered during the import, validation, or conversion processes seamlessly. Proficiency in C# is a core necessity, with previous experience in CSV handling and data validation highly desired.

The project consist to convert a json format file to some csv format files