Closed

Xvfb headless chrome/firefox linux configuration on Rails

hi! I need a hand in configuration Xvfb and watir to scrape headless website in AJAX using RHEL7 or Amazon Linux AMI.

(Removed by [url removed, login to view] Admin) with screen sharing to configure my EC2 instance to start working. For experienced people work for less than 1h I estimate.

Problem:
I have built an app on Rails that scrapes one website twice a day to fetch some data using Nokogiri
Now I wanted to add one more source (another website) that is built in Ajax and Nokogiri is not able to fetch the data and since my app is on AWS I need some headless solution.
So I’m experimenting with Headless gem along with Watir in Rails and Xvfb in RHEL7 to simulate browser - the issue is - always when I trying to use Watir I’m getting an error on server: Selenium::WebDriver::Error::WebDriverError: Unable to find Mozilla geckodriver. Same error getting when trying with chrome.

Chrome and firefox and Xvfb seem to be properly installed.

On my local server Watir is triggering web browser and open in new window properly. The problem is with doing the same using headless solution.

Scope:
fix the problem above only to start scraping by using headless Watir - nothing more.

Skills: PHP, Software Architecture

See more: xvfb ubuntu, xvfb firefox, xvfb chrome, xvfb install, xvfb linux, what is xvfb, xvfb windows, xvfb-run selenium, Hi. I need Logo Design about retail beauty store name as Sunny Beauty Mart Thanks. LOGO NAME : Sunny Beauty Mart , “Hi, I need a writer for a short non-fiction ebook (5,000 - 10,000 words). Requirements: Native speaker Fast delivery (within , Hi I need a logo for my company, and also a business card. , hi, i need someone to develop a 100% responsive WordPress theme based on bootstrap, Hi...I need a website, Hi...I need a website for a conference, Hi...I need a website for a conference. Site should have parallax scrolling and be responsive, and work well on mobile and deskt

About the Employer:
( 0 reviews ) Edinburgh, United Kingdom

Project ID: #15653504

4 freelancers are bidding on average £189 for this job

£150 GBP in 3 days
(10 Reviews)
4.7
ITprogrammer1

Hello! I am writing in response to your Project. After carefully reviewing the experience requirements and skills required for the job, I feel that I am a suitable match for the job. I am a data scientist by professi More

£41 GBP in 4 days
(0 Reviews)
0.0
£500 GBP in 3 days
(2 Reviews)
0.0
bhavesh1508

Its matter of 1 day or so to fix this bug, As I am pretty sure its dependencies issues between headless driver, chrome/firefox installation path and watir driver. So please let me know when we can look into this and More

£66 GBP in 1 day
(0 Reviews)
0.0