Data Scrape of a Dynamic Website using Unix/CentOS
$10-30 USD
Completed
Posted almost 4 years ago
$10-30 USD
Paid on delivery
Goal : Scrape a website after the page has loaded, and grab the data variable and output it to a flat file.
The website displays a 'estimated wait time' during business hours, and the word "Closed" when closed. I want to parse the number (IE 3, 24, 30, etc) to a text file or the word Closed if they are closed.
Requirements :
1. Script must run on CentOS/FreePBX operating system.
2. Must be able to run as a unix cron job (background process I can tell to run and update the text file every ~5 minutes.
3. I plan on scraping multiple pages of the main URL's (same exact main website, just different stores/locations - so it scrapes identical, no need to write different code) - so the code you write I need to be able to duplicate it so I can change the URL and run it in a separate cron file that outputs to a different text file. (IE [login to view URL], [login to view URL], etc)
4. IF you plan on using something like NodeJS, please note that CentOS7 and this OS distribution is somewhat limited and certain libraries/resources may be unobtainable despite the fact I have full root/control over the OS.
5. This is an EXPEDITED project and needs to be completed within 24/48 hours tops.
6. I tip... so if the project is clean, done fast, and works well, I will pay more than the job's final price. I appreciate good speedy work. Thank you.
Hi! I'm script developer that can retrieve data & do tasks with AUTOMATION.100% ACCURATE!
Can you tell me the website URL?
I will write Python 3 and, i'm going to use Python PYPI registered modules. NO SELENIUM (it's slow :D)
Let's discuss more details :)
Thank you and i'm looking forward to working with you!
Best Regards,
VincentOng07
$50 USD in 2 days
5.0 (94 reviews)
6.0
6.0
3 freelancers are bidding on average $23 USD for this job
I work in a co-working environment so I can complete this project with speed & accuracy. I will done your project in full professional way according to your requirements and my creative ideas. I am doing development from last 5+ years. I can also show my past projects to you in chat So inbox sir I will further Insist you there. Trust me you really appreciate my work mark my words sir. kindly share details over chat inbox me.. Your satisfaction is my first priority.
Hello. I am a developer with knowledge of php, java, python frameworks and so on. I am sure I can do your work perfectly. I can give you demo and start work before order . I hope to discuss with you in chat. Thank you for your kind attention. Best Regards.