I need to build a web crawler that returns the most asked questions in a top 50 list
Goal: I want to figure out what the most asked questions are on the web and show it in a friendly way.
First of all: this is a long term freelance gig. You can choose when and where to work from, but the time exposure should be similar to a part time Job. I really like Zeitgeist from Google but it’s always too late. I want a daily list of the most ‘Googled’ questions.
Your typical workday will building the crawler. The first minimum viable product (MVP) product can just search specific pages data and collects the sentence that got like ‘how to’ ‘What is’ + ‘?’ question mark in them. This data is dropt in a Excel sheet.
*Optional is that the crawler / scraper can search Social media like Twitter, Google +, Facebook and Medium for sentence with a question mark.
[url removed, login to view]
[url removed, login to view]
I prefer to get an indication for the cost’s and the hours spend on building a MVP for only Fase 1.
The daily crawl results can be showed on a dedicated webpage and are not dropped in a Excel sheet anymore. But in a friendly one page top 50 list.
I prefer to get an indication for the cost’s and the hours spend on building a MVP for only fase 2.
Users can filter on the website with the main categories and on top 15 most searched for questions. This list is about a combination of words gets the most search hits.
• ARTS & ENTERTAINMENT
• BETTING SYSTEMS
• BUSINESS / INVESTING
• COMPUTERS / INTERNET
• COOKING, FOOD & WINE
• E-BUSINESS & E-MARKETING
• EMPLOYMENT & JOBS
• GREEN PRODUCTS
• HEALTH & FITNESS
• HOME & GARDEN
• PARENTING & FAMILIES
• POLITICS / CURRENT EVENTS
• SOFTWARE & SERVICES
• SPIRITUALITY, NEW AGE & ALTERNATIVE BELIEFS
I prefer to get an indication for the cost’s and the hours spend on building a MVP for only fase 3.
• You are good and creative with Java, HTML, PHP
• You are experienced with Crawlers
• Enjoy building on a vision and likes a challenge
• Your written and spoken English is of a high standard
• You are always polite
Yes it’s a paid gig, after all you need to feed your pets and pay your rent, right? If you apply, make sure to let me know your expected monthly salary in US Dollar $. Just remember, I’m looking for the equivalent of a part-time employee’s hours and you can work from anywhere.
You will receive payment at the 30th of each Month via dedicated Paypal account.
If you want to apply please use the form below. Be sure to include:
• Your expected monthly salary in $US?
• When will you be able to start the job?
• Details of your experience and knowledge with Crawlers
• Links to your previous projects, blog, portfolio, etc
• Previous Jobs/Experience?
• Why you are the best guy/gal for this job
• Your Twitter, Dribbble, Github Account, in case you have one
16 freelancers are bidding on average €17/hour for this job
hi we could do it perfectly with accuracy, please let us know if you want any clarification. if you want us to share our skill and previous work please initiate the chat by replying..