Closed

I need to build a web crawler that returns the most asked questions in a top 50 list

I need to build a web crawler that returns the most asked questions in a top 50 list

Job Details

Goal: I want to figure out what the most asked questions are on the web and show it in a friendly way.

Fase 1

First of all: this is a long term freelance gig. You can choose when and where to work from, but the time exposure should be similar to a part time Job. I really like Zeitgeist from Google but it’s always too late. I want a daily list of the most ‘Googled’ questions.

Your typical workday will building the crawler. The first minimum viable product (MVP) product can just search specific pages data and collects the sentence that got like ‘how to’ ‘What is’ + ‘?’ question mark in them. This data is dropt in a Excel sheet.

*Optional is that the crawler / scraper can search Social media like Twitter, Google +, Facebook and Medium for sentence with a question mark.

[url removed, login to view]

[url removed, login to view]

I prefer to get an indication for the cost’s and the hours spend on building a MVP for only Fase 1.

Fase 2

The daily crawl results can be showed on a dedicated webpage and are not dropped in a Excel sheet anymore. But in a friendly one page top 50 list.

I prefer to get an indication for the cost’s and the hours spend on building a MVP for only fase 2.

Fase 3

Users can filter on the website with the main categories and on top 15 most searched for questions. This list is about a combination of words gets the most search hits.

• ARTS & ENTERTAINMENT

• BETTING SYSTEMS

• BUSINESS / INVESTING

• COMPUTERS / INTERNET

• COOKING, FOOD & WINE

• E-BUSINESS & E-MARKETING

• EDUCATION

• EMPLOYMENT & JOBS

• FICTION

• GAMES

• GREEN PRODUCTS

• HEALTH & FITNESS

• HOME & GARDEN

• LANGUAGES

• MOBILE

• PARENTING & FAMILIES

• POLITICS / CURRENT EVENTS

• REFERENCE

• SELF-HELP

• SOFTWARE & SERVICES

• SPIRITUALITY, NEW AGE & ALTERNATIVE BELIEFS

• SPORTS

• TRAVEL

I prefer to get an indication for the cost’s and the hours spend on building a MVP for only fase 3.

Your Skills

• You are good and creative with Java, HTML, PHP

• You are experienced with Crawlers

• Enjoy building on a vision and likes a challenge

• Your written and spoken English is of a high standard

• You are always polite

Payment

Yes it’s a paid gig, after all you need to feed your pets and pay your rent, right? If you apply, make sure to let me know your expected monthly salary in US Dollar $. Just remember, I’m looking for the equivalent of a part-time employee’s hours and you can work from anywhere.

You will receive payment at the 30th of each Month via dedicated Paypal account.

If you want to apply please use the form below. Be sure to include:

• Your expected monthly salary in $US?

• When will you be able to start the job?

• Details of your experience and knowledge with Crawlers

• Links to your previous projects, blog, portfolio, etc

• Previous Jobs/Experience?

• Why you are the best guy/gal for this job

• Your Twitter, Dribbble, Github Account, in case you have one

Skills: HTML, Java, MySQL, PHP, Visual Basic

See more: work on the internet from home jobs, work in google freelance, work from home with computers, work from home via the internet, work from home travel jobs, work from home sports, work from home software jobs, work from home on computers, work from home jobs with google, work from home jobs list, work from home jobs in us, work from home jobs in education, work from home jobs freelance, work from home jobs at google, work from home java, work from home get paid daily, work from home fitness, work from home employment in, work from home education jobs, work from home education, work from home computers, work for google at home jobs, work employment jobs, workday jobs, workday freelance

About the Employer:
( 1 review ) Arnhem, Netherlands

Project ID: #6415012

16 freelancers are bidding on average €17/hour for this job

technosystem

Kindly accept my bid for your web crawler project and be assured of a high quality work with our highly experienced and dedicated developers. Thanks

€15 EUR / hour
(112 Reviews)
9.2
infoway

Dear hiring manager, First of all thank you for providing such a opportunity. We are highly enthusiastic to work in your project. Please have a look at our design & development portfolios:- [login to view URL] More

€92 EUR / hour
(162 Reviews)
8.5
SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: [login to view URL] More

€15 EUR / hour
(271 Reviews)
8.0
pytho

[login to view URL] ® Portfolio HERE, I have reviewed your project description and I am confident I can complete your website with all the customization you want to have integrated in the back-end. I am an More

€15 EUR / hour
(40 Reviews)
7.0
techwelfare

hi we could do it perfectly with accuracy, please let us know if you want any clarification. if you want us to share our skill and previous work please initiate the chat by replying..

€9 EUR / hour
(80 Reviews)
6.4
evidcomm

Hello Sir, I have read your project detail and what I understand is you want to create new website.. We can surly do that for you..kindly open message board..so I can share you detailed feature list..and we can d More

€7 EUR / hour
(49 Reviews)
6.5
mmadi

Hi, Iam interested in your project and I will be happy to do that for you. I have rich experince in scrapping curl regular expressions Dom and Selenium RC. I worked for [login to view URL] and [login to view URL] search More

€9 EUR / hour
(27 Reviews)
5.9
aistechnolabs

Hi, We have gone through your requirement and we understand that you are looking for highly skilled, qualified, and experience PHP development team for your project to develop the web crawler. I am glad to sa More

€18 EUR / hour
(4 Reviews)
5.6
Infowaze21

Hello, Greeting from Infowaze software solution Pvt. Ltd.!! I have done meticulous study of all your requirement in fase 1 - as you need all the sentence start with 'how to', '?' and 'what is' get collected in e More

€10 EUR / hour
(27 Reviews)
5.5
dpune

Hi, I have more than 14 years of exp and I am expert in this kind of work. I have completed more than 210 projects. Please look at the feedback left by my employers to know more about my work. Waiting for your positive More

€10 EUR / hour
(35 Reviews)
4.8
rkmomin

Dear Hiring Manager, First of all,its my pleasure to bid on your project, I have gone through your requirements and seen your specifications. We are ready to work on it as soon as you will award this project to u More

€7 EUR / hour
(12 Reviews)
4.2
gojkid

A proposal has not yet been provided

€10 EUR / hour
(10 Reviews)
3.5
taytayvn

Hi, see my completed projects please. I have done some projects about crawling. I have experienced in this field, so i sure i can help you solve your problems, I would like to discuss with you about it. Thanks, Taytayv More

€10 EUR / hour
(6 Reviews)
3.3
girnarsoft

Hello, Greetings from GirnarSoft Pvt Ltd!! First of all, thank you for sharing detailed requirements. I have gone through the description in depth and we have expertise to perform the job. Talking about skills- More

€9 EUR / hour
(4 Reviews)
3.2
AllenPaul72

A proposal has not yet been provided

€16 EUR / hour
(2 Reviews)
1.4
mihailmihailov

A proposal has not yet been provided

€10 EUR / hour
(0 Reviews)
0.0
fanio

Hi, i have been developing a crawler for knowledge gathering for my bot a few years ago. I also create a twitter summarization app to summarize what are the current trends. I have experience with Java and web develo More

€22 EUR / hour
(0 Reviews)
0.0