We require a good, scaleable database design using an Open Source database platform? for a search engine similar to google and yahoo. This search engine will store :
Page Name
Text from Page (not HTML)
Language off Page
Links found on page (and type of link eg external, image etc)
Page Last Updated
Site Name
+more
The deliverable in this project is the database design however the project must include a working example in a web scripting language of your choice which? works similar to google? by extracting a block of text from the contents of a web page and highlighting it in bold. This page will only be to demonstrate the database in operation and the queries used to access data.
The example should support boolean searches, exact phrase using quotation marks and the + and - characters in front of a word through the use of queries.
In your bid request please specify your choice of database and why you think this is the best solution.