Write some Software

Firstly, we have b2b websites like [login to view URL] and [login to view URL] which is like a search engine for finding exporters. The aim of the project is to search pass a search term to the b2b websites, when results are displayed, we loop through each of the search results which comes in say 20 results per page and may have up to 100 pages. On clicking each search result, we get a new tab openned which listed details of the exporter. From this page we want to find exporters website using an efficient Regex Expression (match www, http://, http://www) after getting the website we want to navigate to the contact page and save the url of the contact page. Then we go to the 2nd search result and continue till we stop program or reach user defined limit or last search result. Also, the program should be able to loop try a text file for search terms hence the search terms would be imported to the program so for each search term we create a file and write to the file the contact URL of each site in a new line. Notes: 1. Some sites are not english but 98% of them have english url. So we may need to go to the English url to be able to get the contact page (Not sure but Regex to match something like [login to view URL] or [login to view URL] [login to view URL] or .asp ) 2. Some sites have ENTER button so you need to enter the site first to get contact page 3. Few sites are built with flash 4. Some sites doesn't have the word contact in their <a href> tag. But chances that they have the the Navigation button as Text (Contact, Contact Us or CONTACTS). 5. Some sites have the Navigation buttons as images but have href element as [login to view URL] or [login to view URL] 56. Good Knowledge of Scrapy