Completely scrape and spider an ecommerce site for inventory using python
$250-750 USD
Completed
Posted over 11 years ago
$250-750 USD
Paid on delivery
You are asked to create a python spidering program that downloads every product from a popular ecommerce site, returning a map of 9-12 bits of information about each product (product name, model number, cost, possible shipping cost, etc)
the project will be broken up in to 3 parts.
1.) part one will be to create a list of every bottom url listings page in the webpage hierarchy (the page where they list all products of a given type)
2.) scrape this bottom listings page (including the next pages, if multiple ones are present for the listings page) for individual listings url
3.) for each individual listings url, return the map with product information.