scrapy

scrapy shell http://www.allitebooks.com

We then have 5 or so object auto created

response.text is the data on the web page

We can now use XPath to try and parse this data.

XPath

XPath is very confusing to start with

Get all Elements !!

a=response.xpath('//*').extract()
len(a)