Spider templates

Built-in spider templates use Zyte API automatic extraction to provide automatic crawling and parsing, i.e. you can run these spiders on any website of the right type to automatically extract the desired structured data.

For example, to extract all products from an e-commerce website, you can run the e-commerce spider spider as follows:

scrapy crawl ecommerce -a url="https://books.toscrape.com"

Spider templates support additional parameters beyond url. See the documentation of each specific spider for details.

You can also customize spider templates to meet your needs.

Spider template list

E-commerce

Get products from an e-commerce website.