Spider templates

Built-in spider templates use Zyte API automatic extraction to provide automatic crawling and parsing, i.e. you can run these spiders on any website of the right type to automatically extract the desired structured data.

For example, to extract all products from an e-commerce website, you can run the e-commerce spider spider as follows:

scrapy crawl ecommerce -a url="https://books.toscrape.com"

Spider templates support additional parameters beyond url. See the documentation of each specific spider for details.

You can also customize spider templates to meet your needs.

Spider template list

E-commerce: Get products from an e-commerce website.
Google Search: Get Google search results.