Skip to main content

A service for running Scrapy spiders, with an HTTP API

Project description

PyPI Version Build Status Coverage Status Python Version Pypi Downloads

Scrapyd is a service for deploying and running Scrapy spiders.

It allows you to upload Scrapy projects and control their spiders using a JSON API.

(If you are viewing this on GitHub, open the full documentation for additional details.)

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page