Skip to main content

Slybot crawler

Project description

Slybot is a Python web crawler for doing web scraping. It’s implemented on top of the Scrapy web crawling framework and the Scrapely extraction library.

The documentation (including installation and usage) can be found at: http://slybot.readthedocs.org/

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page