Skip to main content
2025 Python Packaging Survey is now live!  Take the survey now

Scrapy project for feeds into INSPIRE-HEP (http://inspirehep.net).

Project description

https://img.shields.io/travis/inspirehep/hepcrawl.svg https://img.shields.io/coveralls/inspirehep/hepcrawl.svg https://img.shields.io/github/tag/inspirehep/hepcrawl.svg https://img.shields.io/pypi/dm/hepcrawl.svg https://img.shields.io/github/license/inspirehep/hepcrawl.svg

HEPcrawl is a harvesting library based on Scrapy (http://scrapy.org) for INSPIRE-HEP (http://inspirehep.net) that focuses on automatic and semi-automatic retrieval of new content from all the sources the site aggregates. In particular content from major and minor publishers in the field of High-Energy Physics.

The project is currently in early stage of development.

See full documentation at http://pythonhosted.org/hepcrawl

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page