inspire-crawler 0.4.3
pip install inspire-crawler==0.4.3
Released:
Crawler integration with INSPIRE-HEP.
Navigation
Unverified details
These details have not been verified by PyPIProject links
Meta
- License: GNU General Public License v2 (GPLv2) (GPLv2)
- Author: CERN
- Tags invenio , inspire , scrapy , crawler
Classifiers
- Development Status
- Environment
- Intended Audience
- License
- Operating System
- Programming Language
- Topic
Project description
Crawler integration with INSPIRE-HEP using scrapy project HEPCrawl.
This module allows scheduling of crawler jobs to a Scrapyd instance serving a Scrapy project. E.g. in this case the default scrapy project is HEPCrawl.
It integrates directly with invenio-workflows module to create workflows for every record harvested by the crawler.
This module is meant to use only with INSPIRE-HEP overlay. Use at own risk.
Full documentation is hosted here: http://pythonhosted.org/inspire-crawler/
See also documentation of HEPCrawl: http://pythonhosted.org/hepcrawl/
Project details
Unverified details
These details have not been verified by PyPIProject links
Meta
- License: GNU General Public License v2 (GPLv2) (GPLv2)
- Author: CERN
- Tags invenio , inspire , scrapy , crawler
Classifiers
- Development Status
- Environment
- Intended Audience
- License
- Operating System
- Programming Language
- Topic
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file inspire-crawler-0.4.3.tar.gz.
File metadata
- Download URL: inspire-crawler-0.4.3.tar.gz
- Upload date:
- Size: 32.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6e43665062a123dead373f1663f5d0291e47c159227d74dcb2aaef7df358b327
|
|
| MD5 |
b96bae77f5fdee7ccf25a1cda6938f59
|
|
| BLAKE2b-256 |
2dd8cab81c98714cf49b79ed22c0eaf48ffe0224a7b4f483f2fe88bad9d5b1a2
|
