EEK 1.0.2

安装

$ pip install eek

使用

用法：eek [-h] [–graph] [–delay SECONDS] [–grep PATTERN] [-i] URL

eek递归地爬取网站，并以CSV格式输出每个页面的元数据。

positional arguments:
  URL                The base URL to start the crawl

optional arguments:
  -h, --help         show this help message and exit
  --graph            output a graphviz digraph of links instead of CSV
                     metadata
  --delay SECONDS    Time, in seconds, to wait in between fetches. Defaults to
                     0.
  --grep PATTERN     Print urls containing PATTERN (a python regular
                     expression).
  -i, --ignore-case  Ignore case. Only valid with --grep

示例

eek http://example.com/

要将输出保存到文件，请使用重定向

eek http://example.com/ > ~/some_file.csv

要减慢爬取速度，请使用--delay=[seconds]