collective.anonymousbrowser 0.11

用户代理

哦，我的天哪，我们有一个全新的默认用户代理

>>> br = Browser()
>>> br.open('https://#:45678')
>>> FF2_USERAGENT in br.contents
True
>>> br2 = Browser('https://#:45678')
>>> FF2_USERAGENT in br2.contents
True

代理模式

但是，我们想要匿名，我们将设置一个代理。要定义这些代理，只需一个 config.ini 文件，例如

[collective.anonymousbrowser]
proxies =
    host1:port
    host2:port

当浏览器定义了多个代理时，它将循环遍历这些代理。但，它不会无限期地使用同一个主机，只需设置 proxy_max_use 参数

>>> from StringIO import StringIO
>>> from tempfile import mkstemp
>>> __, config = mkstemp()
>>> open(config, 'w').write("""[collective.anonymousbrowser]
... proxies =
...     127.0.0.1:45675
...     127.0.0.1:45676
...     127.0.0.1:45677
...     127.0.0.1:45678
...     127.0.0.1:45679
...     """)
>>> b = Browser(config=config, proxy_max_use=3)
>>> b._config._sections
{'collective.anonymousbrowser': {'__name__': 'collective.anonymousbrowser', 'proxies': '\n127.0.0.1:45675\n127.0.0.1:45676\n127.0.0.1:45677\n127.0.0.1:45678\n127.0.0.1:45679'}}
>>> b.proxies
['127.0.0.1:45675', '127.0.0.1:45676', '127.0.0.1:45677', '127.0.0.1:45678', '127.0.0.1:45679']
>>> b.proxified
True
>>> b.open('https://#:45678')
>>> 'Host: localhost:45678' in b.contents
True
>>> b._lastproxy['count'] == 1 and b._lastproxy['proxy'] in [0,1,2,3,4]
True

我们也可以有一个普通的非代理浏览器

>>> b1 = Browser(proxify=False)
>>> b1.proxified
False

接下来要验证的是我们有一个伪随机循环正在运行。首先，我们将选择第二个代理，然后是第三个。当然，我们将设置模拟器在每个行上更改代理。

>>> import mocker
>>> import random
>>> mocked = mocker.Mocker()
>>> custom_random_int = mocked.replace('random.randint')
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(2)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(2)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(2)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(3)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(4)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(2)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> custom_random_int(0, 4)
<mocker.Mock ...
>>> mocked.result(1)
>>> custom_random_int(0,1)
<mocker.Mock ...
>>> mocked.result(0)
>>> mocked.replay()
>>> b = Browser('https://#:45678', config=config, proxy_max_use=3)
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 1, 'proxy': 2}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 2, 'proxy': 2}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 3, 'proxy': 2}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 1, 'proxy': 0}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 1, 'proxy': 3}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 1, 'proxy': 4}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 1, 'proxy': 2}
>>> b.open('https://#:45678')
>>> b._lastproxy
{'count': 1, 'proxy': 1}
>>> mocked.restore()

如果代理已死，我们将它们从列表中删除

>>> __, config = mkstemp()
>>> open(config, 'w').write("""[collective.anonymousbrowser]
... proxies =
...     127.0.0.1:35675
...     127.0.0.1:35676
...     127.0.0.1:35677
...     127.0.0.1:45678
...     """)
>>> mybrowser = Browser(config=config, proxy_max_use=3)
>>> mybrowser.proxies
['127.0.0.1:35675', '127.0.0.1:35676', '127.0.0.1:35677', '127.0.0.1:45678']
>>> mybrowser.open('https://#:45678')
>>> mybrowser.proxies
['127.0.0.1:45678']
>>> mybrowser.proxies = ['127.0.0.1:34785']
>>> mybrowser.open('https://#:45678')
Traceback (most recent call last):
...
Exception: There are no valid proxies left

循环受到递归保护。如果我们总是返回同一个主机，那么选择器就不能选择其他任何东西。它将循环直到崩溃或处理递归

>>> def randomint(a,b):
...     return 2
>>> import random; random.randint = randomint
>>> b2 = Browser(config=config, proxy_max_use=3)
>>> b2.proxy_max_use
3
>>> b2._lastproxy['count']
0
>>> b2.chooseProxy()
'...
>>> b2._lastproxy['count']
1
>>> b2.chooseProxy()
'...
>>> b2._lastproxy['count']
2
>>> b2.chooseProxy()
'...
>>> b2._lastproxy['count']
3
>>> b2.chooseProxy()
'...
>>> b2.chooseProxy()
Ho, seems we got the max wills to choose, something has gone wrong
'127.0.0.1:35675'

0.10-<0.11

• 0.9的bug修复

0.9

• 修复二进制分发，现在使用示例装饰器，mozrunner在firefox目录中执行其命令

0.8

• js执行bug修复

0.7

• bug修复：当您调用open…时启动firefox，这更好。

0.6

• 文档+bug修复

• 使用testrunner处理firefox实例

• 强化代理代码

• 添加测试

0.4

• 文档+bug修复

0.3

• 添加错误消息

0.2

• 添加代理回退功能

0.1

• 初始发布