循环和非循环图的作业调度程序
项目描述
pypushflow
循环和非循环图的作业调度程序
安装
pip install pypushflow[mx]
在MX光束线安装时使用mx
选项。
运行测试
pip install pypushflow[test]
pytest
入门指南
import logging
from pypushflow.Workflow import Workflow
from pypushflow.StopActor import StopActor
from pypushflow.StartActor import StartActor
from pypushflow.PythonActor import PythonActor
from pypushflow.ThreadCounter import ThreadCounter
class MyWorkflow(Workflow):
def __init__(self, name):
super().__init__(name, level=logging.DEBUG)
ctr = ThreadCounter(parent=self)
self.startActor = StartActor(parent=self, thread_counter=ctr)
self.pythonActor = PythonActor(
parent=self,
script="pypushflow.tests.tasks.pythonActorTest.py",
name="Python Actor Test",
thread_counter=ctr,
)
self.stopActor = StopActor(parent=self, thread_counter=ctr)
self.startActor.connect(self.pythonActor)
self.pythonActor.connect(self.stopActor)
testMyWorkflow = MyWorkflow("Test workflow")
inData = {"name": "World"}
outData = testMyWorkflow.run(inData, timeout=15, pool_type="process")
assert outData["reply"] == "Hello World!"
文档
项目详情
关闭
pypushflow-0.6.2.tar.gz的哈希值
算法 | 哈希摘要 | |
---|---|---|
SHA256 | 15c30271d28f8462c8571fd10e3d5995ba68989f47273a422770e036162eb56f |
|
MD5 | 23ee350539e21959f7fcc01c5f050d99 |
|
BLAKE2b-256 | 8b7d0dc0f9b3b43bf79b67fe81cfb09e470da966db86a6feea76a333192c7aa0 |