这是一个公共和可重现的分布式机器学习系统参考实现和基准套件集合。
项目描述
 [ [
MLBench是一个用于分布式机器学习算法的基准测试框架。
此存储库包含MLBench的核心Python库,用于在基准实现之间共享代码以及与仪表板的通信。
有关更多信息,请参阅[MLBench Core文档](https://mlbench.readthedocs.io/projects/mlbench_core/en/stable/api.html)或[主要文档](https://mlbench.readthedocs.io/)
# 更新日志
## [v3.0.0](https://github.com/mlbench/mlbench-core/tree/v3.0.0) (2020-12-07)
[完整更新日志](https://github.com/mlbench/mlbench-core/compare/v2.4.0…v3.0.0)
实现了增强
支持CLI中的多个集群 [#91](https://github.com/mlbench/mlbench-core/issues/91)
添加笔记本/代码以可视化结果 [#72](https://github.com/mlbench/mlbench-core/issues/72)
支持CLI中的AWS [#33](https://github.com/mlbench/mlbench-core/issues/33)
修复rnn语言模型 [#303](https://github.com/mlbench/mlbench-core/pull/303) ([ehoelzl](https://github.com/ehoelzl))
Transformer语言翻译 [#99](https://github.com/mlbench/mlbench-core/pull/99) ([ehoelzl](https://github.com/ehoelzl))
修复了错误
PyTorch训练完成后,训练代码仍在运行 [#26](https://github.com/mlbench/mlbench-core/issues/26)
关闭问题
对于指标计算移除损失参数 [#295](https://github.com/mlbench/mlbench-core/issues/295)
更新PyTorch到1.7 [#286](https://github.com/mlbench/mlbench-core/issues/286)
重构优化器并选择更合适的名称 [#284](https://github.com/mlbench/mlbench-core/issues/284)
无法创建kind集群 [#277](https://github.com/mlbench/mlbench-core/issues/277)
重构CLI [#253](https://github.com/mlbench/mlbench-core/issues/253)
Dependabot无法通过https://pypi.python.org/simple/进行认证 [#252](https://github.com/mlbench/mlbench-core/issues/252)
统一requirements/setup.py版本 [#244](https://github.com/mlbench/mlbench-core/issues/244)
isort在所有PR上失败 [#227](https://github.com/mlbench/mlbench-core/issues/227)
torch.div在PyTorch 1.6中不受支持 [#223](https://github.com/mlbench/mlbench-core/issues/223)
重构tiller和helm的通用功能 [#108](https://github.com/mlbench/mlbench-core/issues/108)
在CLI中为AWS添加GPU支持 [#104](https://github.com/mlbench/mlbench-core/issues/104)
将CPU限制更改为#CPUs - 1 [#101](https://github.com/mlbench/mlbench-core/issues/101)
添加–version标志 [#97](https://github.com/mlbench/mlbench-core/issues/97)
使用非默认区域创建/删除集群时出现错误 [#94](https://github.com/mlbench/mlbench-core/issues/94)
向列表中添加命令 [#86](https://github.com/mlbench/mlbench-core/issues/86)
从gcloud中返回RefreshError [#83](https://github.com/mlbench/mlbench-core/issues/83)
运行新的基准测试并记录成本 [#82](https://github.com/mlbench/mlbench-core/issues/82)
将nvidia k80设为默认GPU [#80](https://github.com/mlbench/mlbench-core/issues/80)
修复随机种子 [#79](https://github.com/mlbench/mlbench-core/issues/79)
与torch.nn.parallel.DistributedDataParallel MPSG进行基准测试 [#75](https://github.com/mlbench/mlbench-core/issues/75)
升级到pytorch 1.5 [#74](https://github.com/mlbench/mlbench-core/issues/74)
提供与竞争对手的比较 [#66](https://github.com/mlbench/mlbench-core/issues/66)
添加一些集成测试 [#64](https://github.com/mlbench/mlbench-core/issues/64)
删除过时的分支 [#62](https://github.com/mlbench/mlbench-core/issues/62)
添加PowerSGD优化器 [#59](https://github.com/mlbench/mlbench-core/issues/59)
添加RNN语言模型 [#54](https://github.com/mlbench/mlbench-core/issues/54)
使用torch.nn.DataParallel进行节点内计算 [#46](https://github.com/mlbench/mlbench-core/issues/46)
为DIND添加CLI支持 [#42](https://github.com/mlbench/mlbench-core/issues/42)
将语言模型基准测试的功能迁移到核心库 [#34](https://github.com/mlbench/mlbench-core/issues/34)
从命令行使结果可重现 [#24](https://github.com/mlbench/mlbench-core/issues/24)
在README.md中添加贡献和文档部分 [#17](https://github.com/mlbench/mlbench-core/issues/17)
测试新的torch.distributed [#15](https://github.com/mlbench/mlbench-core/issues/15)
合并的拉取请求
Bugfix KIND cli [#307](https://github.com/mlbench/mlbench-core/pull/307) ([ehoelzl](https://github.com/ehoelzl))
更新README.md以显示新徽章 [#306](https://github.com/mlbench/mlbench-core/pull/306) ([ehoelzl](https://github.com/ehoelzl))
创建manual.yml [#305](https://github.com/mlbench/mlbench-core/pull/305) ([ehoelzl](https://github.com/ehoelzl))
切换到github actions [#304](https://github.com/mlbench/mlbench-core/pull/304) ([ehoelzl](https://github.com/ehoelzl))
将sphinx从3.3.0提升到3.3.1 [#301](https://github.com/mlbench/mlbench-core/pull/301) ([dependabot[bot]](https://github.com/apps/dependabot))
从metric参数中删除loss [#297](https://github.com/mlbench/mlbench-core/pull/297) ([ehoelzl](https://github.com/ehoelzl))
修复翻译器 [#294](https://github.com/mlbench/mlbench-core/pull/294) ([ehoelzl](https://github.com/ehoelzl))
更新pytorch [#292](https://github.com/mlbench/mlbench-core/pull/292) ([ehoelzl](https://github.com/ehoelzl))
将/docs中的sphinx从3.2.1提升到3.3.0 [#288](https://github.com/mlbench/mlbench-core/pull/288) ([dependabot[bot]](https://github.com/apps/dependabot))
重构优化器 [#285](https://github.com/mlbench/mlbench-core/pull/285) ([ehoelzl](https://github.com/ehoelzl))
将isort从5.5.4提升到5.6.4 [#283](https://github.com/mlbench/mlbench-core/pull/283) ([dependabot[bot]](https://github.com/apps/dependabot))
将sphinx-autoapi从1.5.0升级到1.5.1 [#280](https://github.com/mlbench/mlbench-core/pull/280) ([dependabot[bot]](https://github.com/apps/dependabot))
在AWS上添加GPU功能 [#278](https://github.com/mlbench/mlbench-core/pull/278) ([mmilenkoski](https://github.com/mmilenkoski))
在创建/删除集群时捕获异常 [#276](https://github.com/mlbench/mlbench-core/pull/276) ([ehoelzl](https://github.com/ehoelzl))
修复文档 [#275](https://github.com/mlbench/mlbench-core/pull/275) ([ehoelzl](https://github.com/ehoelzl))
修复AWS部署 [#274](https://github.com/mlbench/mlbench-core/pull/274) ([mmilenkoski](https://github.com/mmilenkoski))
创建dependabot.yml [#260](https://github.com/mlbench/mlbench-core/pull/260) ([ehoelzl](https://github.com/ehoelzl))
合并需求并更新文档 [#259](https://github.com/mlbench/mlbench-core/pull/259) ([ehoelzl](https://github.com/ehoelzl))
将google-api-python-client从1.9.3升级到1.12.1 [#246](https://github.com/mlbench/mlbench-core/pull/246) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将numpy从1.19.0升级到1.19.2 [#245](https://github.com/mlbench/mlbench-core/pull/245) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将boto3从1.14.6升级到1.14.50 [#234](https://github.com/mlbench/mlbench-core/pull/234) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
修复isort错误 [#233](https://github.com/mlbench/mlbench-core/pull/233) ([mmilenkoski](https://github.com/mmilenkoski))
将pytest-mock从3.1.1升级到3.3.1 [#231](https://github.com/mlbench/mlbench-core/pull/231) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将isort从4.3.21升级到5.4.2 [#221](https://github.com/mlbench/mlbench-core/pull/221) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinx从3.0.4升级到3.2.1 [#220](https://github.com/mlbench/mlbench-core/pull/220) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将grpcio从1.29.0升级到1.31.0 [#207](https://github.com/mlbench/mlbench-core/pull/207) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将spacy从2.3.0升级到2.3.2 [#182](https://github.com/mlbench/mlbench-core/pull/182) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
降级Sphinx [#162](https://github.com/mlbench/mlbench-core/pull/162) ([ehoelzl](https://github.com/ehoelzl))
添加开发者文档 [#161](https://github.com/mlbench/mlbench-core/pull/161) ([Panaetius](https://github.com/Panaetius))
FP优化器变更 [#160](https://github.com/mlbench/mlbench-core/pull/160) ([ehoelzl](https://github.com/ehoelzl))
将wcwidth从0.1.9升级到0.2.5 [#156](https://github.com/mlbench/mlbench-core/pull/156) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
升级所有版本并添加文档测试 [#152](https://github.com/mlbench/mlbench-core/pull/152) ([Panaetius](https://github.com/Panaetius))
将torchvision从0.6.0升级到0.6.1 [#151](https://github.com/mlbench/mlbench-core/pull/151) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将numpy从1.18.5升级到1.19.0 [#150](https://github.com/mlbench/mlbench-core/pull/150) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将torch从1.5.0升级到1.5.1 [#148](https://github.com/mlbench/mlbench-core/pull/148) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将google-auth从1.17.2升级到1.18.0 [#147](https://github.com/mlbench/mlbench-core/pull/147) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinx-rtd-theme从0.4.3升级到0.5.0 [#144](https://github.com/mlbench/mlbench-core/pull/144) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将spacy从2.2.4升级到2.3.0 [#142](https://github.com/mlbench/mlbench-core/pull/142) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinx从3.1.0升级到3.1.1 [#140](https://github.com/mlbench/mlbench-core/pull/140) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将dill从0.3.1.1升级到0.3.2 [#138](https://github.com/mlbench/mlbench-core/pull/138) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
更新依赖项 [#137](https://github.com/mlbench/mlbench-core/pull/137) ([Panaetius](https://github.com/Panaetius))
将spacy从2.2.3升级到2.2.4 [#135](https://github.com/mlbench/mlbench-core/pull/135) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将numpy从1.16.6升级到1.18.5 [#133](https://github.com/mlbench/mlbench-core/pull/133) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将freezegun从0.3.12升级到0.3.15 [#129](https://github.com/mlbench/mlbench-core/pull/129) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将tabulate从0.8.6升级到0.8.7 [#128](https://github.com/mlbench/mlbench-core/pull/128) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将deprecation从2.0.6升级到2.1.0 [#125](https://github.com/mlbench/mlbench-core/pull/125) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将pytest-black从0.3.8升级到0.3.9 [#124](https://github.com/mlbench/mlbench-core/pull/124) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinx-rtd-theme从0.4.2升级到0.4.3 [#123](https://github.com/mlbench/mlbench-core/pull/123) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinx从1.8.1升级到3.1.0 [#121](https://github.com/mlbench/mlbench-core/pull/121) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将pytest-mock从1.10.0升级到3.1.1 [#120](https://github.com/mlbench/mlbench-core/pull/120) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将torchtext从0.5.0升级到0.6.0 [#118](https://github.com/mlbench/mlbench-core/pull/118) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将torchvision从0.5.0升级到0.6.0 [#117](https://github.com/mlbench/mlbench-core/pull/117) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
添加对多个集群的支持 [#115](https://github.com/mlbench/mlbench-core/pull/115) ([Panaetius](https://github.com/Panaetius))
将点击次数从7.0提升到7.1.2 [#114](https://github.com/mlbench/mlbench-core/pull/114) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将google-cloud-container从0.3.0升级到0.5.0 [#113](https://github.com/mlbench/mlbench-core/pull/113) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将appdirs从1.4.3升级到1.4.4 [#112](https://github.com/mlbench/mlbench-core/pull/112) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinxcontrib-bibtex从0.4.0升级到1.0.0 [#111](https://github.com/mlbench/mlbench-core/pull/111) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
将sphinx-autoapi从1.3.0升级到1.4.0 [#110](https://github.com/mlbench/mlbench-core/pull/110) ([dependabot-preview[bot]](https://github.com/apps/dependabot-preview))
在create_aws中移除未使用的参数 [#109](https://github.com/mlbench/mlbench-core/pull/109) ([mmilenkoski](https://github.com/mmilenkoski))
修复随机种子问题,添加新的跟踪统计信息 [#107](https://github.com/mlbench/mlbench-core/pull/107) ([ehoelzl](https://github.com/ehoelzl))
在test_cli中添加return_code检查 [#106](https://github.com/mlbench/mlbench-core/pull/106) ([mmilenkoski](https://github.com/mmilenkoski))
在CLI中添加AWS支持 [#103](https://github.com/mlbench/mlbench-core/pull/103) ([mmilenkoski](https://github.com/mmilenkoski))
更新test_cli.py [#100](https://github.com/mlbench/mlbench-core/pull/100) ([giorgiosav](https://github.com/giorgiosav))
在cli中添加图表命令 [#95](https://github.com/mlbench/mlbench-core/pull/95) ([Panaetius](https://github.com/Panaetius))
在CLI中添加对kind集群创建的支持 [#93](https://github.com/mlbench/mlbench-core/pull/93) ([mmilenkoski](https://github.com/mmilenkoski))
# 更新日志
## [v2.4.0](https://github.com/mlbench/mlbench-core/tree/v2.4.0) (2020-04-20)
[完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.3.2…v2.4.0)
实现了增强
将代码格式化切换到black [#35](https://github.com/mlbench/mlbench-core/issues/35)
关闭问题
仅针对Python 3.6运行Travis测试 [#65](https://github.com/mlbench/mlbench-core/issues/65)
如果没有提供–output选项,则下载结果失败 [#57](https://github.com/mlbench/mlbench-core/issues/57)
在mlbench run中记住用户输入 [#56](https://github.com/mlbench/mlbench-core/issues/56)
按模型聚合梯度,而不是按层聚合。 [#45](https://github.com/mlbench/mlbench-core/issues/45)
更新docker镜像到CUDA10,mlbench-core模块到最新版 [#43](https://github.com/mlbench/mlbench-core/issues/43)
升级PyTorch到1.4 [#40](https://github.com/mlbench/mlbench-core/issues/40)
合并的拉取请求
Pytorch v1.4.0 [#68](https://github.com/mlbench/mlbench-core/pull/68) ([ehoelzl](https://github.com/ehoelzl))
修复ci [#67](https://github.com/mlbench/mlbench-core/pull/67) ([ehoelzl](https://github.com/ehoelzl))
按模型添加聚合 [#61](https://github.com/mlbench/mlbench-core/pull/61) ([ehoelzl](https://github.com/ehoelzl))
在mlbench运行中记住用户输入 [#60](https://github.com/mlbench/mlbench-core/pull/60) ([mmilenkoski](https://github.com/mmilenkoski))
在CLI中添加输出文件的默认名称 [#58](https://github.com/mlbench/mlbench-core/pull/58) ([mmilenkoski](https://github.com/mmilenkoski))
CLI适配 [#55](https://github.com/mlbench/mlbench-core/pull/55) ([ehoelzl](https://github.com/ehoelzl))
更新标签和补丁版本到2.3.2 [#52](https://github.com/mlbench/mlbench-core/pull/52) ([ehoelzl](https://github.com/ehoelzl))
添加get_optimizer以创建优化器对象 [#48](https://github.com/mlbench/mlbench-core/pull/48) ([mmilenkoski](https://github.com/mmilenkoski))
# 更新日志
## [v2.3.2](https://github.com/mlbench/mlbench-core/tree/v2.3.2) (2020-04-07)
[完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.3.1…v2.3.2)
实现了增强
添加NCCL & GLOO后端支持 [#49](https://github.com/mlbench/mlbench-core/issues/49)
添加NCCL & GLOO后端支持 [#47](https://github.com/mlbench/mlbench-core/pull/47) ([giorgiosav](https://github.com/giorgiosav))
修复了错误
1节点集群中的math ValueError问题 [#38](https://github.com/mlbench/mlbench-core/issues/38)
合并的拉取请求
num_workers修复 [#51](https://github.com/mlbench/mlbench-core/pull/51) ([giorgiosav](https://github.com/giorgiosav))
添加集中式Adam实现 [#41](https://github.com/mlbench/mlbench-core/pull/41) ([mmilenkoski](https://github.com/mmilenkoski))
# 变更日志
## [2.3.1](https://github.com/mlbench/mlbench-core/tree/2.3.1) (2020-03-09) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.3.0…2.3.1)
实现了增强
针对稀疏化/量化/去中心化场景定制通信方案 [#12](https://github.com/mlbench/mlbench-core/issues/12)
## [v2.3.0](https://github.com/mlbench/mlbench-core/tree/v2.3.0) (2019-12-23) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.2.1…v2.3.0)
## [v2.2.1](https://github.com/mlbench/mlbench-core/tree/v2.2.1) (2019-12-16) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.2.0…v2.2.1)
# 变更日志
## [v2.2.0](https://github.com/mlbench/mlbench-core/tree/v2.2.0) (2019-11-11) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.1.0…v2.2.0)
实现增强: - initialize_backends现在可以作为一个上下文管理器调用 - 改进了CLI以并行运行多个运行
## [v2.1.1](https://github.com/mlbench/mlbench-core/tree/v2.1.1) (2019-11-11) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.1.0…v2.1.1)
## [v2.1.0](https://github.com/mlbench/mlbench-core/tree/v2.1.0) (2019-11-4) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v2.0.0…v2.1.0)
实现了增强
添加MLBench运行的CLI
## [v1.4.4](https://github.com/mlbench/mlbench-core/tree/v1.4.4) (2019-05-28) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.4.3…v1.4.4)
## [v1.4.3](https://github.com/mlbench/mlbench-core/tree/v1.4.3) (2019-05-23) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.4.2…v1.4.3)
## [v1.4.2](https://github.com/mlbench/mlbench-core/tree/v1.4.2) (2019-05-21) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.4.1…v1.4.2)
## [v1.4.1](https://github.com/mlbench/mlbench-core/tree/v1.4.1) (2019-05-16) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.4.0…v1.4.1)
## [v1.4.0](https://github.com/mlbench/mlbench-core/tree/v1.4.0) (2019-05-02) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.4…v1.4.0)
实现了增强
Tensorflow 中分割训练集和验证集 [#22](https://github.com/mlbench/mlbench-core/issues/22)
## [v1.3.4](https://github.com/mlbench/mlbench-core/tree/v1.3.4) (2019-03-20) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.3…v1.3.4)
实现了增强
在 controlflow 中,不要混合训练集和验证集 [#20](https://github.com/mlbench/mlbench-core/issues/20)
修复了错误
为 Tensorflow 添加指标记录功能 [#19](https://github.com/mlbench/mlbench-core/issues/19)
## [v1.3.3](https://github.com/mlbench/mlbench-core/tree/v1.3.3) (2019-02-26) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.2…v1.3.3)
## [v1.3.2](https://github.com/mlbench/mlbench-core/tree/v1.3.2) (2019-02-13) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.1…v1.3.2)
## [v1.3.1](https://github.com/mlbench/mlbench-core/tree/v1.3.1) (2019-02-13) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.0…v1.3.1)
## [v1.3.0](https://github.com/mlbench/mlbench-core/tree/v1.3.0) (2019-02-12) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.2.1…v1.3.0)
## [v1.2.1](https://github.com/mlbench/mlbench-core/tree/v1.2.1) (2019-01-31) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.2.0…v1.2.1)
## [v1.2.0](https://github.com/mlbench/mlbench-core/tree/v1.2.0) (2019-01-30) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.1.1…v1.2.0)
## [v1.1.1](https://github.com/mlbench/mlbench-core/tree/v1.1.1) (2019-01-09) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.1.0…v1.1.1)
## [v1.1.0](https://github.com/mlbench/mlbench-core/tree/v1.1.0) (2018-12-06) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.0.0…v1.1.0)
修复了错误
保存检查点时出现错误 [#13](https://github.com/mlbench/mlbench-core/issues/13)
## [v1.0.0](https://github.com/mlbench/mlbench-core/tree/v1.0.0) (2018-11-20) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/1.4.2…v1.0.0)
实现了增强
将 API 客户端添加到 mlbench-core [#6](https://github.com/mlbench/mlbench-core/issues/6)
迁移至 google-style 文档 [#4](https://github.com/mlbench/mlbench-core/issues/4)
为 Pytorch 添加 Imagenet 数据集 [#3](https://github.com/mlbench/mlbench-core/issues/3)
将工作代码迁移到 mlbench-core 仓库 [#1](https://github.com/mlbench/mlbench-core/issues/1)
# 变更日志
## [1.4.2](https://github.com/mlbench/mlbench-core/tree/1.4.2) (2019-05-21) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.0.0…1.4.2)
实现了增强
Tensorflow 中分割训练集和验证集 [#22](https://github.com/mlbench/mlbench-core/issues/22)
在 controlflow 中,不要混合训练集和验证集 [#20](https://github.com/mlbench/mlbench-core/issues/20)
修复了错误
为 Tensorflow 添加指标记录功能 [#19](https://github.com/mlbench/mlbench-core/issues/19)
保存检查点时出现错误 [#13](https://github.com/mlbench/mlbench-core/issues/13)
# 变更日志
## [v1.4.1](https://github.com/mlbench/mlbench-core/tree/v1.4.1) (2019-05-16) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.4.0…v1.4.1)
## [1.4.0](https://github.com/mlbench/mlbench-core/tree/1.4.0) (2019-05-02) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.0.0…1.4.0)
实现了增强
Tensorflow 中分割训练集和验证集 [#22](https://github.com/mlbench/mlbench-core/issues/22)
在 controlflow 中,不要混合训练集和验证集 [#20](https://github.com/mlbench/mlbench-core/issues/20)
修复了错误
为 Tensorflow 添加指标记录功能 [#19](https://github.com/mlbench/mlbench-core/issues/19)
保存检查点时出现错误 [#13](https://github.com/mlbench/mlbench-core/issues/13)
# 变更日志
## [v1.3.4](https://github.com/mlbench/mlbench-core/tree/v1.3.4) (2019-03-20) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.3…v1.3.4)
实现了增强
在 controlflow 中,不要混合训练集和验证集 [#20](https://github.com/mlbench/mlbench-core/issues/20)
修复了错误
为 Tensorflow 添加指标记录功能 [#19](https://github.com/mlbench/mlbench-core/issues/19)
## [v1.3.3](https://github.com/mlbench/mlbench-core/tree/v1.3.3) (2019-02-26) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.2…v1.3.3)
## [v1.3.2](https://github.com/mlbench/mlbench-core/tree/v1.3.2) (2019-02-13) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.1…v1.3.2)
## [v1.3.1](https://github.com/mlbench/mlbench-core/tree/v1.3.1) (2019-02-13) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.3.0…v1.3.1)
## [v1.3.0](https://github.com/mlbench/mlbench-core/tree/v1.3.0) (2019-02-12) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.2.1…v1.3.0)
## [v1.2.1](https://github.com/mlbench/mlbench-core/tree/v1.2.1) (2019-01-31) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.2.0…v1.2.1)
## [v1.2.0](https://github.com/mlbench/mlbench-core/tree/v1.2.0) (2019-01-30) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.1.1…v1.2.0)
## [v1.1.1](https://github.com/mlbench/mlbench-core/tree/v1.1.1) (2019-01-09) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.1.0…v1.1.1)
# 变更日志
## [v1.1.0](https://github.com/mlbench/mlbench-core/tree/v1.1.0) (2018-12-06) [完整变更日志](https://github.com/mlbench/mlbench-core/compare/v1.0.0…v1.1.0)
修复了错误
保存检查点时出现错误 [#13](https://github.com/mlbench/mlbench-core/issues/13)
添加 Tensorflow 控制流、数据集和模型代码
添加 Pytorch 线性模型
添加稀疏化和去中心化优化器
## [v1.0.0](https://github.com/mlbench/mlbench-core/tree/v1.0.0) (2018-11-15)
实现了增强
将 API 客户端添加到 mlbench-core [#6](https://github.com/mlbench/mlbench-core/issues/6)
迁移至 google-style 文档 [#4](https://github.com/mlbench/mlbench-core/issues/4)
为 Pytorch 添加 Imagenet 数据集 [#3](https://github.com/mlbench/mlbench-core/issues/3)
将工作代码迁移到 mlbench-core 仓库 [#1](https://github.com/mlbench/mlbench-core/issues/1)
## [0.1.0](https://github.com/mlbench/mlbench/tree/0.1.0) (2018-09-14) 实现的增强功能:
在参考实现中添加文档 [#46](https://github.com/mlbench/mlbench/issues/46)
将cAdvisor替换为Kubernetes资源使用统计 [#38](https://github.com/mlbench/mlbench/issues/38)
重命名文件夹 [#31](https://github.com/mlbench/mlbench/issues/31)
更改Docker镜像名称 [#30](https://github.com/mlbench/mlbench/issues/30)
为mpirun添加连续输出 [#27](https://github.com/mlbench/mlbench/issues/27)
将SQLite替换为Postgres [#25](https://github.com/mlbench/mlbench/issues/25)
修复unittest [#23](https://github.com/mlbench/mlbench/issues/23)
添加/修复CI/自动化构建 [#22](https://github.com/mlbench/mlbench/issues/22)
清理不必要的项目文件 [#21](https://github.com/mlbench/mlbench/issues/21)
移除硬编码值 [#20](https://github.com/mlbench/mlbench/issues/20)
改进Notes.txt [#19](https://github.com/mlbench/mlbench/issues/19)
重命名组件 [#15](https://github.com/mlbench/mlbench/issues/15)
修复了错误
长时间运行时下载指标时出现504错误 [#61](https://github.com/mlbench/mlbench/issues/61)
关闭问题
第一版的小文档改进 [#54](https://github.com/mlbench/mlbench/issues/54)
检查mlbench是否可在Google Cloud上运行 [#51](https://github.com/mlbench/mlbench/issues/51)
学习率调度器 [#50](https://github.com/mlbench/mlbench/issues/50)
将Nvidia k8s-device-plugin添加到图表中 [#48](https://github.com/mlbench/mlbench/issues/48)
将Weave添加到Helm图表 [#41](https://github.com/mlbench/mlbench/issues/41)
允许限制实验的资源 [#39](https://github.com/mlbench/mlbench/issues/39)
允许下载运行度量值 [#35](https://github.com/mlbench/mlbench/issues/35)
工作详情页面 [#33](https://github.com/mlbench/mlbench/issues/33)
运行可视化 [#32](https://github.com/mlbench/mlbench/issues/32)
在仪表板中显示实验历史记录 [#18](https://github.com/mlbench/mlbench/issues/18)
在仪表板中显示模型进度 [#13](https://github.com/mlbench/mlbench/issues/13)
在仪表板中报告集群状态 [#12](https://github.com/mlbench/mlbench/issues/12)
从SGD示例发送指标到指标API [#11](https://github.com/mlbench/mlbench/issues/11)
为实验添加指标端点 [#10](https://github.com/mlbench/mlbench/issues/10)
让协调器仪表板启动分布式实验 [#9](https://github.com/mlbench/mlbench/issues/9)
添加小批量SGD模型实验 [#8](https://github.com/mlbench/mlbench/issues/8)
添加MPI基准测试代码 [#7](https://github.com/mlbench/mlbench/issues/7)
添加tensorflow基准测试代码 [#6](https://github.com/mlbench/mlbench/issues/6)
添加Apache Reef基准测试代码 [#5](https://github.com/mlbench/mlbench/issues/5)
为Apache Flink添加基准测试代码 [#4](https://github.com/mlbench/mlbench/issues/4)
获取初始基准测试数值(Spark参考实现和mllib/ml) [#3](https://github.com/mlbench/mlbench/issues/3)
评估脚本(框架无关)和算法输出格式 [#2](https://github.com/mlbench/mlbench/issues/2)
bench-spark: 现在移除prepare-data,对求解器先决条件进行注释 [#1](https://github.com/mlbench/mlbench/issues/1)
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此变更日志由[github_changelog_generator](https://github.com/skywinder/Github-Changelog-Generator)自动生成
* 此日志由[github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)自动生成
* 此日志由[github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)自动生成
* 此日志由[github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)自动生成
项目详情
下载文件
下载适合您平台的文件。如果您不确定选择哪个,请了解更多关于安装包的信息。
源代码分发
构建分发
mlbench_core-3.0.0.tar.gz的哈希值
算法 | 哈希摘要 | |
---|---|---|
SHA256 | 109f4ee46dd01b64ab621af740cb94e12704a2cd37bced570beb2b88fa20a2df |
|
MD5 | 2839dfeb088caa0f38d4060f2862290b |
|
BLAKE2b-256 | c2a21d07aa39c109f46e6ce66bb83c5c8d214945876a9c6ef5d65001160557b4 |
mlbench_core-3.0.0-py3-none-any.whl的哈希值
算法 | 哈希摘要 | |
---|---|---|
SHA256 | 89d9af1825ceccf5dd4a4cbed76ba0e0a9e3e171cfdc04e9ba0b0de98443b80c |
|
MD5 | 5cc58ce92181a53909c91a1d76d7fc8b |
|
BLAKE2b-256 | 9ee7eb4b915d1cf370ecd122081eda57289303fd54b266d1ecac7174debdfe57 |