Skip to main content

Azure Machine Learning Hardware Accelerated models

Project description

Easily create and train a model using various deep neural networks (DNNs) as a featurizer for deployment to Azure or a Data Box Edge device for ultra-low latency inference. These models are currently available:

  • ResNet 50

  • ResNet 152

  • DenseNet-121

  • VGG-16

  • SSD-VGG

Setup

Follow these instructions to install the Azure ML SDK on your local machine, create an Azure ML workspace, and set up your notebook environment, which is required for the next step.

Once you have set up your environment, install the Azure ML Accel Models SDK:

pip install azureml-accel-models

Note:* This package requires you to install tensorflow >= 1.6. This can be done using:

pip install azureml-accel-models[cpu]

If your machine supports GPU, then you can leverage the tensorflow-gpu functionality using:

pip install azureml-accel-models[gpu]

AzureML-Accel-Models

  • Create a featurizer using the Accelerated Models

  • Convert tensorflow model to ONNX format using AccelOnnxConverter

  • Create a container image with AccelContainerImage for deploying to either Azure or Data Box Edge

  • Use the sample PredictionClient for inference on a Accelerated Model Host or create your own GRPC client

Resources

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page