Get in Touch

Course Outline

Introduction to Edge AI and Ascend 310

  • Overview of Edge AI: trends, constraints, and applications.
  • Huawei Ascend 310 chip architecture and supported toolchain.
  • Positioning CANN within the edge AI deployment stack.

Model Preparation and Conversion

  • Exporting trained models from TensorFlow, PyTorch, and MindSpore.
  • Using ATC to convert models to OM format for Ascend devices.
  • Handling unsupported operations and employing lightweight conversion strategies.

Developing Inference Pipelines with AscendCL

  • Using the AscendCL API to run OM models on Ascend 310.
  • Input/output preprocessing, memory handling, and device control.
  • Deploying within embedded containers or lightweight runtime environments.

Optimization for Edge Constraints

  • Reducing model size and tuning precision (FP16, INT8).
  • Using the CANN profiler to identify performance bottlenecks.
  • Managing memory layout and data streaming for optimal performance.

Deploying with MindSpore Lite

  • Using the MindSpore Lite runtime for mobile and embedded targets.
  • Comparing MindSpore Lite with raw AscendCL pipelines.
  • Packaging inference models for device-specific deployment.

Edge Deployment Scenarios and Case Studies

  • Case study: smart camera with object detection model on Ascend 310.
  • Case study: real-time classification in an IoT sensor hub.
  • Monitoring and updating deployed models at the edge.

Summary and Next Steps

Requirements

  • Experience in AI model development or deployment workflows.
  • Fundamental knowledge of embedded systems, Linux, and Python.
  • Familiarity with deep learning frameworks such as TensorFlow or PyTorch.

Audience

  • IoT solution developers.
  • Embedded AI engineers.
  • Edge system integrators and AI deployment specialists.
 14 Hours

Testimonials (1)

Related Categories