Skip to content

About

🦥 A from-scratch learning implementation of an ONNX-style model format and inference runtime for mobile, edge, and on-device AI.

Topics

Resources

Stars

3 stars

Watchers

0 watching

Forks

Latest commit

 

History

49 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TinyONNX — Lightweight AI Inference

TinyONNX · Mini Edge Runtime

A tiny, dependency-free machine learning runtime built from scratch for learning and edge inference.

Python 3.10+ C++20 Zero runtime dependencies MIT license Experimental status

Overview · Hardware · Quick start · Architecture · Supported operations · Development


Overview

TinyONNX is a compact implementation of an ONNX-inspired model format and inference runtime for mobile, edge, and on-device AI. The project keeps the entire execution path visible: tensors, graph validation, operator schemas, planning, kernels, and native execution.

It does not depend on ONNX, ONNX Runtime, NumPy, or another machine learning framework.

Important

TinyONNX is an educational, experimental runtime. Its JSON model format is inspired by ONNX architecture, but it is not the official ONNX wire format and is not intended for production workloads yet.

Hardware support

Board Image Progress Documentation / example
ESP32-CAM ESP32-CAM board Planned; not yet validated. Not available yet.
ESP32 DevKit ESP32 DevKit board Complete reference: ESP-IDF build and flash verified. Build guide · Firmware example
ESP32-S3 ESP32-S3 board Planned; not yet validated. Not available yet.

License

Distributed under the MIT License.

Built to make edge inference internals small enough to understand.

About

🦥 A from-scratch learning implementation of an ONNX-style model format and inference runtime for mobile, edge, and on-device AI.

Topics

Resources

Stars

3 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages