Corpus ID: 235421921

MLPerf Tiny Benchmark

  title={MLPerf Tiny Benchmark},
  author={Colby R. Banbury and Vijay Janapa Reddi and Peter Torelli and Jeremy Holleman and Nat Jeffries and Csaba Kir{\'a}ly and Pietro Montino and David Kanter and Sebastian Ahmed and Danilo Pau and Urmish Thakker and Antonio Torrini and Pete Warden and Jay Cordaro and Giuseppe Di Guglielmo and Javier Mauricio Duarte and Stephen Gibellini and Videet Parekh and Honson Tran and Nhan Tran and Niu Wenxu and Xu Xuesong},
Advancements in ultra-low-power tiny machine learning (TinyML) systems promise to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted and easily reproducible benchmark for these systems. To meet this need, we present MLPerf Tiny, the first industry-standard benchmark suite for ultra-low-power tiny machine learning systems. The benchmark suite is the collaborative effort of more than 50 organizations from industry and… Expand

Figures and Tables from this paper

AIBench Scenario: Scenario-Distilling AI Benchmarking
  • Wanling Gao, Fei Tang, +7 authors Zihan Jiang
  • Computer Science
  • 2021 30th International Conference on Parallel Architectures and Compilation Techniques (PACT)
  • 2021
This paper formalizes a realworld application scenario as a Directed Acyclic Graph-based model and proposes the rules to distill it into a permutation of essential AI and non-AI tasks, which is called a scenario benchmark, and implements an extensible, configurable, and flexible benchmark framework. Expand
Green IoT and Edge AI as Key Technological Enablers for a Sustainable Digital Transition towards a Smart Circular Economy: An Industry 5.0 Use Case
Internet of Things (IoT) can help to pave the way to the circular economy and to a more sustainable world by enabling the digitalization of many operations and processes, such as water distribution,Expand


SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers
It is demonstrated that it is possible to automatically design CNNs which generalize well, while also being small enough to fit onto memory-limited MCUs, and the CNNs found are more accurate and up to $4.35 times smaller than previous approaches, while meeting the strict MCU working memory constraint. Expand
Visual Wake Words Dataset
A new dataset, Visual Wake Words, is presented that represents a common microcontroller vision use-case of identifying whether a person is present in the image or not, and provides a realistic benchmark for tiny vision models. Expand
ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection
This paper introduces a new dataset called "ToyADMOS" designed for anomaly detection in machine operating sounds ( ADMOS), which consists of three sub-datasets for machine-condition inspection, fault diagnosis of machines with geometrically fixed tasks, and fault diagnosisof machines with moving tasks. Expand
Hello Edge: Keyword Spotting on Microcontrollers
It is shown that it is possible to optimize these neural network architectures to fit within the memory and compute constraints of microcontrollers without sacrificing accuracy, and the depthwise separable convolutional neural network (DS-CNN) is explored and compared against other neural network architecture. Expand
MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection
A new dataset of industrial machine sounds that is called a sound dataset for malfunctioning industrial machine investigation and inspection (MIMII dataset) is presented to assist the machine-learning and signal-processing community with their development of automated facility maintenance. Expand
Deep Residual Learning for Image Recognition
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. Expand
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
This work introduces two simple global hyper-parameters that efficiently trade off between latency and accuracy and demonstrates the effectiveness of MobileNets across a wide range of applications and use cases including object detection, finegrain classification, face attributes and large scale geo-localization. Expand
Energy Consumption Model for Sensor Nodes Based on LoRa and LoRaWAN
This paper describes an energy consumption model based on LoRa and LoRaWAN, which allows estimating the consumed power of each sensor node element and can be used to compare different Lo RaWAN modes to find the best sensor node design to achieve its energy autonomy. Expand
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
For certain classes that are particularly prevalent in the dataset, such as people, this work is able to demonstrate a recognition performance comparable to class-specific Viola-Jones style detectors. Expand
Microsoft COCO: Common Objects in Context
We present a new dataset with the goal of advancing the state-of-the-art in object recognition by placing the question of object recognition in the context of the broader question of sceneExpand