MyFood: A Food Segmentation and Classification System to Aid Nutritional Monitoring

  title={MyFood: A Food Segmentation and Classification System to Aid Nutritional Monitoring},
  author={Charles N. C. Freitas and Filipe R. Cordeiro and Valmir Macario},
  journal={2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)},
The absence of food monitoring has contributed significantly to the increase in the population’s weight. Due to the lack of time and busy routines, most people do not control and record what is consumed in their diet. Some solutions have been proposed in computer vision to recognize food images, but few are specialized in nutritional monitoring. This work presents the development of an intelligent system that classifies and segments food presented in images to help the automatic monitoring of… 

Figures and Tables from this paper

The Food Recognition Benchmark: Using Deep Learning to Recognize Food in Images

This work reports on the setup of a public benchmark using publicly available food images sourced through the mobile MyFoodRepo app to develop open and reproducible algorithms, and presents experimental validation of round 4 results.

Food recognition improvement by using hyper-spectral imagery

The prediction results indicate that the hyperspectral images have the advantages of being able to recognize different food items from a mixed form with similar color and similar food types with different colors.

Mobile Computer Vision-Based Applications for Food Recognition and Volume and Calorific Estimation: A Systematic Review

To improve trust, mobile computer vision-based applications in healthcare should provide explanations of how they derive their classifications or volume and calorific estimations.

Food Detection and Segmentation from Egocentric Camera Images

This work presents a novel food detection and segmentation pipeline to detect the presence of food in images acquired from an egocentric wearable camera, and subsequently segment the food image.

Development of Korean Food Image Classification Model Using Public Food Image Dataset and Deep Learning Methods

Food image classification is useful in diet management apps for personal health management. Various methods for classifying food images in a particular country have been proposed in multiple studies.

Biased Bytes: On the Validity of Estimating Food Consumption from Digital Traces

Given that measuring food consumption at a population scale is a challenging task, researchers have begun to explore digital traces (e.g., from social media or from food-tracking applications) as

Table of Contents

Table of contents



DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment

A new Convolutional Neural Network CNN-based food image recognition algorithm is proposed to improve the accuracy of dietary assessment by analyzing the food images captured by mobile devices e.g., smartphone.

Food Detection and Recognition Using Convolutional Neural Network

This paper constructed a dataset of the most frequent food items in a publicly available food-logging system, and used it to evaluate recognition performance, and found that the convolution kernels show that color dominates the feature extraction process.

Food-101 - Mining Discriminative Components with Random Forests

A novel method to mine discriminative parts using Random Forests (rf), which allows us to mine for parts simultaneously for all classes and to share knowledge among them, and compares nicely to other s-o-a component-based classification methods.

FoodNet: Recognizing Foods Using Ensemble of Deep Networks

Experimental results on the largest real-world food recognition database ETH Food-101 and newly contributed Indian food image database demonstrate the effectiveness of the proposed methodology as compared to many other benchmark deep learned CNN frameworks.

FoodTracker: A Real-time Food Detection Mobile Application by Deep Convolutional Neural Networks

A deep convolutional neural network merging with YOLO is built to achieve simultaneous multi-object recognition and localization with nearly 80% mean average precision and is well-suited for mobile devices with negligible inference time and small memory requirements with a deep learning algorithm.

CNN-Based Food Image Segmentation Without Pixel-Wise Annotation

A CNN-based food image segmentation which requires no pixel-wise annotation is proposed and outperformed RCNN regarding food region detection as well as the PASCAL VOC detection task.

Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation

This paper proposes a simple and scalable detection algorithm that improves mean average precision (mAP) by more than 30% relative to the previous best result on VOC 2012 -- achieving a mAP of 53.3%.

ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation

A novel deep neural network architecture named ENet (efficient neural network), created specifically for tasks requiring low latency operation, which is up to 18 times faster, requires 75% less FLOPs, has 79% less parameters, and provides similar or better accuracy to existing models.

YOLO9000: Better, Faster, Stronger

YOLO9000, a state-of-the-art, real-time object detection system that can detect over 9000 object categories, is introduced and a method to jointly train on object detection and classification is proposed, both novel and drawn from prior work.

SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation

Quantitative assessments show that SegNet provides good performance with competitive inference time and most efficient inference memory-wise as compared to other architectures, including FCN and DeconvNet.