Iterative Human and Automated Identification of Wildlife Images

@article{Miao2021IterativeHA,
  title={Iterative Human and Automated Identification of Wildlife Images},
  author={Zhongqi Miao and Ziwei Liu and Kaitlyn M. Gaynor and Meredith S. Palmer and Stella X. Yu and Wayne M. Getz},
  journal={Nat. Mach. Intell.},
  year={2021},
  volume={3},
  pages={885-895}
}
1Department of Environmental Science, Policy, and Management, University of California, Berkeley, Berkeley, CA, USA. 2International Computer Science Institute, University of California, Berkeley, Berkeley, CA, USA. 3School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore. 4National Center for Ecological Analysis and Synthesis, University of California, Santa Barbara, Santa Barbara, CA, USA. 5Department of Ecology and Evolutionary Biology, Princeton… 
View PDF on arXiv
9 Citations
Background Citations
4

9 Citations

A Convolutional Neural Network to Classify Phytoplankton Images Along the West Antarctic Peninsula

Abstract High-resolution optical imaging systems are quickly becoming universal tools to characterize and quantify microbial diversity in marine ecosystems. Automated classification systems such as…

Image Classification of Amazon Parrots by Deep Learning: A Potentially Useful Tool for Wildlife Conservation

Simple Summary Most parrot species are threatened with extinction because of habitat loss and commercial trade. Parrot conservation is vital because parrots play an important role in the ecosystem.…

Open Long-Tailed Recognition in a Dynamic World

The algorithm, OLTR++, maps images to a feature space such that visual concepts can relate to each other through a memory association mechanism and a learned metric that both respects the closed world classification of seen classes and acknowledges the novelty of open classes.

Class incremental learning for wildlife biodiversity monitoring in camera trap images

Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding

This work creates a large and diverse dataset, Animal Kingdom, that provides multiple annotated tasks to enable a more thorough understanding of natural animal behaviors, and proposes a Collaborative Action Recognition model that learns general and specific features for action recognition with unseen new animals.

BOVIDS: A deep learning‐based software package for pose estimation to evaluate nightly behavior and its application to common elands (Tragelaphus oryx) in zoos

Abstract Only a few studies on the nocturnal behavior of African ungulates exist so far, with mostly small sample sizes. For a comprehensive understanding of nocturnal behavior, the data basis needs…

Unsupervised Selective Labeling for More Effective Semi-supervised Learning

This work sets a new standard for practical and efficient SSL by selecting cluster prototypes, either in a pretrained feature space, or along with feature optimization, both without labels, which consistently improves SSL methods over state-of-the-art active learning given labeled data.

Deep Long-Tailed Learning: A Survey

A comprehensive survey on recent advances in deep long-tailed learning is provided, highlighting important applications of deepLongtailed learning and identifying several promising directions for future research.

Deep learning as a tool for ecology and evolution

This review synthesizes 818 studies using deep learning in the context of ecology and evolution to give a discipline‐wide perspective necessary to promote a rethinking of inference approaches in the field and provides an introduction to machine learning and contrast it with mechanistic inference, followed by a gentle primer on deep learning.

References

SHOWING 1-10 OF 60 REFERENCES

ImageNet: A large-scale hierarchical image database

A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.

Snapshot Safari: a large-scale collaborative to monitor Africa’s remarkable biodiversity

Volume 117| Number 1/2 January/February 2021 Commentary https://doi.org/10.17159/sajs.2021/8134 Snapshot Safari: A large-scale collaborative to monitor Africa’s remarkable biodiversity AUTHORS: Lain…

Robust ecological analysis of camera trap data labelled by a machine learning model

It is concluded that, with adequate testing and evaluation in an ecological context, a machine learning model can generate labels for direct use in ecological analyses without the need for manual validation.

Postwar wildlife recovery in an African savanna: evaluating patterns and drivers of species occupancy and richness

As local and global disturbances reshape African savannas, an understanding of how animal communities recover and respond to landscape features can inform conservation and restoration. Here, we…

Energy-based Out-of-distribution Detection

This work proposes a unified framework for OOD detection that uses an energy score, and shows that energy scores better distinguish in- and out-of-distribution samples than the traditional approach using the softmax scores.

What Should Not Be Contrastive in Contrastive Learning

This work introduces a contrastive learning framework which does not require prior knowledge of specific, task-dependent invariances, and learns to capture varying and invariant factors for visual representations by constructing separate embedding spaces, each of which is invariant to all but one augmentation.

Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2

By including many species from several locations, the species model is potentially applicable to many camera trap studies in North America and the empty-animal model can facilitate removal of images without animals globally.

"How many images do I need?" Understanding how sample size per class affects deep learning model performance metrics for balanced designs in autonomous wildlife monitoring

Three critical factors affecting automated image species recognition performance for camera traps

The capabilities of deep learning systems trained on camera trap images using modestly sized training data are tested, performance when considering unseen background locations is compared, and the gradient of lower bound performance is quantified to provide a guideline of data requirements in correspondence to performance expectations.

A Simple Framework for Contrastive Learning of Visual Representations

It is shown that composition of data augmentations plays a critical role in defining effective predictive tasks, and introducing a learnable nonlinear transformation between the representation and the contrastive loss substantially improves the quality of the learned representations, and contrastive learning benefits from larger batch sizes and more training steps compared to supervised learning.
...