A deep active learning system for species identification and counting in camera trap images

Type: Article

Publication Date: 2020-10-14

Citations: 149

DOI: https://doi.org/10.1111/2041-210x.13504

Abstract

Abstract A typical camera trap survey may produce millions of images that require slow, expensive manual review. Consequently, critical conservation questions may be answered too slowly to support decision‐making. Recent studies demonstrated the potential for computer vision to dramatically increase efficiency in image‐based biodiversity surveys; however, the literature has focused on projects with a large set of labelled training images, and hence many projects with a smaller set of labelled images cannot benefit from existing machine learning techniques. Furthermore, even sizable projects have struggled to adopt computer vision methods because classification models overfit to specific image backgrounds (i.e. camera locations). In this paper, we combine the power of machine intelligence and human intelligence via a novel active learning system to minimize the manual work required to train a computer vision model. Furthermore, we utilize object detection models and transfer learning to prevent overfitting to camera locations. To our knowledge, this is the first work to apply an active learning approach to camera trap images. Our proposed scheme can match state‐of‐the‐art accuracy on a 3.2 million image dataset with as few as 14,100 manual labels, which means decreasing manual labelling effort by over 99.5%. Our trained models are also less dependent on background pixels, since they operate only on cropped regions around animals. The proposed active deep learning scheme can significantly reduce the manual labour required to extract information from camera trap images. Automation of information extraction will not only benefit existing camera trap projects, but can also catalyse the deployment of larger camera trap arrays.

Locations

  • Methods in Ecology and Evolution - View
  • arXiv (Cornell University) - View - PDF
  • CaltechAUTHORS (California Institute of Technology) - View - PDF

Similar Works

Action Title Year Authors
+ A deep active learning system for species identification and counting in camera trap images 2019 Mohammad Sadegh Norouzzadeh
Dan Morris
Sara Beery
Neel Joshi
Nebojša Jojić
Jeff Clune
+ A deep active learning system for species identification and counting in camera trap images 2019 Mohammad Sadegh Norouzzadeh
Dan Morris
Sara Beery
Neel Joshi
Nebojša Jojić
Jeff Clune
+ Automated wildlife image classification: An active learning tool for ecological applications 2023 Ludwig Bothmann
Lisa Wimmer
Omid Charrakh
Tobias Weber
Hendrik Edelhoff
Wibke Peters
Hien Nguyen
Caryl Benjamin
Annette Menzel
+ Choosing an Appropriate Platform and Workflow for Processing Camera Trap Data using Artificial Intelligence 2022 Juliana Vélez
Paula J. Castiblanco-Camacho
Michael A. Tabak
Carl Chalmers
Paul Fergus
John Fieberg
+ Deep Learning Object Detection Methods for Ecological Camera Trap Data 2018 Stefan Schneider
Graham W. Taylor
Stefan C. Kremer
+ Deep Learning Object Detection Methods for Ecological Camera Trap Data 2018 Stefan Schneider
Graham W. Taylor
Stefan C. Kremer
+ PDF Chat Deep Learning Object Detection Methods for Ecological Camera Trap Data 2018 Stefan Schneider
Graham W. Taylor
Stefan C. Kremer
+ Automatically identifying wild animals in camera trap images with deep learning. 2017 Mohammad Sadegh Norouzzadeh
Anh‐Tu Nguyen
Margaret Kosmala
Ali Swanson
Craig Packer
Jeff Clune
+ PDF Chat An active learning model to classify animal species in Hong Kong 2024 Gareth Lamb
Ching Hei Lo
Jin Wu
Calvin K. F. Lee
+ Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning 2017 Mohammed Sadegh Norouzzadeh
A. D. Nguyen
Margaret Kosmala
Ali Swanson
Meredith S. Palmer
Craig Packer
Jeff Clune
+ Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning 2017 Mohammed Sadegh Norouzzadeh
Anh‐Tu Nguyen
Margaret Kosmala
Ali Swanson
Meredith S. Palmer
Craig Packer
Jeff Clune
+ PDF Chat Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning 2018 Mohammad Sadegh Norouzzadeh
Anh‐Tu Nguyen
Margaret Kosmala
Alexandra Swanson
Meredith S. Palmer
Craig Packer
Jeff Clune
+ PDF Chat Decision letter for "Sashimi : A toolkit for facilitating high‐throughput organismal image segmentation using deep learning" 2021 Stefan Schneider
Graham W. Taylor
Stefan C. Kremer
+ PDF Chat Decision letter for "Sashimi : A toolkit for facilitating high‐throughput organismal image segmentation using deep learning" 2021 Stefan Schneider
Graham W. Taylor
Stefan C. Kremer
+ PDF Chat Past, present and future approaches using computer vision for animal re‐identification from camera trap data 2018 Stefan Schneider
Graham W. Taylor
Stefan Linquist
Stefan C. Kremer
+ PDF Chat Towards automatic wild animal monitoring: Identification of animal species in camera-trap images using very deep convolutional neural networks 2017 Alexander Gómez-Villa
Augusto Salazar
J. F. Vargas‐Bonilla
+ PDF Chat Removing Human Bottlenecks in Bird Classification Using Camera Trap Images and Deep Learning 2023 Carl Chalmers
Paul Fergus
Serge A. Wich
S. N. Longmore
Naomi Davies Walsh
Philip A. Stephens
Chris Sutherland
Naomi Matthews
Jens Mudde
Amira Nuseibeh
+ Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Data 2018 Stefan Schneider
Graham W. Taylor
Stefan Linquist
Stefan C. Kremer
+ Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Data 2018 Stefan Schneider
Graham W. Taylor
Stefan Linquist
Stefan C. Kremer
+ Mastering Large Scale Multi-label Image Recognition with high efficiency overCamera trap images 2020 Miroslav Valan
Lukáš Picek

Works That Cite This (22)

Action Title Year Authors
+ PDF Chat Bag of tricks for long-tail visual recognition of animal species in camera-trap images 2023 Fagner Cunha
Eulanda M. dos Santos
Juan G. Colonna
+ PDF Chat Automated wildlife image classification: An active learning tool for ecological applications 2023 Ludwig Bothmann
Lisa Wimmer
Omid Charrakh
Tobias Weber
Hendrik Edelhoff
Wibke Peters
Hien Nguyen
Caryl Benjamin
Annette Menzel
+ ElephantBook: A Semi-Automated Human-in-the-Loop System for Elephant Re-Identification 2021 Peter Kulits
Jake Wall
Anka Bedetti
Michelle Henley
Sara Beery
+ PDF Chat Trade-off between deep learning for species identification and inference about predator-prey co-occurrence: Reproducible R workflow integrating models in computer vision and ecological statistics 2022 Olivier Giménez
Maëlis Kervellec
Jean-Baptiste Fanjul
Anna Chaine
Lucile Marescot
Yoann Bollet
Christophe Duchamp
+ Designing Ocean Vision AI: An Investigation of Community Needs for Imaging-based Ocean Conservation 2023 Alison Crosby
Eric C. Orenstein
Susan E. Poulton
Katherine L.C. Bell
Benjamin Woodward
Henry A. Ruhl
Kakani Katija
Angus G. Forbes
+ PDF Chat Application of deep learning to camera trap data for ecologists in planning / engineering – Can captivity imagery train a model which generalises to the wild? 2021 Ryan Curry
Cameron Trotter
A. Stephen McGough
+ PDF Chat High-dimensional black-box optimization under uncertainty 2021 Hadis Anahideh
Jay M. Rosenberger
Victoria Chen
+ Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients 2023 Victoria Huang
Shaleeza Sohail
Michael Mayo
Tania Lorido Botrán
Mark Rodrigues
Chris Anderson
Melanie Po‐Leen Ooi
+ PDF Chat Empowering Wildlife Guardians: An Equitable Digital Stewardship and Reward System for Biodiversity Conservation Using Deep Learning and 3/4G Camera Traps 2023 Paul Fergus
Carl Chalmers
S. N. Longmore
Serge A. Wich
Carmen Warmenhove
Jonathan Swart
Thuto Ngongwane
André Burger
Jonathan Ledgard
Erik Meijaard
+ PDF Chat Machine learning and deep learning—A review for ecologists 2023 M Pichler
Florian Härtig