Application of a Deep Learning Image Classifier for Identification of
Amazonian Fishes
Abstract
1. Given the sharp increase in agricultural and infrastructure
development and the paucity of widespread data available for making
conservation management decisions, a more rapid and accurate tool for
identifying fish fauna in the world’s largest freshwater ecosystem, the
Amazon, is needed. 2. Current strategies for identification of
freshwater fishes require high levels of training and taxonomic
expertise for morphological identification or genetic testing for
species recognition at a molecular level. 3. To overcome these
challenges, we built an image masking model (U-Net) and a convolutional
neural net (CNN) to classify Amazonian fish in photographs. Fish used as
training data were collected and photographed in tributaries in
seasonally flooded forests of the upper Morona River valley in Loreto,
Peru in 2018 and 2019. 4. Species identifications in the training images
(n = 3,068) were verified by expert ichthyologists. These images were
supplemented with photographs taken of additional Amazonian fish
specimens housed in the ichthyological collection of the Smithsonian’s
National Museum of Natural History. 5. We generated a CNN model that
identified 33 genera of fishes with a mean accuracy of 97.9%. Wider
availability of accurate freshwater fish image recognition tools, such
as the one described here, will enable fishermen, local communities and
community scientists to more effectively participate in collecting and
sharing data from their territories to inform policy and management
decisions that impact them directly.