Inter-Research > MEPS > v615 > p15-30  

MEPS 615:15-30 (2019)  -  DOI: https://doi.org/10.3354/meps12925

Automated identification of benthic epifauna with computer vision

Nils Piechaud1,*, Christopher Hunt2, Phil F. Culverhouse3, Nicola L. Foster1, Kerry L. Howell1

1School of Biological and Marine Sciences, University of Plymouth, Plymouth PL4 8AA, UK
2Controlled Frenzy Ltd., THINQTANQ, Fairbairn House, Higher Lane, Plymouth PL1 2AN, UK
3School of Computing, Electronics and Mathematics, University of Plymouth, Plymouth PL4 8AA, UK
*Corresponding author:

ABSTRACT: Benthic ecosystems are chronically undersampled, particularly in environments >50 m depth. Yet a rising level of anthropogenic threats makes data collection ever more urgent. Currently, modern underwater sampling tools, particularly autonomous underwater vehicles (AUVs), are able to collect vast image data, but cannot bypass the bottleneck formed by manual image annotation. Computer vision (CV) offers a faster, more consistent, cost effective and sharable alternative to manual annotation. We used TensorFlow to evaluate the performance of the Inception V3 model with different numbers of training images, as well as assessing how many different classes (taxa) it could distinguish. Classifiers (models) were trained with increasing amounts of data (20 to 1000 images of each taxa) and increasing numbers of taxa (7 to 52). Maximum performance (0.78 sensitivity, 0.75 precision) was achieved using the maximum number of training images but little was gained in performance beyond 200 training images. Performance was also highest with the least classes in training. None of the classifiers had average performances high enough to be a suitable alternative to manual annotation. However, some classifiers performed well for individual taxa (0.95 sensitivity, 0.94 precision). Our results suggest this technology is currently best applied to specific taxa that can be reliably identified and where 200 training images offers a good compromise between performance and annotation effort. This demonstrates that CV could be routinely employed as a tool to study benthic ecology by non-specialists, which could lead to a major increase in data availability for conservation research and biodiversity management.


KEY WORDS: Benthic ecology · Computer vision · Automated image analysis · Automated species identification


Full text in pdf format
Supplementary material 
Cite this article as: Piechaud N, Hunt C, Culverhouse PF, Foster NL, Howell KL (2019) Automated identification of benthic epifauna with computer vision. Mar Ecol Prog Ser 615:15-30. https://doi.org/10.3354/meps12925

Export citation
Mail this link - Contents Mailing Lists - RSS
- -