Automatic creation of storm impact database based on video monitoring and convolutional neural networks

Aurelien Callens*, Denis Morichon, Pedro Liria, Irati Epelde, Benoit Liquet

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review


Data about storm impacts are essential for the disaster risk reduction process, but unlike data about storm characteristics, they are not routinely collected. In this paper, we demonstrate the high potential of convolutional neural networks to automatically constitute storm impact database using timestacks images provided by coastal video monitoring stations. Several convolutional neural network architectures and methods to deal with class imbalance were tested on two sites (Biarritz and Zarautz) to find the best practices for this classification task. This study shows that convolutional neural networks are well adapted for the classification of timestacks images into storm impact regimes. Overall, the most complex and deepest architectures yield better results. Indeed, the best performances are obtained with the VGG16 architecture for both sites with F-scores of 0.866 for Biarritz and 0.858 for Zarautz. For the class imbalance problem, the method of oversampling shows best classification accuracy with F-scores on average 30% higher than the ones obtained with cost sensitive learning. The transferability of the learning method between sites is also investigated and shows conclusive results. This study highlights the high potential of convolutional neural networks to enhance the value of coastal video monitoring data that are routinely recorded on many coastal sites. Furthermore, it shows that this type of deep neural network can significantly contribute to the setting up of risk databases necessary for the determination of storm risk indicators and, more broadly, for the optimization of risk-mitigation measures.

Original languageEnglish
Article number1933
Pages (from-to)1-20
Number of pages20
JournalRemote Sensing
Issue number10
Publication statusPublished - 2 May 2021

Bibliographical note

Copyright the Author(s) 2021. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.


  • convolutional neural networks
  • storm impact database
  • transfer learning
  • video monitoring


Dive into the research topics of 'Automatic creation of storm impact database based on video monitoring and convolutional neural networks'. Together they form a unique fingerprint.

Cite this