Automatic social distance estimation for photographic studies: Performance evaluation, test benchmark, and algorithm

Mert Seker, Anssi Männistö, Alexandros Iosifidis, Jenni Raitoharju

Research output: Contribution to journalArticleScientificpeer-review

6 Downloads (Pure)

Abstract

The social distancing regulations introduced to slow down the spread of COVID-19 virus directly affect a basic form of non-verbal communication, and there may be longer term impacts on human behavior and culture that remain to be analyzed in proxemics studies. To obtain quantitative results for such studies, large media and/or personal photo collections must be analyzed. Several social distance monitoring methods have been proposed for safety purposes, but they are not directly applicable to general photo collections with large variations in the imaging setup. In such studies, the interest shifts from safety to analyzing subtle differences in social distances. Currently, there is no suitable benchmark for developing such algorithms. Collecting images with measured ground-truth pair-wise distances using different camera settings is cumbersome. Moreover, performance evaluation for these algorithms is not straightforward, and there is no widely accepted evaluation protocol. In this paper, we provide an image dataset with measured pair-wise social distances under different camera positions and settings. We suggest a performance evaluation protocol and provide a benchmark to easily evaluate such algorithms. We also propose an automatic social distance estimation method that can be applied on general photo collections. Our method is a hybrid method that combines deep learning-based object detection and human pose estimation with projective geometry. The method can be applied on uncalibrated single images with known focal length and sensor size. The results on our benchmark are encouraging with 91% human detection rate and only 38.24% average relative distance estimation error among the detected people.

Previous article in issue
Original languageEnglish
Article number100427
Pages (from-to)1-14
Number of pages14
JournalMachine Learning with Applications
Volume10
Issue numberDecember 2022
DOIs
Publication statusPublished - 15 Dec 2022
Publication typeA1 Journal article-refereed

Keywords

  • Person detection
  • Social distance estimation
  • Human pose estimation
  • Performance evaluation
  • Test benchmark
  • Proxemics
  • Photographs

Publication forum classification

  • Publication forum level 0

Fingerprint

Dive into the research topics of 'Automatic social distance estimation for photographic studies: Performance evaluation, test benchmark, and algorithm'. Together they form a unique fingerprint.

Cite this