Can data fusion increase the performance of action detection and recognition in the dark?

Research output: Book chapter/Published conference paperConference paperpeer-review

Abstract

Automated human action detection and recognition is a challenging research problem due to the complexity of its data. Contextual data provides additional cues about the actions like if we know car and man, we can short-list actions involving car and man, i.e., driving, opening the car door etc. Therefore, such data can play a pivotal role in modelling and recognizing human actions. However, the visual context during night is often badly disrupted due to clutter and adverse lighting conditions especially in outdoor environments. This situation requires the visual contextual data fusion of captured video sequences. In this paper, we have explored the significance of contextual data fusion for automated human action recognition in video sequences captured at night-time. For this purpose, we have proposed an action recognition framework based on contextual data fusion, spatio-temporal feature fusion and correlation filtering. We have performed experimentation on multi-sensor night vision video streams from infra-red (IR) and visible (VIS) sensors. Experimental results show that contextual data fusion based on the fused contextual information and its colourization significantly enhances the performance of automated action recognition.
Original languageEnglish
Title of host publicationStatistics for data science and policy analysis
EditorsAzizur Raman
PublisherSpringer Nature
Chapter12
Pages159-171
Number of pages13
Publication statusPublished - 2020
EventThe 2nd Applied Statistics and Policy Analysis Conference: ASPAC2019 - Charles Sturt University, Wagga Wagga, Australia
Duration: 05 Sep 201906 Sep 2019
http://csusap.csu.edu.au/~azrahman/ASPAC2019/
http://csusap.csu.edu.au/~azrahman/ASPAC2019/Program%20draft.pdf?attredirects=0&d=1 (program)
http://csusap.csu.edu.au/~azrahman/ASPAC2019/ASPAC2019_Refereed_Book%20of%20Abstracts.pdf?attredirects=0&d=1 (book of abstracts)
https://ebookcentral.proquest.com/lib/CSUAU/detail.action?docID=6152166 (proceedings)

Conference

ConferenceThe 2nd Applied Statistics and Policy Analysis Conference
Abbreviated titleEffective policy through the use of big data, accurate estimates and modern computing tools and statistical modelling
CountryAustralia
CityWagga Wagga
Period05/09/1906/09/19
OtherProceedings due for publication May 2020 https://www.springer.com/gp/book/9789811517341
Internet address

Fingerprint Dive into the research topics of 'Can data fusion increase the performance of action detection and recognition in the dark?'. Together they form a unique fingerprint.

Cite this