The IEEE 23rd International Workshop on Multimedia Signal Processing, organised by the IEEE Signal Processing Society, Centre for Immersive Visual Technologies and Tampere University, will be held from 6th-8th October in Tampere, Finland.

The congress will be the meeting point for professionals from academia and industry developing or are carrying out projects in the field of multimedia signal processing, aiming to share knowledge, exchange ideas and explore future research directions.

The IEEE MMSP 2021 is a hybrid event. This includes the face-to-face gathering at Scandic Hotel Rosendahl and online engagement through a virtual platform.

This event will include the presence of the University of Patras members of the CARAMEL consortium, who will be presenting the paper:

Deep multi-modal data analysis and fusion for robust scene understanding in CAVs

Deep learning (DL) tends to be the integral part of Autonomous Vehicles (AVs). Therefore the development of scene analysis modules that are robust to various vulnerabilities such as adversarial inputs or cyber-attacks is becoming an imperative need for the future AV perception systems. In this paper, we deal with this issue by exploring the recent progress in Artificial Intelligence (AI) and Machine Learning (ML) to provide holistic situational awareness and eliminate the effect of the previous attacks on the scene analysis modules. We propose novel multi-modal approaches against which achieve robustness to adversarial attacks, by appropriately modifying the analysis Neural networks and by utilizing late fusion methods. More specifically, we propose a holistic approach by adding new layers to a 2D segmentation DL odel enhancing its robustness to adversarial noise. Then, a novel late fusion technique has been applied, by extracting direct features from the 3D space and project them into the 2D segmented space for identifying inconsistencies. Extensive evaluation studies using the KITTI odometry dataset provide promising performance results under various types of noise.

7th October 2021

The IEEE 23rd International Workshop on Multimedia Signal Processing