Multimodal fake news detection on social media: a survey of deep learning techniques

The escalation of false information related to the massive use of social media has become a challenging problem, and signifcant is the efort of the research community in providing efective solutions to detecting it. Fake news are spreading for decades, but with the rise of social media, the nature of misinformation has evolved from text-based modality to visual modalities, such as images, audio, and video. Therefore, the identifcation of media-rich fake news requires an approach that exploits and efectively combines the information acquired from diferent multimodal categories. Multimodality is a key approach to improving fake news detection, but efective solutions supporting it are still poorly explored. More specifcally, many diferent works exist that investigate if a text, an image, or a video is fake or not, but efective research on a real multimodal setting, ‘fusing’ the diferent modalities with their diferent structure and dimension is still an open problem. The paper is a focused survey concerning a very specifc topic which is the use of deep learning (DL) methods for multimodal fake news detection on social media. The survey provides, for each work surveyed, a description of some relevant features such as the DL method used, the type of analysed data, and the fusion strategy adopted. The paper also highlights the main limitations of the current state of the art and draws some future directions to address open questions and challenges, including explainability and efective cross-domain fake news detection strategies.