This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

Sentiment AnalysisOpen Source

About

Multimodal-Infomax (MMIM) focuses on synthesizing fusion results from multi-modal inputs through a two-level mutual information maximization approach. It employs techniques such as the Barber-Agakov lower bound and contrastive predictive coding to enhance the training process. This software is designed for researchers and practitioners in the field of multimodal deep learning, particularly those interested in sentiment analysis.

Open Source Health

Not enough history
Stars
203
Forks
36
License
MIT
Last commit
4 years ago
Python

Related Categories

Using Multimodal-Infomax?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Deep Cognition and Language Research (DeCLaRe) Lab

Open-source projects on GitHub: Conv Emotion, Tango and MELD

View vendor profile

More by Deep Cognition and Language Research (DeCLaRe) Lab