MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs. Spurious bias, a tendency to use spurious correlations between non-essential input attributes and target variables for predictions, has revealed a severe robustness pitfall in deep learning models trained on single modality data.