[C5] Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Models
Chani Jung, Dongkwan Kim, Jiho Jin, Jiseon Kim, Yeon Seonwoo, Yejin Choi, Alice Oh, and Hyunwoo Kim. Empirical Methods in Natural Language Processing (EMNLP), 2024
One-sentence Summary: We assess key precursors of Theory of Mind (ToM) in LLMs by perception-augmented ToM benchmarks. We propose PercepToM, a ToM method inspired by our findings of models’ strength in perception inference and weakness in perception-to-belief inference.