← Back to all articles
arXiv cs.AIAugust 18, 2026

DiffImaginE: Imagine to Verify Entity Types with Diffusion

Excerpt

arXiv:2608.03025v4 Announce Type: replace Abstract: Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence. Existing imagine-and-compare verifiers map each (span, type) pair to one predicted visual feature, compressing diverse visual realisations into a single prototype and providing a compatibility score without explicit probabilistic semantics. We introduce DiffImaginE, which formulates MNER