Late interaction

3 articles tagged “Late interaction”.

SMART: late interaction without retraining

A new paper out this week shows the per-token hidden states of off-the-shelf single-vector embedders already carry the information needed for ColBERT-style MaxSim - and you can wire it in at inference time, without retraining. The late-interaction deployment barrier I most underestimated just dropped.

A primer on late interaction

How ColBERT-style token-level matching fits between single-vector dense retrieval and cross-encoders, why MaxSim is the clever bit, and what the storage tax actually looks like in practice.