Attention as Lattice Gauge Theory: Relations Interact Only Through Wilson Loops
Models relation composition in attention as lattice gauge theory, where only closed loops are meaningful.
Explainer · on the wire
The explainer for this story is still on the wire.
The claim, the mechanism, and the figures land here once generated.
Source · arXiv