Positional Encoding Evolution
RESEARCH DIARY / POSITIONAL ENCODING
From token order to shared world time.
Follow THE DOG CHASED THE CAT as position expands from one sequence coordinate into relative distance, image geometry, video, and synchronized sound.
FOUNDATIONStart with the ambiguity
ABSOLUTE PEGive every token a slot
ROTARY PEPut distance inside attention
MULTIMODALExpand position into space and video
TIME ALIGNMENTSynchronize modalities
SUMMARYCompare the full evolution