reorder
order information
Four tokens with two numbers each. The input row is the token's content plus its position vector, X = E + PE, where PE(p) = (sin p, cos p) is the chapter's sinusoidal formula at width 2; position vectors belong to places, so they stay put when the tokens move. The projections WQ, WK, WV are shared by every token.