My Blog

January 12, 2025

Position Encodings in Attention: From Absolute to Rotary