Meta Ai Meta AI Introduces Multi-Token Attention (MTA): An Innovative Approach for LLMs to Adjust Attention Weights Based on Multiple Query and Key Vectors ByDeepMind April 2, 2025 12:42 pm