Attention Scores vs Attention Weights in Self-Attention-The Difference Nobody Explains Clearly

Estimated read time 1 min read

When I first started learning Self-Attention in LLMs, I thought Attention Scores and Attention Weights were exactly the same thing. Both…

 

​ When I first started learning Self-Attention in LLMs, I thought Attention Scores and Attention Weights were exactly the same thing. Both…Continue reading on Medium »   Read More LLM on Medium 

#AI

You May Also Like

More From Author