Scoring two tokens
A score is the dot product of one query and one key. The softmax comes
next
.
What does a score measure?
How well a query matches a key.