Self-Attention Matrix
Key concept: Each token’s score row becomes normalized weights that mix the value vectors.
Choose a Reader or click Next reader. Inspect match, scale, normalize, and gather; drag a matrix cell to change a score.
What to look for: each weight row sums to one. Editing a score changes that reader’s row and output, while other rows stay independent.
Open the demo in a new tab for more room.