Characterizing interference weights in a tiny language model
transformer-circuits.pub · saved by 1 readers
We identify interference weights in a 1-layer transformer by measuring their effect on model outputs and loss.
We identify interference weights in a 1-layer transformer by measuring their effect on model outputs and loss.