Breaking changes
- The from
from_model_and_pretrained
interface has been updated to take remove the slice option this has been moved to its own methodslice_sequence
method.
New features
-
Integration with transformer lens #103
- This is probably the biggest new feature. We now support directly producing a
PredictionTrajectory
from a lens and anActivationCache
. - This means that you can visualize the effects of interventions made using the fantastic
TransformerLens
library using the full set of tools that come with thetuned-lens
project. - There is a tutorial discussing this integration here
- This is probably the biggest new feature. We now support directly producing a
-
Rank visualization #105
- Like in the original logit lens blog post we now support easily visualizing the rank of the target token in the prediction distribution. See
Full Changelog: v0.1.1...v0.2.0