v1.16.0

Lots of feature additions (thanks @joelburget for Llama support, and @sheikheddy for Llama-2-70b-chat-hf support!), and also a very helpful bugfix from @wesg52. Thanks to all contributors, especially new contributors!

What's Changed

• Add support for Llama-2-70b-chat-hf by @sheikheddy in #525
• Update loading_from_pretrained.py by @jbloomAus in #529
• Bugfix: pytest import by @tkukurin in #532
• Remove non-existing parameter from decompose_resid() documentation by @VasilGeorgiev39 in #504
• Add @overload to FactoredMatrix.__{,r}matmul__ by @JasonGross in #512
• Improve documentation for abstract attribute by @Felhof in #508
• Add pos_slice to run_with_cache by @VasilGeorgiev39 in #465
• Add Support for Yi-6B and Yi-34B by @collingray in #494
• updated docs to account for additional test suites by @bryce13950 in #533
• Bugfix: remove redundant assert checks by @tkukurin in #534
• Speed up !pip install transformer-lens in colab by @pavanyellow in #510
• Add Xavier and Kaiming Initializations by @Chanlaw in #537
• chore: fixing type errors and enabling mypy by @chanind in #516
• Add Mixtral by @collingray in #521
• Standardize black line length to 100, in line with other project settings by @Chanlaw in #538
• Refactor hook_points by @VasilGeorgiev39 in #505
• Fix split_qkv_input for grouped query attention by @wesg52 in #520
• locked attribution patching to 1.1.1 by @bryce13950 in #541
• Demo no position fix by @bryce13950 in #544
• Othello colab fix by @bryce13950 in #545
• Fixed Santa Coder demo by @bryce13950 in #546
• Hf token auth by @bryce13950 in #550
• Fixed device being set to cpu:0 instead of cpu by @Butanium in #551
• Add support for Llama 3 (and Llama-2-70b-hf) by @joelburget in #549
• Loading of huggingface 4-bit quantized Llama by @coolvision in #486
• removed deuplicate rearrange block by @bryce13950 in #555
• Bert demo ci by @bryce13950 in #556

New Contributors

• @sheikheddy made their first contribution in #525
• @tkukurin made their first contribution in #532
• @VasilGeorgiev39 made their first contribution in #504
• @JasonGross made their first contribution in #512
• @pavanyellow made their first contribution in #510
• @Chanlaw made their first contribution in #537
• @chanind made their first contribution in #516
• @wesg52 made their first contribution in #520
• @Butanium made their first contribution in #551
• @coolvision made their first contribution in #486

Full Changelog: v1.15.0...v1.16.0