Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KeyError in entropix.ipynb #56

Open
koolkao opened this issue Oct 9, 2024 · 2 comments
Open

KeyError in entropix.ipynb #56

koolkao opened this issue Oct 9, 2024 · 2 comments

Comments

@koolkao
Copy link

koolkao commented Oct 9, 2024

Appreciate the Colab notebook on Entropix, can't wait to try it out myself! When I run it in Colab, I'm getting this KeyError below.

[<ipython-input-6-d0ff32815be4>](https://localhost:8080/#) in load_weights(ckpt_dir, n_layers, debug)
     54         for i in range(n_layers):
     55             layer_weights.append(LayerWeights(
---> 56                 wq=w[f'layers.{i}.attention.wq.weight'],
     57                 wk=w[f'layers.{i}.attention.wk.weight'],
     58                 wv=w[f'layers.{i}.attention.wv.weight'],

KeyError: 'layers.0.attention.wq.weight'
@SinatrasC
Copy link

Make sure you removed comment # from model download call

#download_weights() -> download_weights()

@koolkao
Copy link
Author

koolkao commented Oct 10, 2024

thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants