Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
zinccat authored Oct 21, 2024
1 parent 9b4f16f commit 7745e72
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

Porting [FlexAttention](https://github.com/pytorch-labs/attention-gym) to pure JAX.

Example usage (For faster performance using Flash Attention, check examples/benchmark.py):
Example usage (**For faster performance using Flash Attention, check examples/benchmark.py**):

```python
import jax
Expand Down Expand Up @@ -69,4 +69,4 @@ Float16:
- FlexAttention: 0.11s
- FlaxAttention (This repo): 0.13s

We can see that the performance is about 20% slower than the original implementation. There are still some optimizations to be done.
We can see that the performance is about 20% slower than the original implementation. There are still some optimizations to be done.

0 comments on commit 7745e72

Please sign in to comment.