Skip to content
Back to pull request #769

For bs=1 set kv_cache_type to paged. #971

Sign in to view logs

For bs=1 set kv_cache_type to paged.

For bs=1 set kv_cache_type to paged. #971

Run time

Learn about OS pricing on GitHub Actions
Job Run time
IREE Perplexity (3.11, llama-mi300x-3)
41s
41s