Skip to content
Back to pull request #769

For bs=1 set kv_cache_type to paged. #971

Sign in to view logs

For bs=1 set kv_cache_type to paged.

For bs=1 set kv_cache_type to paged. #971

IREE Perplexity (3.11, llama-mi300x-3)

IREE Perplexity (3.11, llama-mi300x-3)
succeeded Jan 10, 2025 in 41s