Skip to content

WIP: [GPU] Use FP32 accumulator for QK multiplication for 2nd+ token calculation in PagedAttention #18501

WIP: [GPU] Use FP32 accumulator for QK multiplication for 2nd+ token calculation in PagedAttention

WIP: [GPU] Use FP32 accumulator for QK multiplication for 2nd+ token calculation in PagedAttention #18501

Annotations

1 warning

JAX Layer Tests  /  JAX Layer Tests

succeeded Jan 24, 2025 in 1m 52s