Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA#168
Merged
kdamaszk merged 14 commits intohabana_mainfrom libint/enable_fusedsdpaAug 19, 2024
+70-24
Commits
Commits on Aug 9, 2024
Commits on Aug 14, 2024
- committed
- authored
- authored
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Aug 15, 2024
- committed
Commits on Aug 16, 2024
- committed
Commits on Aug 19, 2024
- committed