[V1][Frontend] Coalesce bunched `RequestOutput`s#12298

Open

njhill wants to merge 1 commit intovllm-project:mainfrom njhill:coalesce-stream

+33-8

Commits on Jan 22, 2025

[V1][Frontend] Coalesce bunched RequestOutputs

njhill
and
robertgshaw2-redhat
committed