Skip to content
yapf

Update default max_num_batch_tokens for chunked prefill to 2048 (#10544) #28861

Sign in to view logs

Update default max_num_batch_tokens for chunked prefill to 2048 (#10544)

Update default max_num_batch_tokens for chunked prefill to 2048 (#10544) #28861

Triggered via push November 23, 2024 05:14
@youkaichaoyoukaichao
pushed 02a43f8
main
Status Success
Total duration 1m 46s
Artifacts –

yapf.yml

on: push
Matrix: yapf
Fit to window
Zoom out
Zoom in