Skip to content
mypy

Update default max_num_batch_tokens for chunked prefill to 2048 (#10544) #22468

Sign in to view logs

Update default max_num_batch_tokens for chunked prefill to 2048 (#10544)

Update default max_num_batch_tokens for chunked prefill to 2048 (#10544) #22468

Run time

Learn about OS pricing on GitHub Actions
Job Run time
mypy (3.9)
29s
mypy (3.10)
28s
mypy (3.11)
28s
mypy (3.12)
34s
1m 59s