Skip to content

Commit

Permalink
Move a prometheus related log message to debug
Browse files Browse the repository at this point in the history
At startup, I noticed this message.

    INFO 12-06 19:45:45 api_server.py:252] vLLM to use
      /tmp/tmpllec8im4 as PROMETHEUS_MULTIPROC_DIR

This seems like an implementation detail of vLLM just doing the right
thing. It doesn't seem interesting or relevant, except when debugging
something very specific with prometheus integration.

Signed-off-by: Russell Bryant <[email protected]>
  • Loading branch information
russellb committed Dec 6, 2024
1 parent d7b4c28 commit 6d6f384
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions vllm/entrypoints/openai/api_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -249,8 +249,8 @@ def mount_metrics(app: FastAPI):

prometheus_multiproc_dir_path = os.getenv("PROMETHEUS_MULTIPROC_DIR", None)
if prometheus_multiproc_dir_path is not None:
logger.info("vLLM to use %s as PROMETHEUS_MULTIPROC_DIR",
prometheus_multiproc_dir_path)
logger.debug("vLLM to use %s as PROMETHEUS_MULTIPROC_DIR",
prometheus_multiproc_dir_path)
registry = CollectorRegistry()
multiprocess.MultiProcessCollector(registry)

Expand Down

0 comments on commit 6d6f384

Please sign in to comment.