Skip to content

Commit

Permalink
doc string for use_memory_pool
Browse files Browse the repository at this point in the history
Signed-off-by: youkaichao <[email protected]>
  • Loading branch information
youkaichao committed Jan 22, 2025
1 parent d1991e5 commit daf3169
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion vllm/device_allocator/cumem.py
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,12 @@ def use_memory_pool(self, tag: Optional[str] = None):
"""
A context manager to use the memory pool.
All memory allocation created inside the context will be allocated
in the memory pool, and has the specified tag."""
in the memory pool, and has the specified tag.
Args:
tag: The tag of the memory allocation. If None, the default tag
will be used.
"""
if tag is None:
tag = CuMemAllocator.default_tag
else:
Expand Down

0 comments on commit daf3169

Please sign in to comment.