Able to configure the shm size in Playground #238
Labels
needs-kind
Indicates a PR lacks a label and requires one.
needs-priority
Indicates a PR lacks a label and requires one.
needs-triage
Indicates an issue or PR lacks a label and requires one.
What would you like to be added:
When serving with ray for multi-host cases, you should be able to set the
/dev/shm
size to improve the performance, see the log here:Ray natively supports a distributed shared memory store for large objects (objects that are bigger than 100KB) to efficiently manage the memory usage of the cluster. When using Linux, Ray tries to use /dev/shm for the shared memory. But if this is too small, Ray automatically fallback to /tmp folder, which usually can cause worse performance than using the shared memory.
Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
The artifacts should be linked in subsequent comments.
The text was updated successfully, but these errors were encountered: