If you wish to isolate your processes into multiple containers and
expose one or more GPUs to each container you need to ensure they are
using a shared IPC namespace.
In a Docker configuration you can mark one container as having a
shareable IPC namespace with the flag --ipc="shareable". Other
containers can then share that namespace with the flag
--ipc="container:<_name-or-ID_>" and passing the name or ID of the
container that is sharing it’s namespace.
You can also share the host IPC namespace with your container with the
flag --ipc="host", however this is not recommended on multi-tenant