Slow read from attached volume - Is there a way to speed this up? #25359
m-schenker
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi there dear developers and community,
I struggle with a problem in regards to volumes. I am trying to run Ollama and other LLM related tasks in podman containers. I have a mdadm raid-0 based array, formatted with XFS, that my computer can access with up to 12GB/s sequentially with a single process or up to 24GB/s sequentially with two or more processes to load large files from. Unfortunately it seems Ollama and other containers struggle to load files from this array when used as a volume and seem limited to loading files with 1-2GB/s at the maximum.
Is there any way, any trick, to speed this up or is running these workloads in podman simply the wrong solution?
Thank you.
Beta Was this translation helpful? Give feedback.
All reactions