Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Ollama Registry #21637

Open
kong62 opened this issue Feb 14, 2025 · 5 comments
Open

Support Ollama Registry #21637

kong62 opened this issue Feb 14, 2025 · 5 comments
Labels
kind/requirement New feature or idea on top of harbor more-info-needed The issue author need to provide more details and context to the issue

Comments

@kong62
Copy link

kong62 commented Feb 14, 2025

Can you support ollama models?

@stonezdj
Copy link
Contributor

stonezdj commented Feb 14, 2025

You can refer https://github.com/stonezdj/harbor/releases/tag/v2.11.0-ollama, left your comment if any feature need to add

@wy65701436
Copy link
Contributor

Can you break down your requirement in details? If the ollama models are OCI compatible, then Harbor can support that.

@wy65701436 wy65701436 added the kind/requirement New feature or idea on top of harbor label Feb 17, 2025
@reasonerjt reasonerjt added the more-info-needed The issue author need to provide more details and context to the issue label Feb 17, 2025
@kong62
Copy link
Author

kong62 commented Feb 18, 2025

Can you break down your requirement in details? If the ollama models are OCI compatible, then Harbor can support that.

when we deploy ollama models:
`
ollama pull mistral:7b
...

ollama list
NAME ID SIZE MODIFIED
mistral:7b f974a74358d6 4.1 GB 4 days ago
qwen2.5:32b 9f13ba1299af 19 GB 8 days ago
deepseek-r1:32b 38056bbcbb2d 19 GB 8 days ago
qwen2.5:14b 7cdf5a0187d5 9.0 GB 9 days ago
deepseek-r1:14b ea35dfe18182 9.0 GB 11 days ago
deepseek-r1:70b 0c1615a8ca32 42 GB 11 days ago
deepseek-r1:7b 0a8c26691023 4.7 GB 11 days ago
deepseek-r1:8b 28f8fd6cdc67 4.9 GB 11 days ago
llama3.1:8b 46e0c10c039e 4.9 GB 2 months ago
qwen2.5:7b 845dbda0ea48 4.7 GB 2 months ago
llama3.3:latest a6eb4748fd29 42 GB 2 months ago
`

These models are downloaded from the Internet, which is very slow. And we have many nodes that need to pull these models. So, we want to pull the model through a node, and then push it to the harbor, so that other nodes can point to harbor to pull. This is similar to using docker to pull images.

@bupd
Copy link
Contributor

bupd commented Feb 19, 2025

you can use ramalama to push the models to Harbor.

Currently using ollama push to push model to Harbor returns this error:

❯ ollama push demo.goharbor.io/harborbupd/olulama:latest
retrieving manifest 
Error: Get "harbor?nonce=bZ3Q5RVQd3azeO5mSPqEfA&scope=&service=&ts=1739954090": unsupported protocol scheme ""

But pushing this using ramalama seems to work fine.

@bupd
Copy link
Contributor

bupd commented Feb 19, 2025

Eventhough If we support Ollama in Harbor. Ollama doesn't currently support pull from Private Registry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/requirement New feature or idea on top of harbor more-info-needed The issue author need to provide more details and context to the issue
Projects
None yet
Development

No branches or pull requests

5 participants