campinator/gridllm-server

•Updated 11 months ago

GridLLM scales LLM inference with a central server, load balancing, and Ollama API support

Buildkit cache

Image

Message queues

Machine learning & AI

411

Tags for campinator/gridllm-server

Sort by

TAG

latest

Last pushed 11 months by campinator

docker pull campinator/gridllm-server:latest

Digest	OS/ARCH	Compressed size
5689ad39026c	linux/amd64	69.02 MB
2cbdca4c4702	linux/arm64	68.71 MB

TAG

nightly

Last pushed 11 months by campinator

docker pull campinator/gridllm-server:nightly

Digest	OS/ARCH	Compressed size
890414e66125	linux/amd64	69.02 MB
3d45ab80f85b	linux/arm64	68.71 MB

TAG

buildcache

Last pushed 11 months by campinator

docker pull campinator/gridllm-server:buildcache

Digest

Type

Buildkit cache