irfanuruchi/llm-box

•Updated about 1 year ago

Docker: 4-bit Phi-3-mini LLM on CPU, safe-math & hidden CoT, <0.5 s p95

Image

Integration & delivery

Machine learning & AI

Web servers

10K+

Tags for irfanuruchi/llm-box

Sort by

TAG

latest

Last pushed about 1 year by irfanuruchi

docker pull irfanuruchi/llm-box:latest

Digest	OS/ARCH	Compressed size
e5e3e70ee5b9	linux/amd64	2.07 GB
413f7f9ce760	linux/arm64	2.06 GB