faster-whisper
100K+
The LinuxServer.io team brings you another container release featuring:
Find us at:
Faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. This container provides a Wyoming protocol server for faster-whisper.
We utilise the docker manifest for multi-platform awareness. More information is available from docker here and our announcement here.
Simply pulling lscr.io/linuxserver/faster-whisper:latest should retrieve the correct image for your arch, but you can also pull specific arch images via tags.
The architectures supported by this image are:
| Architecture | Available | Tag |
|---|---|---|
| x86-64 | ✅ | amd64-<version tag> |
| arm64 | ✅ | arm64v8-<version tag> |
This image provides various versions that are available via tags. Please read the descriptions carefully and exercise caution when using unstable or development tags.
| Tag | Available | Description |
|---|---|---|
| latest | ✅ | Stable releases |
| gpu | ✅ | Releases with Nvidia GPU support (amd64 only) |
| gpu-legacy | ✅ | Legacy releases with Nvidia GPU support for pre-Turing cards (amd64 only) |
For use with Home Assistant Assist, add the Wyoming integration and supply the hostname/IP and port that Whisper is running add-on."
When using the gpu tag with Nvidia GPUs, make sure you set the container to use the nvidia runtime and that you have the Nvidia Container Toolkit installed on the host and that you run the container with the correct GPU(s) exposed. See the Nvidia Container Toolkit docs for more details.
For more information see the faster-whisper docs,
This image can be run with a read-only container filesystem. For details please read the docs.
To help you get started creating a container from this image you can either use docker-compose or the docker cli.
[!NOTE] Unless a parameter is flagged as 'optional', it is mandatory and a value must be provided.
---
services:
faster-whisper:
image: lscr.io/linuxserver/faster-whisper:latest
container_name: faster-whisper
environment:
- PUID=1000
- PGID=1000
- TZ=Etc/UTC
- DEBUG= #optional
- LOCAL_ONLY= #optional
- WHISPER_BEAM=1 #optional
- WHISPER_LANG=auto #optional
- WHISPER_MODEL=auto #optional
volumes:
- /path/to/faster-whisper/data:/config
ports:
- 10300:10300
restart: unless-stopped
docker run -d \
--name=faster-whisper \
-e PUID=1000 \
-e PGID=1000 \
-e TZ=Etc/UTC \
-e DEBUG= `#optional` \
-e LOCAL_ONLY= `#optional` \
-e WHISPER_BEAM=1 `#optional` \
-e WHISPER_LANG=auto `#optional` \
-e WHISPER_MODEL=auto `#optional` \
-p 10300:10300 \
-v /path/to/faster-whisper/data:/config \
--restart unless-stopped \
lscr.io/linuxserver/faster-whisper:latest
Containers are configured using parameters passed at runtime (such as those above). These parameters are separated by a colon and indicate <external>:<internal> respectively. For example, -p 8080:80 would expose port 80 from inside the container to be accessible from the host's IP on port 8080 outside the container.
| Parameter | Function |
|---|---|
-p 10300:10300 | Wyoming connection port. |
-e PUID=1000 | for UserID - see below for explanation |
-e PGID=1000 | for GroupID - see below for explanation |
-e TZ=Etc/UTC | specify a timezone to use, see this list. |
-e DEBUG= | If set to true, or any other value, the container will output debug logs. |
-e LOCAL_ONLY= | If set to true, or any other value, the container will not attempt to download models from HuggingFace and will only use locally-provided models. |
-e WHISPER_BEAM=1 | Number of candidates to consider simultaneously during transcription. |
-e WHISPER_LANG=auto | Two character code for the language that you will speak to the add-on. |
-e WHISPER_MODEL=auto | Whisper model that will be used for transcription. From here. |
-v /config | Local path for Whisper config files. |
--read-only=true | Run container with a read-only filesystem. Please read the docs. |
You can set any environment variable from a file by using a special prepend FILE__.
As an example:
-e FILE__MYVAR=/run/secrets/mysecretvariable
Will set the environment variable MYVAR based on the contents of the /run/secrets/mysecretvariable file.
For all of our images we provide the ability to override the default umask settings for services started within the containers using the optional -e UMASK=022 setting.
Keep in mind umask is not chmod it subtracts from permissions based on it's value it does not add. Please read up here before asking for support.
When using volumes (-v flags), permissions issues can arise between the host OS and the container, we avoid this issue by allowing you to specify the user PUID and group PGID.
Ensure any volume directories on the host are owned by the same user you specify and any permissions issues will vanish like magic.
In this instance PUID=1000 and PGID=1000, to find yours use id your_user as below:
id your_user
Example output:
uid=1000(your_user) gid=1000(your_user) groups=1000(your_user)
We publish various Docker Mods to enable additional functionality within the containers. The list of Mods available for this image (if any) as well as universal mods that can be applied to any one of our images can be accessed via the dynamic badges above.
Shell access whilst the container is running:
docker exec -it faster-whisper /bin/bash
To monitor the logs of the container in realtime:
docker logs -f faster-whisper
Container version number:
docker inspect -f '{{ index .Config.Labels "build_version" }}' faster-whisper
Image version number:
docker inspect -f '{{ index .Config.Labels "build_version" }}' lscr.io/linuxserver/faster-whisper:latest
Most of our images are static, versioned, and require an image update and container recreation to update the app inside. With some exceptions (noted in the relevant readme.md), we do not recommend or support updating apps inside the container. Please consult the Application Setup section above to see if it is recommended for the image.
Below are the instructions for updating containers:
Update images:
All images:
docker-compose pull
Single image:
docker-compose pull faster-whisper
Update containers:
All containers:
docker-compose up -d
Single container:
docker-compose up -d faster-whisper
You can also remove the old dangling images:
docker image prune
Update the image:
docker pull lscr.io/linuxserver/faster-whisper:latest
Stop the running container:
docker stop faster-whisper
Delete the container:
docker rm faster-whisper
Recreate a new container with the same docker run parameters as instructed above (if mapped correctly to a host folder, your /config folder and settings will be preserved)
You can also remove the old dangling images:
docker image prune
[!TIP] We recommend Diun for update notifications. Other tools that automatically update containers unattended are not recommended or supported.
If you want to make local modifications to these images for development purposes or just to customize the logic:
git clone https://github.com/linuxserver/docker-faster-whisper.git
cd docker-faster-whisper
docker build \
--no-cache \
--pull \
-t lscr.io/linuxserver/faster-whisper:latest .
The ARM variants can be built on x86_64 hardware and vice versa using lscr.io/linuxserver/qemu-static
docker run --rm --privileged lscr.io/linuxserver/qemu-static --reset
Once registered you can define the dockerfile to use with -f Dockerfile.aarch64.
auto for model and language if not set.Content type
Image
Digest
sha256:454d9298f…
Size
1.6 GB
Last updated
2 days ago
docker pull linuxserver/faster-whisper:3.5.0-gpuPulls:
5,782
Last week