Performance metrics for AI / ML cluster
2.7K
sflow-rt/ai-metrics is an sFlow-RT application that provides real-time metrics for AI/ML RoCEv2 network traffic, for example, large scale CUDA compute tasks using NVIDIA Collective Communication Library (NCCL) operations for inter-GPU communications: AllReduce, Broadcast, Reduce, AllGather, and ReduceScatter..
This image also includes sflow-rt/browse-drops, sflow-rt/browse-flows, sflow-rt/browse-metrics, sflow-rt/topology, sflow-rt/trace-flow, and sflow-rt/prometheus applications that provide visibility into traffic flowing over the topology.
docker run -v $PWD/store:/sflow-rt/store/ -p 8008:8008 -p 6343:6343/udp sflow/ai-metrics
Run AI Metrics application. Access web interface on port 8008.
See sflow/sflow-rt for additional settings available in the base image.
Visit sFlow-RT for documentation, tutorials, and community support.
Please read and accept the License Agreement before downloading this software.
Content type
Image
Digest
sha256:50e1751e0…
Size
53.9 MB
Last updated
13 days ago
docker pull sflow/ai-metrics