sflow/ai-metrics

By sflow

Updated 13 days ago

Performance metrics for AI / ML cluster

Image
Networking
Machine learning & AI
Monitoring & observability
0

2.7K

sflow/ai-metrics repository overview

What is AI Metrics?

sflow-rt/ai-metrics is an sFlow-RT application that provides real-time metrics for AI/ML RoCEv2 network traffic, for example, large scale CUDA compute tasks using NVIDIA Collective Communication Library (NCCL) operations for inter-GPU communications: AllReduce, Broadcast, Reduce, AllGather, and ReduceScatter..

This image also includes sflow-rt/browse-drops, sflow-rt/browse-flows, sflow-rt/browse-metrics, sflow-rt/topology, sflow-rt/trace-flow, and sflow-rt/prometheus applications that provide visibility into traffic flowing over the topology.

How to use this image

docker run -v $PWD/store:/sflow-rt/store/ -p 8008:8008 -p 6343:6343/udp sflow/ai-metrics

Run AI Metrics application. Access web interface on port 8008.

See sflow/sflow-rt for additional settings available in the base image.

Documentation and support

Visit sFlow-RT for documentation, tutorials, and community support.

License

Please read and accept the License Agreement before downloading this software.

Tag summary

Content type

Image

Digest

sha256:50e1751e0

Size

53.9 MB

Last updated

13 days ago

docker pull sflow/ai-metrics