oliver006/redis_exporter

By oliver006

Updated 2 days ago

Prometheus Exporter for Redis Metrics. Supports Redis 2.x, 3.x, 4.x and 5.x

Image
53

100M+

oliver006/redis_exporter repository overview

Prometheus Valkey & Redis Metrics Exporter

Tests Coverage Status codecov docker_pulls Stand With Ukraine

Prometheus exporter for Valkey metrics (Redis-compatible).
Supports Valkey 7.x, 8.x, 9.x (and Redis)


           ____  _                ___ ____ _____
          / ___|| |_ ___  _ __   |_ _/ ___| ____|
          \___ \| __/ _ \| '_ \   | | |   |  _|
           ___) | || (_) | |_) |  | | |___| |___
          |____/ \__\___/| .__/  |___\____|_____|
                         |_|

           Stop ICE's Attack On Our Communities!


Ukraine is still suffering from Russian aggression, please consider supporting Red Cross Ukraine with a donation.

Stand With Ukraine

Building and running the exporter

Build and run locally
git clone https://github.com/oliver006/redis_exporter.git
cd redis_exporter
go build .
./redis_exporter --version
Pre-build binaries

For pre-built binaries please take a look at the releases.

Basic Prometheus Configuration

Add a block to the scrape_configs of your prometheus.yml config file:

scrape_configs:
  - job_name: redis_exporter
    static_configs:
    - targets: ['<<REDIS-EXPORTER-HOSTNAME>>:9121']

and adjust the host name accordingly.

Kubernetes SD configurations

To have instances in the drop-down as human readable names rather than IPs, it is suggested to use instance relabelling.

For example, if the metrics are being scraped via the pod role, one could add:

          - source_labels: [__meta_kubernetes_pod_name]
            action: replace
            target_label: instance
            regex: (.*redis.*)

as a relabel config to the corresponding scrape config. As per the regex value, only pods with "redis" in their name will be relabelled as such.

Similar approaches can be taken with other role types depending on how scrape targets are retrieved.

Prometheus Configuration to Scrape Multiple Redis Hosts

The Prometheus docs have a very informative article on how multi-target exporters are intended to work.

Run the exporter with the command line flag --redis.addr= so it won't try to access the local instance every time the /metrics endpoint is scraped. Using below config instead of the /metric endpoint the /scrape endpoint will be used by prometheus. As an example the first target will be queried with this web request: http://exporterhost:9121/scrape?target=first-redis-host:6379

scrape_configs:
  ## config for the multiple Redis targets that the exporter will scrape
  - job_name: 'redis_exporter_targets'
    static_configs:
      - targets:
        - redis://first-redis-host:6379
        - redis://second-redis-host:6379
        - redis://second-redis-host:6380
        - redis://second-redis-host:6381
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: <<REDIS-EXPORTER-HOSTNAME>>:9121

  ## config for scraping the exporter itself
  - job_name: 'redis_exporter'
    static_configs:
      - targets:
        - <<REDIS-EXPORTER-HOSTNAME>>:9121

The Redis instances are listed under targets, the Redis exporter hostname is configured via the last relabel_config rule.
If authentication is needed for the Redis instances then you can set the password via the --redis.password command line option of the exporter (this means you can currently only use one password across the instances you try to scrape this way. Use several exporters if this is a problem).
For TLS targets whose certificate hostname differs from the target address, pass tls_server_name to /scrape (for example via the Prometheus relabel target __param_tls_server_name).
You can also use a json file to supply multiple targets by using file_sd_configs like so:


scrape_configs:
  - job_name: 'redis_exporter_targets'
    file_sd_configs:
      - files:
        - targets-redis-instances.json
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: <<REDIS-EXPORTER-HOSTNAME>>:9121

  ## config for scraping the exporter itself
  - job_name: 'redis_exporter'
    static_configs:
      - targets:
        - <<REDIS-EXPORTER-HOSTNAME>>:9121

The targets-redis-instances.json should look something like this:

[
  {
    "targets": [ "redis://redis-host-01:6379", "redis://redis-host-02:6379"],
    "labels": { }
  }
]

Prometheus uses file watches and all changes to the json file are applied immediately.

Prometheus Configuration to Scrape All Nodes in a Redis Cluster

When using a Redis Cluster, the exporter provides a discovery endpoint that can be used to discover all nodes in the cluster. To use this feature, the exporter must be started with the --is-cluster flag.
The discovery endpoint is available at /discover-cluster-nodes and can be used in the Prometheus configuration like this:

scrape_configs:
  - job_name: 'redis_exporter_cluster_nodes'
    http_sd_configs:
      - url: http://<<REDIS-EXPORTER-HOSTNAME>>:9121/discover-cluster-nodes
        refresh_interval: 10m
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: <<REDIS-EXPORTER-HOSTNAME>>:9121

  ## config for scraping the exporter itself
  - job_name: 'redis_exporter'
    static_configs:
      - targets:
        - <<REDIS-EXPORTER-HOSTNAME>>:9121

By default, Redis cluster node discovery will use the IP address of the nodes. If the cluster is running with --cluster-preferred-endpoint-type hostname and --cluster-announce-hostname <cluster-node-name> then you can set the --cluster-discover-hostnames flag or theREDIS_EXPORTER_CLUSTER_DISCOVER_HOSTNAMES environment variable to true and the discovery endpoint will return hostnames instead of IP addresses for the nodes. This flag is helpful when the cluster is deployed in container environments.

P.S. Consider using -append-instance-role-label option to easily distinguish master and replica nodes metrics.

Command line flags
NameEnvironment Variable NameDescription
redis.addrREDIS_ADDRAddress of the Redis instance, defaults to redis://localhost:6379. If TLS is enabled, the address must be like the following rediss://localhost:6379
redis.userREDIS_USERUser name to use for authentication (Redis ACL for Redis 6.0 and newer).
redis.passwordREDIS_PASSWORDPassword of the Redis instance, defaults to "" (no password).
redis.password-fileREDIS_PASSWORD_FILEPassword file of the Redis instance to scrape, defaults to "" (no password file).
check-keysREDIS_EXPORTER_CHECK_KEYSComma separated list of key patterns to export value and length/size, eg: db3=user_count will export key user_count from db 3. db defaults to 0 if omitted. The key patterns specified with this flag will be found using SCAN. Use this option if you need glob pattern matching; check-single-keys is faster for non-pattern keys. Warning: using --check-keys to match a very large number of keys can slow down the exporter to the point where it doesn't finish scraping the redis instance. --check-keys doesn't work in cluster mode as "SCAN" does not work across multiple instances.
check-single-keysREDIS_EXPORTER_CHECK_SINGLE_KEYSComma separated list of keys to export value and length/size, eg: db3=user_count will export key user_count from db 3. db defaults to 0 if omitted. The keys specified with this flag will be looked up directly without any glob pattern matching. Use this option if you don't need glob pattern matching; it is faster than check-keys.
check-streamsREDIS_EXPORTER_CHECK_STREAMSComma separated list of stream-patterns to export info about streams, groups and consumers. Syntax is the same as check-keys.
check-single-streamsREDIS_EXPORTER_CHECK_SINGLE_STREAMSComma separated list of streams to export info about streams, groups and consumers. The streams specified with this flag will be looked up directly without any glob pattern matching. Use this option if you don't need glob pattern matching; it is faster than check-streams.
streams-exclude-consumer-metricsREDIS_EXPORTER_STREAMS_EXCLUDE_CONSUMER_METRICSDon't collect per consumer metrics for streams (decreases amount of metrics and cardinality).
check-keys-batch-sizeREDIS_EXPORTER_CHECK_KEYS_BATCH_SIZEApproximate number of keys to process in each execution. This is basically the COUNT option that will be passed into the SCAN command as part of the execution of the key or key group metrics, see COUNT option. Larger value speeds up scanning. Still Redis is a single-threaded app, huge COUNT can affect production environment.
count-keysREDIS_EXPORTER_COUNT_KEYSComma separated list of patterns to count, eg: db3=sessions:* will count all keys with prefix sessions: from db 3. db defaults to 0 if omitted. Warning: The exporter runs SCAN to count the keys. This might not perform well on large databases.
scriptREDIS_EXPORTER_SCRIPTComma separated list of path(s) to Redis Lua script(s) for gathering extra metrics.
lua-script-read-onlyREDIS_EXPORTER_LUA_SCRIPT_READ_ONLYUse the EVAL_RO command for gathering extra metrics with a Lua script instead of EVAL. To protect data in Redis from bugs or Lua script compromise.
debugREDIS_EXPORTER_DEBUGVerbose debug output
log-levelREDIS_EXPORTER_LOG_LEVELSet log level
log-formatREDIS_EXPORTER_LOG_FORMATLog format, valid options are txt (default) and json.
namespaceREDIS_EXPORTER_NAMESPACENamespace for the metrics, defaults to redis.
connection-timeoutREDIS_EXPORTER_CONNECTION_TIMEOUTTimeout for connection to Redis instance, defaults to "15s" (in Golang duration format)
web.listen-addressREDIS_EXPORTER_WEB_LISTEN_ADDRESSAddress to listen on for web interface and telemetry, defaults to 0.0.0.0:9121.
web.telemetry-pathREDIS_EXPORTER_WEB_TELEMETRY_PATHPath under which to expose metrics, defaults to /metrics.
redis-only-metricsREDIS_EXPORTER_REDIS_ONLY_METRICSWhether to export only Redis metrics (omit Go process+runtime metrics), defaults to false.
include-go-runtime-metricsREDIS_EXPORTER_INCLUDE_GO_RUNTIME_METRICSWhether to include Go runtime metrics, defaults to false.
include-config-metricsREDIS_EXPORTER_INCL_CONFIG_METRIC

Tag summary

Content type

Image

Digest

sha256:1a286dba9

Size

8.1 MB

Last updated

2 days ago

docker pull oliver006/redis_exporter:alpine