opensnowcat/opensnowcat-collector-pubsub repository overview

⁠OpenSnowcat Pub/Sub Collector

OpenSnowcat Collector (Pub/Sub) is a highly scalable, real-time event tracking server that ingests events from Snowplow and Segment SDKs and streams them directly to a Pub/Sub topics for further processing. This Docker image facilitates easy deployment and configuration of the collector in a containerized environment. It supports custom event schemas, payload formats, and includes options for logging, rate limiting, and security. Ideal for data-driven pipelines leveraging Kinesis as the transport layer.

⁠Run the collector

Refer to OpenSnowcat devkit for examples

docker run \
  -it --rm \
  -v $PWD:/opensnowcat \
  -e GOOGLE_APPLICATION_CREDENTIALS=/opensnowcat/service-account.json \
  -p 8080:8080 \
  opensnowcat/opensnowcat-collector-pubsub \
  --config /opensnowcat/gcp/config.collector.hocon

⁠Documentation & Support

• Opensnowcat.io⁠
• Snowplow Discorse⁠
• Slack communities: MeasureSlack, dbt, LocallyOptimistic

⁠License

This software is licensed under Apache 2.0. For additional details visit the Github project⁠

⁠Contact

Please contact [email protected]⁠ for additional information.