apachestreampipes/backend repository overview

⁠Apache StreamPipes Core

⁠What is Apache StreamPipes?

Apache StreamPipes is a self-service Industrial IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

StreamPipes is an end-to-end toolbox for the industrial IoT. It comes with a rich graphical user interface targeted at non-technical users and provides the following features:

• Quickly connect >20 industrial protocols such as OPC-UA, PLCs, MQTT, REST, Pulsar, Kafka and others.
• Create data harmonization and analytics pipelines using > 100 algorithms and data sinks to forward data to third-party systems.
• Use the data explorer to visually explore historical data with many widgets tailored for time-series data.
• A live dashboard to display real-time data from data sources and pipelines, e.g., for shopfloor monitoring.
• StreamPipes is highly extensible and includes a Java SDK to create new pipeline elements and adapters. Python support is available in an early development stage - stay tuned!
• Pipeline elements are standalone microservices that can run anywhere - centrally on your server or close at the edge. You want to employ your own machine learning model on live data? Just write your own data processor and make it reusable as a pipeline element.

Besides that, StreamPipes includes features for production deployments:

• Assign resources such as pipelines, data streams and dashboards to assets for better organization
• Monitoring & metrics of pipelines and adapters
• Built-in user and access rights management
• Export and import resources

⁠Installation

We provide docker-compose files as well as helm charts for Kubernetes. Follow the installation instructions at https://streampipes.apache.org/docs/try-installation⁠.

⁠Apache StreamPipes Core

This image contains the Apache StreamPipes core, which manages the whole system and controls pipeline execution.

⁠Further information

Check the Apache StreamPipes website at https://streampipes.apache.org⁠

Check the installer folder of our Github repository:

• Compose: https://github.com/apache/streampipes/tree/dev/installer/compose⁠
• K8s: https://github.com/apache/streampipes/tree/dev/installer/k8s⁠

Make sure to checkout the correct branch of the latest official release.