Data Pipelines

Data pipelines let you transform and validate telemetry before it is stored and broadcast to the UI.

When to use

• Rename keys across firmware versions (temp_c → temperature)
• Drop invalid telemetry (range checks / conditional drop)
• Normalize payloads (flatten, coerce types, defaults)
• Forward telemetry to external systems (webhook forward)

How it works (high level)

• Data pipelines are optional on a device profile
• If no pipeline is selected, telemetry is stored as received
• Pipelines run on telemetry before DB write + realtime emit + alarms
• Fail-open: if a pipeline step throws, ingest continues with the original telemetry

UI pages (app)

• Data Pipelines — /data-pipelines
• Data Pipeline Editor — /data-pipelines/:id