Data Pipelines Overview

Verified user flows

• Create / edit / delete data pipeline
• Preview transform (webhooks not sent; preview shows outbound body)
• Save & activate
• Bind pipeline to a device profile
• Webhook outbound to an external HTTPS endpoint (fail-open)

Key concepts

• Pipelines are a linear list of steps (not a ThingsBoard-style canvas)
• Steps can be disabled without deleting them
• Blank / unbound = passthrough
• Alarms stay on the device profile — not in the pipeline editor

Step catalog

Transform

• Rename keys, change scope (prefix/regex), copy key
• Scale / round / coerce / set defaults
• Map values, string transform (trim / lower / upper)
• Flatten object, derive key (expression), remove empty

Filter

• Pick keys (allowlist), drop keys (denylist)
• Filter range (drop whole message), clamp range, conditional drop

Outbound

• Webhook (send out) — POST/PUT/GET to http(s)://…
  • Default body envelope: { ts, deviceId, tenantId, profileId, telemetry }
  • Optional raw body (includeContext: false)
  • Optional headers JSON (e.g. Authorization)
  • Timeout 1–30s; errors logged, ingest not blocked
  • Preview returns webhookPreviews[] with the exact body that would be sent