Skip to main content

FromPipelineDataEvent@1

The FromPipelineDataEvent@1 node is used to receive data from a pipeline data event and trigger the execution of the transformation pipeline.

This node binds to the DataFlow topic exchange using the pipeline's own runtime entity ID as the routing key. This means the pipeline only receives data that was explicitly routed to it by an upstream ToPipelineDataEvent@1 node that specified this pipeline's ID as the targetPipelineRtEntityId.

Inter-Pipeline Communication Architecture​

The DataFlow entity establishes a shared topic exchange in the event hub. When pipelines within the same DataFlow need to communicate:

  1. The sending pipeline uses ToPipelineDataEvent@1 with a targetPipelineRtEntityId to publish data to the DataFlow's topic exchange
  2. The receiving pipeline uses FromPipelineDataEvent@1 which automatically binds to the exchange using its own pipeline runtime entity ID as the routing key
  3. The event hub routes the message to the correct pipeline based on the routing key match

Adapter Prerequisites​

  • General availability: All adapters support this node type.

Node Configuration​

For fields path, targetPath, targetValueWriteMode, and targetValueKind, see Overview.

triggers:
  - type: FromPipelineDataEvent@1 # The pipeline will be triggered by a pipeline data event routed to this pipeline

No additional configuration is needed. The node automatically uses the pipeline's own runtime entity ID as the routing key when binding to the DataFlow's topic exchange.