Skip to main content

Overview

OctoMesh distinguishes between Extract, Transform, Control and Load nodes. Each node type has a specific role in the data pipeline. The following table provides an overview of the node types and their availability in edge and mesh pipelines.

  • Trigger nodes are used to trigger the execution of a pipeline based on HTTP request, polling, or other events.
  • Extract nodes are used to extract data from a source system.
  • Transform nodes are used to transform data. Transform nodes can be used to filter, aggregate, join, or otherwise manipulate data.
  • Control nodes are used to control the flow of data.
  • Load nodes are used to load data into a target system.

All nodes have some common fields that are used to read or write data. The following table provides an overview of the common fields.

Path

The path field is a path in the payload where the data should be read, for example $.myField, any JSON path is valid. The path is used to define the location where the data should be read from the payload for the current node.

TargetPath

The targetPath field is a path in the payload where the data should be stored, for example $.myField, any JSON path is valid.

TargetValueWriteMode​

Field targetValueWriteMode combined with targetValueKind is used to define how the data should be written to the target path. The following modes are available:

  • Overwrite: The data is overwritten if the target path already exists.
  • Append: The data is appended to the target path if the target path already exists. This mode is only available for arrays.
  • Prepend: The data is prepended to the target path if the target path already exists. This mode is only available for arrays.
note

The default value of TargetValueWriteMode is Overwrite.

TargetValueKind​

Field targetValueKind combined with targetValueWriteMode is used to define how the data should be written to the target path. The following kinds are available:

  • Simple: The data is written as is.
  • Array: The data is written as an array.
note

The default value of TargetValueKind is Simple.

tip

Field targetPath cannot convert the output object. For example, a data context contains an array. If targetPath $.myField is used, the output object cannot be written because an object is expected in data context.