MapNodeConfiguration

Namespace: Meshmakers.Octo.Sdk.Common.EtlDataPipeline.Nodes.Transforms

Configuration of node for pivot transformation, converting a JSON object with multiple columns into a list of objects with a single column.

public record MapNodeConfiguration : SourceTargetPathNodeConfiguration, INodeConfiguration, IEquatable<NodeConfiguration>, ITargetPathNodeConfiguration, IEquatable<TargetPathNodeConfiguration>, IPathNodeConfiguration, IEquatable<SourceTargetPathNodeConfiguration>, IEquatable<MapNodeConfiguration>

Inheritance Object → NodeConfiguration → TargetPathNodeConfiguration → SourceTargetPathNodeConfiguration → MapNodeConfiguration
Implements INodeConfiguration, IEquatable<NodeConfiguration>, ITargetPathNodeConfiguration, IEquatable<TargetPathNodeConfiguration>, IPathNodeConfiguration, IEquatable<SourceTargetPathNodeConfiguration>, IEquatable<MapNodeConfiguration>

Remarks:

This type of transformation is known as a pivot transformation or data restructuring, specifically a conversion from wide format to long format, where the JSON object, currently organized column-wise, is transformed into a list format with each row (based on the timestamp) as a separate object.

Properties

SelectPaths

Properties to transform

public IEnumerable<string> SelectPaths { get; set; }

Property Value

IEnumerable<String>

Path

Gets or sets the source path in json path format

public string Path { get; set; }

Property Value

String

TargetPath

Gets or sets the target path in json path format

public string TargetPath { get; set; }

Property Value

String

TargetValueWriteMode

Gets or sets the writing mode (overwrite, append, prepend)

public TargetValueWriteModes TargetValueWriteMode { get; set; }

Property Value

TargetValueWriteModes

TargetValueKind

Gets or sets the value kind to write (simple value or array)

public ValueKinds TargetValueKind { get; set; }

Property Value

ValueKinds

DocumentMode

Gets or sets the document mode (extend, replace)

public DocumentModes DocumentMode { get; set; }

Property Value

DocumentModes

Description

Gets or sets an optional description

public string Description { get; set; }

Property Value

String

Constructors