Mapping Groups in Nexadata are powerful tools that allow users to map data fields with conditional logic to ensure data consistency across systems. This guide will walk you through the process of creating a new Mapping Group.
Step-by-step Instructions
Step 1: Open the Mapping Group editor
Starting from the Home Screen
From the Nexadata home screen, click the "Create a Mapping Group" tile to go directly to the Mapping Group editor for a new Mapping Group.
Navigating from the Build Menu
Alternatively, go to Build > Mapping Group in the navigation bar. This brings you to a list of existing Mapping Groups where you can:
Edit an existing Mapping Group.
Create a new Mapping Group by clicking the "+" button in the upper right corner.
Step 2: Configure basic Mapping Group options
Once you’re in the Mapping Group editor, you’ll see the following options:
Name - Enter the name for your Mapping Group in the Name field (required).
Case Sensitivity - Check the Case Sensitive box if the mappings should distinguish between uppercase and lowercase letters.
Effective Dates
Set the Start Time and End Time for the Mapping Group.
This feature is helpful when mappings need to be active only during specific date ranges.
Step 3: Enter individual Mapping Rules
Below the configuration options, you’ll find the Mapping Rule Table, which allows you to define specific rules for data mapping. The table includes the following columns:
Select (Checkbox): Use these checkboxes to select individual rules or all rules for batch actions, such as removing or exporting multiple rules.
Type: Specifies the type of mapping. Options include:
Exact: Match the data exactly as entered.
Not Exact: Exclude data that matches the value entered.
Like: Match data based on similar patterns (e.g., partial matches).
Not Like: Exclude data based on similar patterns.
Regex: Use advanced pattern matching with regular expressions.
From: Enter the source value the rule will search for in your data.
To: Enter the target value that the data will transform to.
Sequential Rule Application
Mapping rules within a Mapping Group are applied sequentially. In the example above:
The first rule maps the product family
"100"to"Colas".The second rule uses
"Colas"as the reference for the Not Exact condition, mapping all other product families (e.g.,"200","300","400") to"Non Colas".
This sequential logic ensures that rules build upon one another to create precise mappings.
In addition to the individual mapping rules, there are the following Rule Management buttons:
Add Rule: Add a new mapping rule.
Remove Rule: Remove the selected rule(s).
Export: Export rules for external use or backup.
Import: Import rules from a saved file to quickly populate your Mapping Group.
Step 4: Adding Conditions to Individual Maps
To place conditions on individual maps within a Mapping Group, start by adding columns in the primary Mapping Groups editor. This can be done by clicking Add Column (marked as 1 in the screenshot below).
When adding a column:
Enter the Name of the column as it will appear in the recordset.
Select the Data Type that corresponds to the condition you want to apply:
String: Use for text-based conditions like matching names, codes, or categories (e.g.,
"Status = Active").Number: Use for numeric comparisons such as quantities, percentages, or thresholds (e.g.,
"Quantity > 100").Date: Use for time-based conditions like matching specific dates or ranges (e.g.,
"Date is after 01/01/2024").
👍 Defining columns allows for re-using your Mapping Group across multiple Pipelines.
Once columns are added, you’ll see a pencil icon next to each mapping rule (indicated as 2 in the screenshot above). Click this icon to open the Conditions Editor, where you can define or edit conditions.
The Conditions Editor allows you to:
Add rules using natural language.
Combine conditions with logical operators like AND and OR.
Create nested logic using Grouping.
💪 Adding Conditions to Individual Maps enables precise and flexible logic tailored to your mapping needs.
👍 Conditions can be entered in natural language. Click the lightning bolt (⚡️) button (next to Save) to open a text input field where you can add instructions for each condition.
Step 5: Save (or delete) the Mapping Group
Save: Located in the lower left corner (pictured above), this button saves your Mapping Group.
Delete: Found in the upper right corner under the dropdown menu Actions (across from the Mapping Group name). This button deletes the Mapping Group if it’s no longer needed. If the Mapping Group is in use, then a similar dialogue will appear:
Step 6: Using a Mapping Group in a Transformation Pipeline
Once your Mapping Group is complete with individual Mapping Rules, you can apply it within a Nexadata Pipeline to transform data according to the mapping logic you've set up.
In the Nexadata Pipeline Builder:
Select Mapping
In the Pipeline Builder, choose the Mapping option and then click on the Use Existing Mapping Group tile. This will launch a three-step wizard to integrate the Mapping Group into your pipeline.
Three-Step Wizard for Mapping Group Integration
Select a Mapping Group
Choose the desired Mapping Group from the dropdown menu, then click Next to proceed.
Define Transformation Details
Enter a Transformation Name for this mapping step.
Select the Column where the Mapping Group should be applied.
Click Next once this information is entered.
Apply the Mapping Group Rules
In the final step, the maps and conditions defined in the Mapping Group are applied.
If there are conditions for individual maps, then it will be necessary to link the column in the Mapping Group with the actual column in the dataset. You can do that via the column-linking interface as illustrated below:
👍 Click the Preview Rule Changes button (circular arrows) to see a preview of the mapping rule changes.
👍 From within a Pipeline, individual maps and conditions can be added, adjusted, or removed. Any changes are saved with the original Mapping Group.
3. Complete the Transformation
Once you’ve configured these options, save the transformation step to apply your Mapping Group within the pipeline, and the affected columns will be highlighted as illustrated below.
👍 See Mapping Group Management in a Pipeline for enhanced Mapping Group capabilities.
Summary of Steps
Open the Mapping Group Editor - Start from the home screen or go to Build > Mapping Group to create or edit a Mapping Group.
Configure Basic Options - Set the Mapping Group's name, case sensitivity, and effective start/end dates.
Enter Mapping Rules - Define each rule with "From" and "To" values, selecting rule type (exact, not exact, like, not like, or regex).
Add Mapping Conditions - Add a column and edit the conditions when a map is applied within a Mapping Group.
Save or Delete the Mapping Group - Click Save to finalize or Delete if it’s no longer needed.
Use in a Pipeline - In Pipeline Builder, select Mapping, choose the Mapping Group, define transformation details, and set any additional conditions as needed.