Skip to main content

Data Transform

Data Normalization​

Standardizes data by removing unnecessary spaces, leading zeroes, and formatting text, numbers, or dates for consistency and improved usability.

Benefits​

  1. Cleans up data.
  2. Simplifies data source joins.

Supported Options​

  • Remove Leading Whitespace: Eliminates unnecessary spaces at the beginning of text.
  • Remove Trailing Whitespace: Removes extra spaces at the end of text.
  • Remove Leading Zeroes: Strips zeroes from the start of numerical or text values.
  • Convert Text to Lowercase: Converts all text characters to lowercase.
  • Convert Text to Uppercase: Converts all text characters to uppercase.
  • Floor Function: Rounds numbers down to the nearest whole number.
  • Ceiling Function: Rounds numbers up to the nearest whole number.
  • Date Format: Converts dates into a specified format.
  • Data Type Conversion: Transforms data types (e.g., string, integer).

Example: Formatting a Date Field​

  1. Select the Source Field as the Date field.
  2. Provide a name for the transformed output field.
  3. Select ‘Data Normalization’ as the Transformation.
  4. Choose ‘Date Format’ from the Normalization dropdown.
  5. Select the required date format (e.g., DD/MM/YYYY).
  6. Click ‘Apply’.
Data Normalization Example
Example of normalizing a date field.

Data Cleansing​

Replaces specific existing values in a field with new values.

Benefits​

  1. Ensures clean data in the system.
  2. Reduces storage costs and additional transformations.

Example: Updating Product Prices​

  1. Select the Source Field as the Price field.
  2. Provide a name for the transformed output field.
  3. Select ‘Data Cleansing’ as the Transformation.
  4. Choose ‘Replace Values’ from the Data Cleansing dropdown.
  5. Select ‘Custom Replacement’ as the Replacement option.
  6. Enter the current price in the ‘Replacement Value’ field.
  7. Enter the new price in the ‘Replace With’ field.
  8. Click ‘Apply’.
Data Cleansing Example
Example of replacing values in a field during data cleansing.

Calculation​

Enables custom calculations such as addition, subtraction, multiplication, division, percentage increase, and percentage decrease on field values.

Benefits​

  1. Enhances reporting capabilities.

Supported Options​

TransformationDescription
ADDAdds a specified value to the field’s existing values.
MINUSSubtracts a specified value from the field’s existing values.
MULTIPLYMultiplies the field’s values by a specified number.
DIVIDEDivides the field’s values by a specified number.
PERCENTAGE INCREASEIncreases the field’s values by a given percentage.
PERCENTAGE DECREASEDecreases the field’s values by a given percentage.

Example: Increasing Product Prices​

  1. Select the Source Field as the Price field.
  2. Provide a name for the transformed output field.
  3. Select ‘Calculation’ as the Transformation.
  4. Choose ‘Custom’ in the Calculation dropdown.
  5. Select ‘ADD’ as the Operation.
  6. Input the value to be added to all the Price field’s values.
  7. Click ‘Apply’.
Calculation Example
Example of adding a value to a price field using the calculation transformation.

Attribute Standardization​

Transforms values between units of measurement or currency for consistency and alignment with standards.

Benefits​

  1. Ensures clean data in the system.
  2. Reduces storage costs and additional transformations.

Supported Options​

TransformationDescription
Weight from grams to KilogramsConverts weight values from grams to kilograms.
Weight from Kilograms to PoundsConverts weight values from kilograms to pounds.
Length from meters to CentimetersConverts length values from meters to centimeters.
Length from centimeters to metersConverts length values from centimeters to meters.
Dollar to Dirham Currency ConversionConverts monetary values from dollars to dirhams.
Dirham to Dollar Currency ConversionConverts monetary values from dirhams to dollars.

Example: Currency Conversion (USD to Dirham)​

  1. Select the Source Field as the Price field.
  2. Provide a name for the transformed output field.
  3. Select ‘Attribute Standardization’ as the Transformation.
  4. Choose ‘Dollar to Dirham Currency Conversion’ from the dropdown.
  5. Click ‘Apply’.
Attribute Standardization Example
Example of converting currency from USD to Dirham using attribute standardization.