Skip to main content

3.3 Release Notes (Nov 2023)

Rajni Duggal
  • Updated
mceclip3.png What's New

Fabrication - Profiling/Multi-table Output Support

  • Users can now link and filter by data configuration using the associated profiling output/config. 
  • Additionally, configurations can be directly generated from profiling results.
  • Multiple Tables and Files can now be generated.

TDM Overview Report Generator

  • DCS now offers the capability to produce a summary report, covering profiling, masking, validation, and other scans tailored to a DB data connection.
  • The comprehensive report can help streamline analysis, decision-making, and communication for project stakeholders.
  • For the time being, this feature is exclusively available via the API.

Validation - Dual Configuration Support

  • The validation scan has been upgraded to support both the existing validation configuration and the new masking configuration.
  • Users now have the ability to choose the masking config instead of the validation config, in order to ensure that the right columns are effectively masked and checked.

API Endpoints

  • Added database load and backup
mceclip4.png Changed

 

Custom Masking Functions

  • Python scripts can now be deployed directly via the data library in Ecosystem UI.
  • Users can update/delete their custom function scripts.

Fabrication -  Generate Schema Structure

  • Added the ability to generate schema structures. With this update, a create schema field when checked, will automatically establish tables and their respective structures.

Pattern Finder

  • Outliers have been excluded from the standard deviation calculation to enhance precision. 
  • Additionally, any duplicate indexes identified have been systematically replaced with uniformly spaced values to ensure accuracy.
fixes__1_.png Fixed

 

Task Manager

  • Fixed an error that caused special characters for URL to be double encoded.

DB Masking 

  • Oracle 
    • Fixed escaping backslash for UNISTR function.
    • Fixed an inconsistency with masking full names that began with spaces.
  • MySQL
    • Resolved an issue where the conditional masking configuration for the 'Address' column in the 'where' clause was ambiguous.
  • Teradata
    • Improved function definitions and calls for better consistency and reduced errors.

DB Validation

  • Added support for TOP N function with DISTINCT in Teradata.

File Masking

  • XML
    • Resolved an issue where the XML masking process completed successfully, but did not generate the corresponding masked file based on unique constraints.

API

  • Fixed an error where File Profile report request could return a 400 error.

MSSQL - Performance Update

  • The query responsible for retrieving tables and columns in MSSQL has been optimised. Users can now expect faster and more efficient performance.

Expanded Null Exclusion List

  • The null exclusion list, previously exclusive to delimited file masking, has been expanded to all database types.

Mask Functions

  • Fixed an error where the masked credit card number was being truncated to 5 digits.
mceclip0.png Decommissioned

  • Data Subsetting

    • Data Subsetting has now been decommissioned

Related articles

Comments

0 comments

Article is closed for comments.