Data Test Engineer

TCS Hiring for Data Test Engineer

Experience Range: - 03 To 05 Years (Mandatory)

Job Locations : Chennai, Bengaluru, Hyderabad, Kochi, Pune, Bhubaneswar

JOB DESCRIPTION

Key Responsibilities:

1) Data Testing & Validation

• Develop and execute test cases for MDM , Customer 360 , Party data , and reference data workflows.
• Validate match/merge , survivorship , Golden Record , hierarchies , and crosswalk logic in MDM platforms.
• Test ETL pipelines across batch and streaming data flows, ensuring correctness of:
• Transformations
• Aggregations
• Schema evolution
• Incremental loads & SCD logic
• File formats (Parquet/Avro/JSON)

2) Data Reconciliation & Quality

• Perform source-to-target data validation, including:
• Row counts
• Checksums
• Attribute-level comparisons
• Duplicate checks
• Null/format validations
• Create automated or semi-automated data profiling and quality checks .

3) Modernization Program Testing

• Test large-scale data migration and modernization programs, including:
• Legacy → Cloud platform migrations
• Data warehouse → Lakehouse transitions
• Big-bang vs incremental migration validations
• Validate data completeness , accuracy , performance , and lineage during cutover phases.

4) Tools, Frameworks & Automation

• Write and execute test scripts using SQL , Python , or PySpark .
• Leverage DQ frameworks such as Great Expectations , Deequ , or internal validation libraries.
• Integrate test suites into CI/CD pipelines (e.g., GitHub Actions, CodePipeline, Azure DevOps).
• Use cloud-native tools for validation (e.g., AWS Athena, Glue Catalog validations, S3 queries, etc.).

5) Collaboration & Reporting

• Collaborate with Data Engineers, ETL Developers, and MDM teams to understand business rules and transformation logic.
• Participate in peer reviews of test cases & results.
• Prepare test summary reports , defect logs, and daily status updates.
• Contribute to root cause analysis for data issues and support defect triage.

Required Qualifications:

• Experience in Data Testing/QA roles.
• Strong SQL skills: joins, window functions, aggregations, analytical functions.
• Experience in testing MDM systems (Reltio, Informatica MDM, Semarchy, or equivalent).
• Hands-on testing of ETL pipelines using Glue, Informatica, Talend, IICS, SSIS, or similar.
• Understanding of data modeling , partitioning , SCD types , and data warehousing concepts .
• Experience in large data migration or modernization testing programs.
• Ability to validate data transformations using SQL/Python/PySpark.

Preferred Qualifications (not compulsory)

• Experience working in AWS data environments (Glue, Athena, Redshift, S3).
• Familiarity with Great Expectations , Deequ , or similar data validation tools.
• Exposure to data governance , metadata management , and lineage tools .
• Experience in Agile development environments.
• BFSI domain knowledge (KYC, customer onboarding, AML, customer hierarchies) is a strong plus.

Minimum Qualification:

15 years of Full Time Education