About Position:

We are looking for a skilled ETL Test & Automation Engineer to design, develop, and maintain automated test frameworks for data pipelines, ETL workflows, XML/JSON payloads, and MDM systems. The ideal candidate has deep hands-on experience in Python-based test automation, data quality validation, and cloud-native data platforms such as Azure Databricks, AWS Redshift, and Informatica.

• Role: ETL Test & Automation Engineer
• Location: All Persistent Locations
• Experience: 6 to 12 Years
• Job Type: Full Time Employment

What You'll Do:

ETL Pipeline Testing

• Design and execute test strategies for ETL pipelines built on DBT ,Informatica , Databricks
• Validate data transformation logic across Bronze, Silver, and Gold layers of Medallion Architecture
• Perform source-to-target (STT) mapping validation for migrations (Informatica to Databricks, Redshift to Delta Lake)
• Validate incremental and full-load ETL pipelines including CDC (Change Data Capture) scenarios
• Test DLT (Delta Live Tables) pipelines including DLT Expectations and data quality rules

Test Automation Framework

• Build and maintain Python-based test automation frameworks using pytest, PySpark
• Develop reusable test utilities for schema validation, null checks, duplicate detection, and row count reconciliation
• Integrate automated test suites into CI/CD pipelines (Azure DevOps / GitHub Actions)
• Automate regression testing for pipeline deployments across DEV, QA, and PROD environments
• Implement data diff and checksum-based validation for large-scale table migrations

XML & API Validation

• Validate XML payloads against XSD schemas using lxml and xmlschema libraries
• Test REST API integrations (Jira, ServiceNow, ADO, SFTP) for data ingestion pipelines
• Perform business rule validation on XML-based customer, order, and product feeds
• Validate JSON schema contracts and API response structures for event-driven pipelines

MDM & Domain Validation

• Validate MDM golden records for Customer, Product, and Vendor domains
• Test deduplication logic, survivorship rules, and cross-system data consistency
• Validate row-level and column-level security rules in Unity Catalog (masking functions, row filters)
• Test SCD Type 1 and Type 2 implementations in Delta Lake

Data Quality & Reporting

• Define and enforce DQ rules using Great Expectations, dbt tests, or custom pytest assertions
• Build automated data quality dashboards and test result reports
• Track test metrics: pass rate, coverage, defect density across pipeline stages
• Raise and manage defects using Jira / Azure DevOps with detailed root cause analysis

Expertise you will bring:

• Bachelor's Computer Science, Information Technology, or related field
• 6 to 12 years of experience in ETL testing, data quality, or test automation roles
• Hands-on experience with Informatica PowerCenter / IICS and cloud data platforms (Azure / AWS)
• Strong understanding of data warehousing concepts: Star Schema, SCD, CDC, Medallion Architecture
• Experience testing large-scale data migration projects (source system to cloud data lake)
• Excellent analytical and debugging skills for identifying root cause of data discrepancies
• ISTQB / CSTE certification preferred but not mandatory

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.