Top Skills:
ForecastingSchedulingAnalyticalPythonData CollectionComputer ScienceData AnalysisBillingProcess ImprovementSqlAdlsAiAuditAzureAzure Data FactoryBillingBusiness Case DevelopmentBusiness IntelligenceBusiness Intelligence Development StudioCachingCi/cdCode ReviewCost OptimizationData AnalysisData AnalyticsData ArchitectureData CollectionData ModelingData PipelineData QualityData VisualizationDatabase Management SystemDatabricksDevopsEncryptionForecastingGitGovernanceIndexingMacroeconomicsMicrosoft AzurePipelineProcess ImprovementPysparkPythonRbacReporting ToolSchedulingSparkSqlStakeholder ManagementTriage
Line of Service Advisory
Industry/Sector FS X-Sector
Specialism Data, Analytics AI
Management Level Senior Associate
Job Description Summary . In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage.
Role Overview Data Engineer with strong hands-on expertise in Azure and Databricks to build, optimise, and operate scalable data pipelines and lakehouse solutions. You will partner with architects, analysts, and business stakeholders to deliver trusted, analytics-ready datasets for insurance use cases.
Responsibilities
- Design, build, and support batch and near real-time data pipelines on Azure using standard engineering practices.
- Develop and optimize Databricks notebooks/jobs using PySpark/Spark, SQL, and Python; follow code review, testing, and documentation standards.
- Implement and maintain lakehouse tables (Delta) and curated layers; apply partitioning and file-layout best practices for performance.
- Create orchestration and scheduling using Azure Data Factory and/or Databricks Workflows; manage dependencies, retries, and SLAs.
- Implement data quality checks, observability (logging/metrics/alerts), and incident triage to ensure reliable pipelines in production.
- Apply security and governance controls for regulated/PII data (RBAC, encryption, secrets management) and support audits as needed.
- Tune Spark workloads and manage Azure/Databricks costs (cluster policies, job sizing, caching, indexing/z-order) to meet performance targets.
Required Skills Qualifications
- Bachelor's/master's degree in computer science, Engineering, or related.
- 3-6 years of data engineering experience delivering production pipelines on Azure.
- Strong Databricks expertise (Spark/PySpark), SQL, and Python.
- Hands-on with Azure data services (ADLS Gen2, ADF) and CI/CD using Git-based workflows; familiarity with DevOps practices is a plus.
- Good understanding of data modeling and lakehouse patterns (Delta).
- Strong communication and stakeholder management; ability to translate requirements into scalable data solutions (insurance domain preferred).
Preferred Attributes
- Certifications: Azure Data Engineer Associate and/or Databricks (preferred).
- Exposure to Databricks Unity Catalog/Delta Live Tables and insurance data domains (policy, claims, billing) is a plus; experience with performance/cost optimization is valued.
Mandatory skill sets:
- Azure Databricks
Preferred skill sets:
- Azure Databricks
Education
Degrees/Field of Study required: Bachelor of Technology
Degrees/Field of Study preferred:
Certifications
(if blank, certifications not specified)
Required Skills
Microsoft Azure Databricks
Optional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Applied Macroeconomics, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Communication, Competitive Advantage, Continuous Process Improvement, Creativity, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Embracing Change, Emotional Regulation, Empathy, Geopolitical Forecasting {+ 24 more}
Travel Requirements
Not Specified
Available for Work Visa Sponsorship
No
Government Clearance Required
No
IN_Senior Associate_Azure Databricks_D&A_Advisory
PwC Service Delivery Center
naukri
Noida
3-6 years Not Disclosed
Full time
30 April 2026
Top Skills:
ForecastingSchedulingAnalyticalPythonData CollectionComputer ScienceData AnalysisBillingProcess ImprovementSqlAdlsAiAuditAzureAzure Data FactoryBillingBusiness Case DevelopmentBusiness IntelligenceBusiness Intelligence Development StudioCachingCi/cdCode ReviewCost OptimizationData AnalysisData AnalyticsData ArchitectureData CollectionData ModelingData PipelineData QualityData VisualizationDatabase Management SystemDatabricksDevopsEncryptionForecastingGitGovernanceIndexingMacroeconomicsMicrosoft AzurePipelineProcess ImprovementPysparkPythonRbacReporting ToolSchedulingSparkSqlStakeholder ManagementTriage
96
Get Personalized Job Matches with 1 Click
Job Description
Download Resume Line of Service Advisory
Industry/Sector FS X-Sector
Specialism Data, Analytics AI
Management Level Senior Associate
Job Description Summary . In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage.
Role Overview Data Engineer with strong hands-on expertise in Azure and Databricks to build, optimise, and operate scalable data pipelines and lakehouse solutions. You will partner with architects, analysts, and business stakeholders to deliver trusted, analytics-ready datasets for insurance use cases.
Responsibilities
- Design, build, and support batch and near real-time data pipelines on Azure using standard engineering practices.
- Develop and optimize Databricks notebooks/jobs using PySpark/Spark, SQL, and Python; follow code review, testing, and documentation standards.
- Implement and maintain lakehouse tables (Delta) and curated layers; apply partitioning and file-layout best practices for performance.
- Create orchestration and scheduling using Azure Data Factory and/or Databricks Workflows; manage dependencies, retries, and SLAs.
- Implement data quality checks, observability (logging/metrics/alerts), and incident triage to ensure reliable pipelines in production.
- Apply security and governance controls for regulated/PII data (RBAC, encryption, secrets management) and support audits as needed.
- Tune Spark workloads and manage Azure/Databricks costs (cluster policies, job sizing, caching, indexing/z-order) to meet performance targets.
Required Skills Qualifications
- Bachelor's/master's degree in computer science, Engineering, or related.
- 3-6 years of data engineering experience delivering production pipelines on Azure.
- Strong Databricks expertise (Spark/PySpark), SQL, and Python.
- Hands-on with Azure data services (ADLS Gen2, ADF) and CI/CD using Git-based workflows; familiarity with DevOps practices is a plus.
- Good understanding of data modeling and lakehouse patterns (Delta).
- Strong communication and stakeholder management; ability to translate requirements into scalable data solutions (insurance domain preferred).
Preferred Attributes
- Certifications: Azure Data Engineer Associate and/or Databricks (preferred).
- Exposure to Databricks Unity Catalog/Delta Live Tables and insurance data domains (policy, claims, billing) is a plus; experience with performance/cost optimization is valued.
Mandatory skill sets:
- Azure Databricks
Preferred skill sets:
- Azure Databricks
Education
Degrees/Field of Study required: Bachelor of Technology
Degrees/Field of Study preferred:
Certifications
(if blank, certifications not specified)
Required Skills
Microsoft Azure Databricks
Optional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Applied Macroeconomics, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Communication, Competitive Advantage, Continuous Process Improvement, Creativity, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Embracing Change, Emotional Regulation, Empathy, Geopolitical Forecasting {+ 24 more}
Travel Requirements
Not Specified
Available for Work Visa Sponsorship
No
Government Clearance Required
No