Azure Databrick
Protiviti India
We do not know your resume yet
Upload your resume to unlock your actual match score and identify important JD keywords before applying.
Recruiters may search these ATS Keywords in your resume
Keywords
Job Description
Role & responsibilities
- Lead the design and development of scalable, high-performance data pipelines using Azure Databricks (PySpark, Delta Lake).
- Serve as the Databricks SME for the team, driving best practices around cluster optimization, job orchestration, notebooks, and performance tuning.
- Architect and enhance ETL/ELT frameworks using Databricks and Azure.
- Manage end-to-end implementation of data engineering projects with focus on reliability, maintainability, and cost efficiency.
- Collaborate with cross-functional teams to define data strategy, data modelling standards, and platform improvements.
- Mentor and guide junior engineers, conduct code reviews, and ensure adherence to engineering standards.
- Work closely with business stakeholders to translate requirements into scalable data solutions.
- Implement and manage Delta Lake, data versioning, audit layers, and data quality frameworks.
- Define and enforce governance, access control, and security standards across the data platform.
- Monitor production workloads, drive root-cause analysis, and continuously improve platform stability.
- Contribute to roadmap planning and provide recommendations for tool upgrades, architecture improvements, and cloud optimization.
Preferred candidate profile
- 46 years of experience in Data Engineering with strong hands-on exposure to Azure cloud.
- Deep expertise in Azure Databricks, including PySpark, Delta Lake, Databricks Jobs, and cluster management.
- Strong programming skills in Python and experience building reusable transformation frameworks.
- Strong experience with Azure Data Factory (ADF) for orchestration, pipeline automation, and triggers.
- Solid understanding of data modelling, ETL/ELT principles, and big-data distributed processing.
- Proficiency in SQL, performance optimization, and working with large datasets.
- Experience working with ADLS and integration with other Azure services.
- Exposure to CI/CD (Azure DevOps preferred) and version control (Git).
- Strong analytical and problem-solving mindset with capability to take ownership of deliverables.
About The Company
Protiviti India
We help our clients seize new opportunities for growth and profitability while protecting themselves from their risks. With our risk management and internal audit heritage, we have gained unique perspetives on the challenges faced by our clients. We use these perspectives not only to solve regulatory, risk and compliance problems, but also to help our clients become more effective and productive. We and our clients recognize that the information required for effective risk management also provides powerful insights about business that can drive enhanced performance. The name Protiviti represents our values, including professionalism, integrity and independence. Unlike many consulting practices, Protiviti has no affiliation with an external audit firm, nor do we provide any external audit services. This affords us a key strategic advantage, as we can offer the resources, quality, capabilities and expertise of any large accounting firm without regulatory or market concerns regarding conflicts of interest. Experience tells us that no one competency is enough to solve today’s complex business problems. That’s why we focus and develop the expertise of our people in the following areas, so that they can team with you to tailor a solution to fit your organization.
How to Apply Better for This Job
This section explains the correct next step without forcing sign-in immediately.
Check ATS score before applying
Scan your resume for ATS readability, formatting issues, missing sections, weak keywords, and content gaps.
Customize your resume for this JD
Match your resume with the job description and add ETL , SQL , etl , git , sql , keywords where they fit naturally.
Find similar jobs too
Do not depend on one opening. Use your resume to find similar frontend jobs across relevant job platforms.
Ready with your customized resume?
Once your resume includes the right skills and is ATS-friendly, you can apply directly on the source platform.
Market Insights:Best DevOps Engineer Jobs in India
Find the latest DevOps Engineer jobs across top Indian cities. Compare job counts by location and apply where hiring demand is higher.