• Design, develop, and maintain end-to-end big data pipelines for enterprise applications

• Work on Apache Hadoop and Apache Spark-based data processing frameworks

• Manage and optimize data pipelines, scripts, and production systems for performance and stability

• Perform unit testing of data pipelines and support UAT (User Acceptance Testing) activities

• Debug and resolve issues in existing data pipelines, scripts, and production workflows

• Modify and enhance existing data processing systems based on business requirements

• Review design, code, and deliverables to ensure high-quality output

• Build and maintain scalable and secure big data solutions using cloud platforms

• Ensure implementation of data governance, security, and compliance standards

• Mentor junior team members and contribute to knowledge sharing initiatives

• Participate in Agile development practices and cross-team collaboration

• Handle Proof of Concepts (PoCs) and deliver solutions within timelines