Data Engineer - Lead
IRIS software
We do not know your resume yet
Upload your resume to unlock your actual match score and identify important JD keywords before applying.
Recruiters may search these ATS Keywords in your resume
Keywords
Job Description
Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture thattruly values your talent and ambitions
Join Iris Software - one of thefastest-growing IT services companies- whereyou own and shape your success story.
At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential.
At Iris, every role is more than a job - it's a launchpad for growth.
Job Description
PRIMARY RESPONSIBILITIES
- Design and implement robust, scalable data pipelines to support AI/ML model development and deployment
- Clean, transform, and curate structured and unstructured data from diverse sources to ensure model-ready quality
- Collaborate with data scientists, ML engineers, and business teams to ensure data readiness, usability, and alignment with AI objectives
- Develop andmaintainmetadata management, data lineage, and data quality frameworks to support AI governance and compliance
- Enable advanced feature engineering capabilities and implement real-time data streaming solutions for AI applications
- Design and deploy data collection instruments and oversee data aggregation processes
- Ensure data compliance, privacy, and ethical use standards across all AI workflows
- Support enterprise-wide data initiatives including business glossary development, taxonomy creation, and the DARE program's automation goals
KNOWLEDGE/SKILLS
- Programming & Technical Skills:Advancedproficiencyin Python, SQL, and distributed computing frameworks (Spark, Hadoop)
- Cloud Platforms:Hands-on experience with cloud data platforms (AWS, Azure, GCP) and their data services
- Data Engineering Tools:Expertisewith data orchestration tools (Airflow, Prefect), ETL/ELT frameworks, and data pipeline optimization
- AI/ML Data Specialization:Experience with ML feature stores, data versioning, model-ready data design, and real-time streaming technologies
- Data Management:Strong understanding of data governance, metadata management, data quality frameworks, and lineage tracking
- Compliance & Ethics:Knowledge of data privacy regulations, compliance standards, and ethical AI data practices
- Collaboration:Excellent communication skills and ability to work effectively with cross-functional teams including data scientists, ML engineers, and business stakeholders
EDUCATION AND EXPERIENCE
Required:
- Bachelor's degree in Computer Science, Data Engineering, Computer Engineering, or related technical field
- 3+ years of experience in data engineering withdemonstratedexperience in AI/ML environments
- Proficiencyin Python and SQL for data manipulation and pipeline development
- Experience with cloud data platforms (AWS, Azure, or GCP)
- Hands-on experience with data orchestration tools (e.g., Airflow, Prefect) and ETL frameworks
Preferred:
- Master's degree in Computer Science, Data Engineering, or related field
- 5+ years of experience in data engineering, preferably in AI/ML environments
- Experience with real-time data processing (Kafka, Kinesis).
- Exposure to LLMs and generative AI data preparation.
- Knowledge ofMLOpsand integration with ML lifecycle tools.
- Familiarity with BI tools and semantic layer design.
Must Have -
. Python & advanced SQL
. Spark / distributed processing
. Cloud platforms (AWS)
. Airflow / orchestration tools
. Data pipeline automation
. Data governance & quality
Nice to have -
. Kafka/Kinesis streaming
. Feature stores
. LLM‑ready data pipelines
. MLOps exposure
Mandatory Competencies
Perks and Benefits for Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click to view the benefits.
How to Apply Better for This Job
This section explains the correct next step without forcing sign-in immediately.
Check ATS score before applying
Scan your resume for ATS readability, formatting issues, missing sections, weak keywords, and content gaps.
Customize your resume for this JD
Match your resume with the job description and add ai , bi , s3 , AWS , Sql , keywords where they fit naturally.
Find similar jobs too
Do not depend on one opening. Use your resume to find similar frontend jobs across relevant job platforms.
Ready with your customized resume?
Once your resume includes the right skills and is ATS-friendly, you can apply directly on the source platform.
Market Insights:Best Data Engineer Jobs in India
Find the latest Data Engineer jobs across top Indian cities. Compare job counts by location and apply where hiring demand is higher.