Job Role

AWS Data Engineer to join clients team for the design, development, and implementation of data-driven solutions on the AWS cloud platform.

Responsibilities

• Data Architecture: Develop and maintain the overall data architecture, ensuring scalability, performance, and data quality.
• AWS Data Services: Expertise in using AWS data services such as AWS Glue, S3, SNS, SES, Dynamo DB, Redshift, Cloud formation, Cloud watch, IAM, DMS, Event bridge scheduler etc.
• Data Warehousing: Design and implement data warehouses on AWS, leveraging AWS Redshift or other suitable options.
• Data Lakes: Build and manage data lakes on AWS using AWS S3 and other relevant services.
• Data Pipelines: Design and develop efficient data pipelines to extract, transform, and load data from various sources.
• Data Quality: Implement data quality frameworks and best practices to ensure data accuracy, completeness, and consistency.
• Cloud Optimization: Optimize data engineering solutions for performance, cost-efficiency, and scalability on the AWS cloud.
• Team Leadership: Mentor and guide data engineers, ensuring they adhere to best practices and meet project deadlines.

Qualifications

• Bachelors degree in computer science, Engineering, or a related field.
• 5-8 years of experience in data engineering roles, with a focus on AWS cloud platforms.
• Strong understanding of data warehousing and data lake concepts.
• Proficiency in SQL and at least one programming language ( Python/PySpark ).
• Experience with any big data technologies like Hadoop, Spark, and Kafka.
• Knowledge of data modeling and data quality best practices.
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and as part of a team.

Preferred Qualifications

• Certifications in AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect - Data.

Mandatory Competencies

Middleware - Message Oriented Middleware - Messaging (JMS, ActiveMQ, RabitMQ, Kafka, SQS, ASB etc)

Big Data - Big Data - Pyspark

Big Data - Big Data - Hadoop

Big Data - Big Data - SPARK

Cloud - AWS - AWS S3, S3 glacier, AWS EBS

Database - Database Programming - SQL

Cloud - AWS - Dynamo DB, Amazon Aurora, Amazon RDS

Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift

Cloud - AWS - AWS SNS, AWS SQS, AWS Kinesis

Cloud - AWS - Amazon IAM, AWS Secrets Manager, AWS KMS, AWS Cognito

Beh - Communication and collaboration