Key Skills: AWS, AWS Cloud, Data Engineer, AWS Cloud Engineer, Pyspark, SQL, Python
Roles and Responsibilities:
- Designs and implements scalable data pipelines, data lakes, and data warehouse solutions.
- Builds and maintains cloud-native data platforms using AWS services such as S3, EC2, Glue, Athena, Redshift, and SageMaker.
- Develops data processing workflows using Python, PySpark, and SQL.
- Integrates data from multiple sources and ensures data quality, consistency, and reliability.
- Implements containerized solutions using Docker and Kubernetes for scalable deployments.
- Applies CI/CD practices and version control using Git and modern DevOps workflows.
- Designs and develops APIs and microservices to support data access and integration.
- Works on LLM-powered solutions, including prompt engineering and Retrieval-Augmented Generation (RAG) workflows.
- Collaborates with cross-functional teams to understand data requirements and deliver solutions.
- Supports data visualization and reporting using tools such as Tableau or Power BI.
- Monitors, troubleshoots, and optimizes performance of data pipelines and systems.
- Communicates effectively with stakeholders and drives data-driven decision-making.
Skills Required:
- Demonstrates strong experience in AWS cloud services and data engineering ecosystems.
- Possesses hands-on expertise in building large-scale data pipelines and platforms.
- Shows proficiency in Python, PySpark, SQL, and programming languages such as Java or Scala.
- Exhibits strong understanding of data lakes, data warehouses, and analytics architectures.
- Demonstrates experience with containerization using Docker and orchestration using Kubernetes.
- Applies knowledge of CI/CD pipelines, version control, and collaborative development practices.
- Shows understanding of APIs, microservices, and distributed systems.
- Demonstrates familiarity with LLM-based solutions, prompt engineering, and RAG frameworks.
- Exhibits strong analytical, problem-solving, and communication skills.
Education: Bachelor's or Master's degree in Computer Science or a related technical field.