Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholders, utilizing big data tools, implementing real-time data processing, ensuring data governance and security, documenting data architecture, and delivering data-driven insights.
- Design and implement data pipelines to collect, process, and store data efficiently.
- Ensure data quality, integrity, and accessibility.
- Create data models to support business analytics and reporting.
- Work with data scientists, analysts, and other stakeholders to understand data needs, and design schemas.
- Build and manage ETL (Extract, Transform, Load) processes for data integration and automate data ingestion and transformation tasks.
- Administer and optimize databases (both SQL and NoSQL). Monitor database performance and troubleshoot issues.
- Collaborate with software engineers to integrate data systems with applications.
- Utilize big data tools for processing large datasets, such as Hadoop or Spark.
- Implement distributed systems for real-time data processing.
- Ensure data governance and security through compliance with data governance policies and data security standards.
- Implement data access controls and encryption techniques.
- Document data architecture, pipelines, and processes.
- Provide reports and insights based on data analysis.
Education: Bachelors degree or equivalent in Computer Science, MIS, or similar discipline. Accreditation: Specific business accreditation for Business Intelligence.
Experience: Relevant work experience in data engineering based on the following number of years: Associate: Prior experience not required; Standard I: Two (2) years; Standard II: Three (3) years; Senior I: Four (4) years; Senior II: Five (5) years
Knowledge, Skills and Abilities
- Fluency in English
- Analytical Skills
- Accuracy Attention to Detail
- Numerical Skills
- Planning Organizing Skills
- Presentation Skills
Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
5-7 years96
Get Personalized Job Matches with 1 Click
Job Description
Download ResumeResponsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholders, utilizing big data tools, implementing real-time data processing, ensuring data governance and security, documenting data architecture, and delivering data-driven insights.
- Design and implement data pipelines to collect, process, and store data efficiently.
- Ensure data quality, integrity, and accessibility.
- Create data models to support business analytics and reporting.
- Work with data scientists, analysts, and other stakeholders to understand data needs, and design schemas.
- Build and manage ETL (Extract, Transform, Load) processes for data integration and automate data ingestion and transformation tasks.
- Administer and optimize databases (both SQL and NoSQL). Monitor database performance and troubleshoot issues.
- Collaborate with software engineers to integrate data systems with applications.
- Utilize big data tools for processing large datasets, such as Hadoop or Spark.
- Implement distributed systems for real-time data processing.
- Ensure data governance and security through compliance with data governance policies and data security standards.
- Implement data access controls and encryption techniques.
- Document data architecture, pipelines, and processes.
- Provide reports and insights based on data analysis.
Education: Bachelors degree or equivalent in Computer Science, MIS, or similar discipline. Accreditation: Specific business accreditation for Business Intelligence.
Experience: Relevant work experience in data engineering based on the following number of years: Associate: Prior experience not required; Standard I: Two (2) years; Standard II: Three (3) years; Senior I: Four (4) years; Senior II: Five (5) years
Knowledge, Skills and Abilities
- Fluency in English
- Analytical Skills
- Accuracy Attention to Detail
- Numerical Skills
- Planning Organizing Skills
- Presentation Skills
Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.