Lead Data Engineer - R01553055
Brillio
We do not know your resume yet
Upload your resume to unlock your actual match score and identify important JD keywords before applying.
Recruiters may search these ATS Keywords in your resume
Keywords
Job Description
Primary Skills
- GCP, Big Query, Python, Airflow, SQL, DBT
- About the Role
- We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and BigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.
- Key Responsibilities
- 1. Data Migration & Cloud Modernization
- Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
- Lead the migration of large-scale datasets to Google BigQuery.
- Design and implement data migration strategies ensuring data quality, integrity, and performance.
- 2. Data Integration & Streaming
- Integrate data from various structured and unstructured sources, including APIs, relational databases, and IoT devices.
- Build real-time streaming pipelines for large-scale ingestion and processing of IoT and telemetry data.
- 3. ETL / Data Pipeline Development
- Modernize and refactor legacy SSIS packages into cloud-native ETL pipelines.
- Develop scalable, reliable workflows using Apache Airflow, Python, Spark, and GCP-native tools.
- Ensure high-performance data transformation and loading into BigQuery for analytical use cases.
- 4. Programming & Query Optimization
- Write and optimize complex SQL queries, stored procedures, and scheduled jobs within BigQuery.
- Develop modular, reusable transformation scripts using Python, Java, Spark, and SQL.
- Continuously monitor and optimize query performance and cost efficiency in the cloud data environment.
- Required Skills & Experience
- 5+ years in Data Engineering with a strong focus on cloud and big data technologies.
- Minimum 2+ years of hands-on experience with GCP, specifically BigQuery.
- Proven experience migrating on-premise data systems to the cloud.
- Strong development experience with Apache Airflow, Python, and Apache Spark.
- Expertise in streaming data ingestion, particularly in IoT or sensor data environments.
- Strong SQL development skills; experience with BigQuery performance tuning.
- Solid understanding of cloud architecture, data modeling, and data warehouse design.
- Familiarity with Git and CI/CD practices for managing data pipelines.
- Preferred Qualifications
- GCP Professional Data Engineer certification.
- Experience with modern data stack tools like dbt, Kafka, or Terraform.
- Exposure to ML pipelines, analytics engineering, or DataOps/DevOps methodologies.
- Why Join Us
- Work with cutting-edge technologies in a fast-paced, collaborative environment.
- Lead cloud transformation initiatives at scale.
- Competitive compensation and benefits.
- Remote flexibility and growth opportunities.
About The Company
Brillio
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Founded in 2014 as a digitally native full-service digital transformation services and consulting firm, we apply our expertise in customer experience transformation, data analytics, Artificial Intelligence (AI), platform and product engineering, cloud infrastructure, and security to help clients quickly innovate for growth, create digital products, build service platforms, and drive smarter, data-driven performance. Headquartered in Edison, New Jersey, we are powered by a diverse global team of world-class professionals across the U.S., the UK, Romania, Canada, Mexico and India, and are certified a Great Place to Work®. We help clients harness the transformative potential of the four superpowers of technology: cloud computing, Internet of Things (IoT), AI, and mobility. We bring deep expertise across the full spectrum of digital capabilities: • Accelerating customer experience transformation to drive growth, customer advocacy, and superior customer experience • Powering intelligent enterprises by harnessing the potential of data, analytics, and AI • Crafting products of relevance with a product mindset and high-performance engineering • Enabling enterprise agility with resilient cloud infrastructure and security To learn more, please visit https://www.brillio.com/ and follow us here or @brillioglobal.
How to Apply Better for This Job
This section explains the correct next step without forcing sign-in immediately.
Check ATS score before applying
Scan your resume for ATS readability, formatting issues, missing sections, weak keywords, and content gaps.
Customize your resume for this JD
Match your resume with the job description and add Gcp , Sql , dbt , etl , gcp , keywords where they fit naturally.
Find similar jobs too
Do not depend on one opening. Use your resume to find similar frontend jobs across relevant job platforms.
Ready with your customized resume?
Once your resume includes the right skills and is ATS-friendly, you can apply directly on the source platform.
Market Insights:Best Data Engineer Jobs in India
Find the latest Data Engineer jobs across top Indian cities. Compare job counts by location and apply where hiring demand is higher.