Source description
About the role
As a Senior Data Engineer at our esteemed client of KHOOBI CONSULTING, you will be responsible for designing and delivering enterprise-scale data platforms on Google Cloud Platform (GCP) with a focus on BigQuery. Your expertise in cloud-native data engineering, data modeling, and performance optimization will be crucial for this role. Key Responsibilities: - Design and implement scalable data architectures on Google Cloud Platform - Build and optimize high-performance data pipelines using BigQuery - Develop robust ETL/ELT frameworks and reusable components - Optimize BigQuery performance through techniques such as partitioning, clustering, and cost optimization - Lead data modeling efforts including dimensional modeling and star/snowflake schemas - Ensure data governance, security, and compliance are maintained - Integrate data from various sources including APIs, streaming, and batch systems - Mentor junior engineers and promote best practices within the team - Collaborate closely with stakeholders in analytics, business intelligence, and AI teams Required Skills: - Hands-on experience with Google Cloud Platform (GCP ecosystem) - Deep expertise in BigQuery including query optimization and architecture design - Advanced SQL and data modeling skills - Proficiency in Python/Scala for data engineering tasks - Familiarity with orchestration tools like Apache Airflow - Practical experience with GCP services such as Dataflow Pub/Sub, Cloud Storage, and Dataproc Good to Have: - Experience with building streaming pipelines for real-time data processing - Knowledge of data governance frameworks - Exposure to machine learning pipelines or AI platforms - Prior experience in the BFSI domain is preferred - Familiarity with tools like dbt In this role, you are expected to: - Drive architectural decisions - Define data engineering standards and best practices - Mentor and upskill team members - Ensure scalability, reliability, and cost efficiency of solutions What We Expect from you: - Strong ownership mindset - Ability to tackle complex data challenges - Excellent communication skills with both business and technical teams - Experience in delivering enterprise-scale solutions (Note: The additional details of the company are not present in the provided job description) As a Senior Data Engineer at our esteemed client of KHOOBI CONSULTING, you will be responsible for designing and delivering enterprise-scale data platforms on Google Cloud Platform (GCP) with a focus on BigQuery. Your expertise in cloud-native data engineering, data modeling, and performance optimization will be crucial for this role. Key Responsibilities: - Design and implement scalable data architectures on Google Cloud Platform - Build and optimize high-performance data pipelines using BigQuery - Develop robust ETL/ELT frameworks and reusable components - Optimize BigQuery performance through techniques such as partitioning, clustering, and cost optimization - Lead data modeling efforts including dimensional modeling and star/snowflake schemas - Ensure data governance, security, and compliance are maintained - Integrate data from various sources including APIs, streaming, and batch systems - Mentor junior engineers and promote best practices within the team - Collaborate closely with stakeholders in analytics, business intelligence, and AI teams Required Skills: - Hands-on experience with Google Cloud Platform (GCP ecosystem) - Deep expertise in BigQuery including query optimization and architecture design - Advanced SQL and data modeling skills - Proficiency in Python/Scala for data engineering tasks - Familiarity with orchestration tools like Apache Airflow - Practical experience with GCP services such as Dataflow Pub/Sub, Cloud Storage, and Dataproc Good to Have: - Experience with building streaming pipelines for real-time data processing - Knowledge of data governance frameworks - Exposure to machine learning pipelines or AI platforms - Prior experience in the BFSI domain is preferred - Familiarity with tools like dbt In this role, you are expected to: - Drive architectural decisions - Define data engineering standards and best practices - Mentor and upskill team members - Ensure scalability, reliability, and cost efficiency of solutions What We Expect from you: - Strong ownership mindset - Ability to tackle complex data challenges - Excellent communication skills with both business and technical teams - Experience in delivering enterprise-scale solutions (Note: The additional details of the company are not present in the provided job description)
More at KHOOBI CONSULTING