EY - GDS Consulting - AI And DATA - GCP - Senior

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. The opportunity We are seeking an experienced GCP Data Engineer with strong technology and data understanding in GCP engineering space, having proven delivery capability. The candidate will be responsible for building, maintaining, and optimizing data pipelines and data platforms on Google Cloud (Big Query). The role will focus on data ingestion, transformation, orchestration, automation, and analytics enablement for enterprise-scale solutions. Your Technical responsibilities: Design and develop scalable ETL/ELT pipelines on GCPBuild and maintain data ingestion and transformation frameworks using BigQuery and GCP servicesDevelop Cloud Functions and automation scripts for data movement and processingCreate and maintain workflows using Cloud Composer/AirflowImplement data reconciliation, validation, and data quality controlsTroubleshoot pipeline failures and performance issues using monitoring and logging toolsSupport migration of on-premises or legacy workloads to GCPCreate dashboards, reports, and analytics solutions for business usersCollaborate with business, architecture, and development teams to deliver data-driven solutions.Use Data flow or STS to build pipeline from traditional and cloud source to GCP.Good understanding of cloud design considerations and FinOps Proficient in a modern scripting language like Python, Spark and Scala.Work with container technology such as Docker, version control systems (Github), build management and CI/CD tools (Concourse, Jenkins)Data Pipeline Workflows: Build and maintain data pipelines using tools and services like Dataflow, Dataproc, Apache Beam, Apache Airflow, Cloud Composer, etc. to collect, process, and distribute data.CI/CD Implementation: Implement CI/CD pipelines for data applications using services like Cloud Build, Jenkins, or Gitlab. Continuous testing, continuous integration, build, package, and deployment should be automated across multi-cloud environments.Code Management: Take charge of source code repositories like GitHub or Bitbucket, ensuring robust version control practices.Data Security & Compliance: Implement security best practices. Handle actions such as encryption, managing and securing service accounts, secret management (like with Secret Manager), authentication, access control, and data compliance necessities (like GDPR).Performance Optimization and Cost Control: Monitor, debug, troubleshoot, and optimize performance of Dataflow jobs, and other data infrastructure. Implement strategies for optimizing cost across multiple clouds.Data Lakes and Data Warehouses Management: Manage BigQuery or other cloud data warehouse solutions and services for Data Lakes. Mandatory Requirements (Qualifications) We are looking for the candidates with the following: BE/BTech/MCA with a sound industry experience of 5 to 8 years36+ years of Data Engineering experience with hands-on GCP implementationProgramming Language- Python, SQL, Spark (PySpark)Experience in FS domain- preferably asset wealth managementExperience with CI/CD pipelines and cloud-native development practices.Exposure to Apache Spark, Databricks, and modern data engineering frameworks.Strong communication skillsGoogle Cloud Certified is add-on EY | Building a better working world EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets. Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate. Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today. At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. The opportunity We are seeking an experienced GCP Data Engineer with strong technology and data understanding in GCP engineering space, having proven delivery capability. The candidate will be responsible for building, maintaining, and optimizing data pipelines and data platforms on Google Cloud (Big Query). The role will focus on data ingestion, transformation, orchestration, automation, and analytics enablement for enterprise-scale solutions. Your Technical responsibilities: Design and develop scalable ETL/ELT pipelines on GCPBuild and main