Data Engineer (GCP)

We are seeking a skilled Data Engineer to join the AI Platform Capabilities team supporting the UDP Uplift program. In this role, you will design, build, and test standardized data and AI platform capabilities across a multi-cloud environment (Azure & GCP). You will collaborate closely with AI use case teams to develop: Scalable data pipelinesReusable data productsFoundational data infrastructureYour work will support advanced AI solutions such as: GenAIRAG (Retrieval-Augmented Generation)Document IntelligenceKey Responsibilities Design and develop scalable ETL/ELT pipelines for AI workloadsBuild and optimize data pipelines for structured & unstructured dataEnable context processing & vector store integrationsSupport streaming data workflows and batch processingEnsure adherence to enterprise data models, governance, and security standardsCollaborate with DataOps, MLOps, Security, and business teams (LBUs)Contribute to data lifecycle management for AI platformsRequired Skills 57 years of hands-on experience in Data EngineeringStrong expertise in Python and advanced SQLExperience with GCP and/or Azure cloud-native data servicesHands-on experience with PySpark / Spark SQLExperience building data pipelines for ML/AI workloadsUnderstanding of CI/CD, Git, and Agile methodologiesKnowledge of data quality, governance, and security practicesStrong collaboration and stakeholder management skillsNice-to-Have Skills Experience with Vector Databases / Vector Stores (for RAG pipelines)Familiarity with MLOps / GenAIOps concepts (feature stores, model registries, prompt management)Exposure to Knowledge Graphs / Context Stores / Document Intelligence workflowsExperience with DBT (Data Build Tool)Knowledge of Infrastructure-as-Code (Terraform)Experience in multi-cloud deployments (Azure + GCP)Familiarity with event-driven systems (Kafka, Pub/Sub) & API integrationsIdeal Candidate Profile Strong data engineering foundation with AI/ML exposureExperience working in multi-cloud environmentsAbility to build production-grade, scalable data systemsComfortable working in cross-functional, fast-paced environments We are seeking a skilled Data Engineer to join the AI Platform Capabilities team supporting the UDP Uplift program. In this role, you will design, build, and test standardized data and AI platform capabilities across a multi-cloud environment (Azure & GCP). You will collaborate closely with AI use case teams to develop: Scalable data pipelinesReusable data productsFoundational data infrastructureYour work will support advanced AI solutions such as: GenAIRAG (Retrieval-Augmented Generation)Document IntelligenceKey Responsibilities Design and develop scalable ETL/ELT pipelines for AI workloadsBuild and optimize data pipelines for structured & unstructured dataEnable context processing & vector store integrationsSupport streaming data workflows and batch processingEnsure adherence to enterprise data models, governance, and security standardsCollaborate with DataOps, MLOps, Security, and business teams (LBUs)Contribute to data lifecycle management for AI platformsRequired Skills 57 years of hands-on experience in Data EngineeringStrong expertise in Python and advanced SQLExperience with GCP and/or Azure cloud-native data servicesHands-on experience with PySpark / Spark SQLExperience building data pipelines for ML/AI workloadsUnderstanding of CI/CD, Git, and Agile methodologiesKnowledge of data quality, governance, and security practicesStrong collaboration and stakeholder management skillsNice-to-Have Skills Experience with Vector Databases / Vector Stores (for RAG pipelines)Familiarity with MLOps / GenAIOps concepts (feature stores, model registries, prompt management)Exposure to Knowledge Graphs / Context Stores / Document Intelligence workflowsExperience with DBT (Data Build Tool)Knowledge of Infrastructure-as-Code (Terraform)Experience in multi-cloud deployments (Azure + GCP)Familiarity with event-driven systems (Kafka, Pub/Sub) & API integrationsIdeal Candidate Profile Strong data engineering foundation with AI/ML exposureExperience working in multi-cloud environmentsAbility to build production-grade, scalable data systemsComfortable working in cross-functional, fast-paced environments