Padmi

GCP Data Engineer/Architect

BangalorePosted 2 months ago
Infrastructure And DatabasesMid-levelFull Time; Regular
Apply at RARR Technologies Pvt. Ltd.

Opens the source posting on shine.com

Source description

About the role

View original

Mandatory Skills : GCP BigQuery, GCP Data Architecture, AWS Cloud Architecture, AWS Code Pipeline, Lead the architectural design of the Paramount FinOps Platform a layer including BigQuery project structure dataset zones Raw Transformation Serving and IAM modelDefine and document the FOCUS FinOps Open Cost and Usage Specification schema for normalizing billing data from AWS CUR 20 GCP BigQuery Export Azure Cost Management and OCI Cost ReportsArchitect the BigQuery StarRocks data transfer design raw billing tables and curated serving layer specifying table schemas incremental sync patterns and Airflow DAG structure for the PCO operational storeDesign the transformation pipeline architecture six transformation models BGBU attribution tag normalisation SPRICUD amortisation product taxonomy cost categorisation credit classification model dependencies and orchestrate transformation logic within the Cloud Composer Airflow DAGsDefine BigQuery RowLevel Security RLS architecture across System Roles and Business Roles ensuring every query is scoped to the users authorised dataArchitect the Cloud Composer Airflow DAG strategy ingestion pipeline transformation orchestration and BigQuery StarRocks export tasks Basic Qualifications Python engineer with experience in data pipeline architecture4 years GCP and BigQuery architecture experience3-4 years AWS and experience with multicloud billing dataExperience with Apache Airflow or Google Cloud ComposerKnowledge of FOCUS specification or billing normalization standardsExperience with Kubernetes Terraform and HelmExperience with CICD design using GitHub Actions Mandatory Skills : GCP BigQuery, GCP Data Architecture, AWS Cloud Architecture, AWS Code Pipeline, Lead the architectural design of the Paramount FinOps Platform a layer including BigQuery project structure dataset zones Raw Transformation Serving and IAM modelDefine and document the FOCUS FinOps Open Cost and Usage Specification schema for normalizing billing data from AWS CUR 20 GCP BigQuery Export Azure Cost Management and OCI Cost ReportsArchitect the BigQuery StarRocks data transfer design raw billing tables and curated serving layer specifying table schemas incremental sync patterns and Airflow DAG structure for the PCO operational storeDesign the transformation pipeline architecture six transformation models BGBU attribution tag normalisation SPRICUD amortisation product taxonomy cost categorisation credit classification model dependencies and orchestrate transformation logic within the Cloud Composer Airflow DAGsDefine BigQuery RowLevel Security RLS architecture across System Roles and Business Roles ensuring every query is scoped to the users authorised dataArchitect the Cloud Composer Airflow DAG strategy ingestion pipeline transformation orchestration and BigQuery StarRocks export tasks Basic Qualifications Python engineer with experience in data pipeline architecture4 years GCP and BigQuery architecture experience3-4 years AWS and experience with multicloud billing dataExperience with Apache Airflow or Google Cloud ComposerKnowledge of FOCUS specification or billing normalization standardsExperience with Kubernetes Terraform and HelmExperience with CICD design using GitHub Actions

One address, no account. We’ll tell you when matching roles go live.

More at RARR Technologies Pvt. Ltd.

Related open roles

View all roles