Source description
About the role
As a highly skilled Data Engineer at Cloudsufi, you will spearhead data modernization initiatives by designing and executing complex data migrations and building scalable, secure data pipelines within the Google Cloud Platform (GCP) ecosystem. You will bridge the gap between architectural design and implementation, ensuring that the data infrastructure is robust, cost-effective, and secure. Key Responsibilities: - Lead GCP-based projects with at least 3+ years of experience in Data Engineering. - Successfully move large-scale production datasets across environments. - Mentor junior engineers and lead technical sprints. - Communicate complex technical trade-offs to non-technical stakeholders. - Proactively identify bottlenecks in the data lifecycle. - Work with US/Europe-based clients in an onsite/offshore delivery model. Qualifications Required: - Expert-level proficiency in Google Cloud Platform (GCP). - Advanced skills in BigQuery including SQL, optimization, and administration. - Hands-on experience with Cloud Composer (Apache Airflow) for orchestration. - Proficiency in Dataform and Cloud Data Fusion for ETL/ELT processes. - Expertise in SQL including complex joins, CTEs, and window functions. - Fair to solid proficiency in Python for scripting and Airflow DAGs. - Deep understanding of IAM, Service Accounts, and Secret Manager for security and ops. - Fair understanding of GCP Networking including VPC and Cloud SQL Auth Proxy. About Cloudsufi: Cloudsufi is the company that posted this job opportunity for a Data Engineer. As a highly skilled Data Engineer at Cloudsufi, you will spearhead data modernization initiatives by designing and executing complex data migrations and building scalable, secure data pipelines within the Google Cloud Platform (GCP) ecosystem. You will bridge the gap between architectural design and implementation, ensuring that the data infrastructure is robust, cost-effective, and secure. Key Responsibilities: - Lead GCP-based projects with at least 3+ years of experience in Data Engineering. - Successfully move large-scale production datasets across environments. - Mentor junior engineers and lead technical sprints. - Communicate complex technical trade-offs to non-technical stakeholders. - Proactively identify bottlenecks in the data lifecycle. - Work with US/Europe-based clients in an onsite/offshore delivery model. Qualifications Required: - Expert-level proficiency in Google Cloud Platform (GCP). - Advanced skills in BigQuery including SQL, optimization, and administration. - Hands-on experience with Cloud Composer (Apache Airflow) for orchestration. - Proficiency in Dataform and Cloud Data Fusion for ETL/ELT processes. - Expertise in SQL including complex joins, CTEs, and window functions. - Fair to solid proficiency in Python for scripting and Airflow DAGs. - Deep understanding of IAM, Service Accounts, and Secret Manager for security and ops. - Fair understanding of GCP Networking including VPC and Cloud SQL Auth Proxy. About Cloudsufi: Cloudsufi is the company that posted this job opportunity for a Data Engineer.
More at CLOUDSUFI INC