Data Engineer (GCP)

As a Data Engineer specializing in Google Cloud Platform (GCP), BigQuery, and Looker, you will be responsible for designing and managing data solutions to facilitate data-driven decision-making within the organization. Your role will involve developing scalable data pipelines, optimizing data models, and creating insightful dashboards. Here is a breakdown of your responsibilities: - Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on GCP using services like Dataflow, Cloud Composer, Dataproc, Pub/Sub, and Cloud Functions. - Develop, optimize, and manage data warehouse solutions in BigQuery, including schema design, partitioning, clustering, and materialized views. - Write and optimize complex SQL queries on BigQuery for large-scale datasets to ensure cost-efficient and high-performance query execution. - Build and maintain semantic models in Looker using LookML, including explores, views, derived tables (PDTs), and data governance layers. - Design and develop Looker dashboards, looks, and reports to provide actionable business insights. - Implement data ingestion from various sources (databases, APIs, files, streaming) into the GCP data platform. - Ensure data quality, validation, lineage, and consistency across pipelines and reporting layers. - Manage security, IAM roles, access controls, and data governance policies on GCP and Looker. - Monitor pipeline and warehouse performance, troubleshoot failures, and optimize for cost and reliability. - Automate workflows and infrastructure using scripting and tools like Terraform and CI/CD pipelines. - Collaborate with business stakeholders, analysts, and product teams to translate requirements into data models and dashboards. - Prepare and maintain technical documentation, data dictionaries, and best-practice standards. - Participate in code reviews and contribute to the continuous improvement of data engineering practices. In terms of qualifications, you should ideally possess: - Bachelors degree in Computer Science, Information Technology, Engineering, or a related field (B.Tech / B.E. / MCA / M.Tech). - 46 years of experience in data engineering, with at least 23 years working with GCP and BigQuery. - Hands-on experience with Looker and LookML development on real-world projects. - GCP certification (e.g., Professional Data Engineer) would be an added advantage. Your soft skills should include: - Strong analytical and problem-solving abilities. - Excellent verbal and written communication skills for effective interaction with business stakeholders. - Ability to work independently and collaboratively in cross-functional teams. - Detail-oriented with a focus on data accuracy and quality. - Proactive attitude and willingness to learn new cloud and data technologies. Please note that this is a full-time role based in Noida, Uttar Pradesh, with a requirement for candidates to work from the office five days a week. If you are not currently based in Noida or the Delhi NCR region, you should be willing to relocate. As a Data Engineer specializing in Google Cloud Platform (GCP), BigQuery, and Looker, you will be responsible for designing and managing data solutions to facilitate data-driven decision-making within the organization. Your role will involve developing scalable data pipelines, optimizing data models, and creating insightful dashboards. Here is a breakdown of your responsibilities: - Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on GCP using services like Dataflow, Cloud Composer, Dataproc, Pub/Sub, and Cloud Functions. - Develop, optimize, and manage data warehouse solutions in BigQuery, including schema design, partitioning, clustering, and materialized views. - Write and optimize complex SQL queries on BigQuery for large-scale datasets to ensure cost-efficient and high-performance query execution. - Build and maintain semantic models in Looker using LookML, including explores, views, derived tables (PDTs), and data governance layers. - Design and develop Looker dashboards, looks, and reports to provide actionable business insights. - Implement data ingestion from various sources (databases, APIs, files, streaming) into the GCP data platform. - Ensure data quality, validation, lineage, and consistency across pipelines and reporting layers. - Manage security, IAM roles, access controls, and data governance policies on GCP and Looker. - Monitor pipeline and warehouse performance, troubleshoot failures, and optimize for cost and reliability. - Automate workflows and infrastructure using scripting and tools like Terraform and CI/CD pipelines. - Collaborate with business stakeholders, analysts, and product teams to translate requirements into data models and dashboards. - Prepare and maintain technical documentation, data dictionaries, and best-practice standards. - Participate in code reviews and contribute to the continuous improvement of data engineering practices. In terms of qualifications,