Data Engineer

The role involves full systems life cycle management, including analysis, design, coding, testing, and implementation of applications. Responsibilities include contributing to architecture design, technology planning, and integration for Applications Development (AD) projects. The position supports emerging technologies, ensures effective communication, and provides expertise in development, integration, and maintenance. Key Responsibilities Data Engineering: Design, implement, and optimize data pipelines using Google Cloud Platform (GCP) services (DataFlow, BigQuery, Cloud Pub/Sub, Cloud Storage), ShellScript, and CI/CD tools like Jenkins. Collaboration & Documentation: Gather requirements, define scope, and produce technical documentation. Data Quality & Governance: Implement best practices for data accuracy, consistency, and reliability. Performance Optimization: Monitor and optimize pipeline and query performance. Required Skills & Experience Technical Expertise: Minimum 4.5+ years in GCP, BigQuery, SQL, OpenShift, Python, Power BI. Strong understanding of data modeling, database design, and ETL processes. Experience integrating GCP with on-premises systems, other cloud services, and middleware. Ability to debug and resolve issues effectively. Excellent problem-solving, analytical, communication, and teamwork skills.