Padmi

Senior Big Data Engineer (10 + Years)

IndiaPosted 1 month ago
Software engineeringSeniorFull Time
Apply at mindbrain

Opens the source posting on foundit.in

Source description

About the role

View original

Job Title: Senior Data Engineer – Technical Lead (GCP) Experience: 10+ Years Location: Remote (Candidate must collect company assets from the client location) Shift Timing: 2:00 PM – 11:00 PM IST About the Role We are looking for an experienced Senior Data Engineer – Technical Lead to lead a Business-As-Usual (BAU) Data Engineering team responsible for maintaining, optimizing, and enhancing production data pipelines on Google Cloud Platform (GCP) . This is a hands-on technical leadership role where you will drive operational excellence, mentor a team of data engineers, troubleshoot production issues, optimize Airflow pipelines, and ensure smooth delivery of reliable data solutions from Data Lake to Enterprise Data Warehouse. Key Responsibilities Technical Leadership Lead and mentor an offshore Data Engineering BAU team. Provide technical guidance and ensure alignment with engineering best practices. Collaborate effectively with US stakeholders during overlapping working hours. Production Support & Incident Management Act as the highest escalation point for production data issues. Troubleshoot and resolve complex pipeline failures. Perform root cause analysis and implement permanent fixes. Data Pipeline Management Manage end-to-end data movement from Data Lake → Dimensions/Facts → Data Warehouse . Implement SQL fixes, Airflow DAG enhancements, data backfills, and validation processes. Optimize pipeline performance and ensure data reliability. Change & Release Management Execute production deployments with proper testing and rollback strategies. Maintain documentation and deployment evidence. Follow ITIL and Change Management best practices. Continuous Improvement Identify recurring production issues and automate solutions using Python and SQL. Reduce manual intervention through process optimization. Improve monitoring, performance, and operational efficiency. Required Skills Mandatory Skills SQL Server Python Apache Airflow / Cloud Composer Hadoop Google BigQuery Data Lake Google Cloud Platform (GCP Required Experience 10+ years of Data Engineering experience. Proven experience leading technical teams or acting as a Technical Lead. Extensive hands-on experience with production support in enterprise data environments. Strong expertise in SQL optimization, Airflow orchestration, and Python development. Experience working with global stakeholders and supporting US business hours.

One address, no account. We’ll tell you when matching roles go live.

More at mindbrain

Related open roles

View all roles
Senior Big Data Engineer (10 + Years) at mindbrain · Padmi