Lead Data Engineer

Job Summary We are looking for a highly skilled Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and cloud-based data processing solutions for enterprise applications. Key Responsibilities • Design and develop scalable ETL/ELT pipelines using GCP services. • Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam. • Develop robust backend processing solutions using Java. • Work extensively with BigQuery for data warehousing, analytics, and performance optimization. • Integrate data from multiple sources including APIs, databases, and streaming platforms. • Optimize pipeline performance, cost, scalability, and reliability on GCP. • Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders. • Ensure data quality, governance, monitoring, and security best practices. • Troubleshoot production issues and provide long-term scalable solutions. Required Skills • Strong hands-on experience with GCP services. • Expertise in Google Dataflow / Apache Beam. • Strong programming skills in Java. • Hands-on experience with BigQuery. • Experience in building batch and streaming data pipelines. • Good knowledge of SQL and data modeling concepts. • Experience with CI/CD, Git, and Agile methodologies. • Strong problem-solving and debugging skills. Good to Have • Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka. • Exposure to Python or Spark. • Experience in handling large-scale enterprise data platforms. Preferred Qualifications • Bachelor’s/Master’s degree in Computer Science, Engineering, or related field. • GCP certifications are an added advantage.