Manager Data Engineering (Big Data)

As a hands-on Big Data Technical Lead, your role involves owning the end-to-end technical design and architecture of batch and streaming data pipelines. You will lead the development of high-throughput, low-latency data processing systems using Java and design real-time streaming solutions. Your responsibilities also include driving code quality, performance optimization, and scalability across systems, reviewing code, mentoring engineers, and collaborating with various teams to deliver production-grade solutions. Automation of operational workflows, participation in capacity planning, and staying updated with evolving Big Data technologies are also crucial aspects of your role. Key Responsibilities: - Own end-to-end technical design and architecture of batch and streaming data pipelines - Lead development of high-throughput, low-latency data processing systems using Java - Design and implement real-time streaming solutions - Drive code quality, performance optimization, and scalability - Review code, mentor engineers, and set engineering best practices - Collaborate with cross-functional teams for delivering production-grade solutions - Ensure data reliability, fault tolerance, and observability - Automate operational workflows and deployment pipelines - Participate in capacity planning and system tuning - Stay current with evolving Big Data and streaming ecosystems Qualifications Required: - Strong proficiency in Java (multithreading, concurrency, JVM tuning) - Hands-on experience with distributed data processing frameworks like Apache Spark and Apache Kafka - Solid understanding of batch + streaming architectures - Experience with Hadoop ecosystem components and relational databases - Knowledge of NoSQL / distributed datastores and Linux-based systems - Exposure to containerization, orchestration, monitoring, and observability tools - Experience with CI/CD pipelines, automated testing frameworks, and leading technical teams - Strong problem-solving and debugging skills in complex distributed systems - Excellent communication skills to work with cross-functional stakeholders If you are passionate about leading technical teams, driving automation, and reliability at scale, and enabling data-driven innovation, this Lead Big Data DevOps Engineer role offers you the opportunity to work on large-scale, real-time data systems, have high technical ownership, and shape next-generation streaming and analytics platforms. Benefits include a competitive salary and benefits package, leadership role in building and scaling next-generation Big Data platforms, working with cutting-edge technologies, professional growth through challenging projects, and continuous learning. As a hands-on Big Data Technical Lead, your role involves owning the end-to-end technical design and architecture of batch and streaming data pipelines. You will lead the development of high-throughput, low-latency data processing systems using Java and design real-time streaming solutions. Your responsibilities also include driving code quality, performance optimization, and scalability across systems, reviewing code, mentoring engineers, and collaborating with various teams to deliver production-grade solutions. Automation of operational workflows, participation in capacity planning, and staying updated with evolving Big Data technologies are also crucial aspects of your role. Key Responsibilities: - Own end-to-end technical design and architecture of batch and streaming data pipelines - Lead development of high-throughput, low-latency data processing systems using Java - Design and implement real-time streaming solutions - Drive code quality, performance optimization, and scalability - Review code, mentor engineers, and set engineering best practices - Collaborate with cross-functional teams for delivering production-grade solutions - Ensure data reliability, fault tolerance, and observability - Automate operational workflows and deployment pipelines - Participate in capacity planning and system tuning - Stay current with evolving Big Data and streaming ecosystems Qualifications Required: - Strong proficiency in Java (multithreading, concurrency, JVM tuning) - Hands-on experience with distributed data processing frameworks like Apache Spark and Apache Kafka - Solid understanding of batch + streaming architectures - Experience with Hadoop ecosystem components and relational databases - Knowledge of NoSQL / distributed datastores and Linux-based systems - Exposure to containerization, orchestration, monitoring, and observability tools - Experience with CI/CD pipelines, automated testing frameworks, and leading technical teams - Strong problem-solving and debugging skills in complex distributed systems - Excellent communication skills to work with cross-functional stakeholders If you are passionate about leading technical teams, driving automation, and reliability at scale, and enabling data-driven innovation, this Lead Big Data DevOps Engineer