Spark Developer

Infracloud is hiring for the role of Spark Developer! Responsibilities of the Candidate: Contribute fixes and enhancements to the Apache Spark open-source project. Upgrade and maintain compatibility with newer Spark releases. Optimize Spark internals for performance, scalability, and reliability. Design and develop distributed data processing solutions. Debug complex Spark-related performance and stability issues. Collaborate with product and platform teams on architecture and technical initiatives. Requirements: Strong experience with Apache Spark internals and distributed systems. Hands-on experience contributing to open-source projects. Strong Java and/or Scala programming skills. Expertise in query execution, distributed processing, and performance optimization. Strong debugging and problem-solving abilities. Ability to work independently and drive technical initiatives. Good to Have: Experience with Kubernetes and cloud-native environments. Knowledge of JVM tuning and system optimization. Contributions to Apache or other open-source communities. Experience with large-scale analytics or data platforms.