Senior Software Engineer - Big Data

Responsibilities - Software Engineering: Write clean, concise, maintainable big data jobs. Comfortable authoring code on a distributed compute platform. Author clear and purposeful stories. Drive automation at every step from code to deploy. Problem Solving Capabilities using Data Structures and Algorithms. Promote best practices in development and operations. Ability to work in Agile environment. - Testing: Author unit, integration, and end-to-end tests. Perform load, scale, and performance tests. - Architecture: Understand and critique the overall platform architecture. Implement reusable algorithmic code. Offer constructive feedback on design documents from other team members. Bring a strong focus on innovation and the use of open source technologies. ### Qualifications: - 5+ years of hands-on software development with a bachelors degree in computer science, engineering or relevant field - Must have strong cloud Implementation expertise in cloud architecture. - Technologies: cloud: AWS(Must) - Workflow Orchestration: Airflow, Oozie - Containerization: Docker - Container Orchestration: Kubernetes, Swarm - Programming Languages: Scala(Preferable), Python(Preferable) - Big Data Frameworks: Spark, Hive, Flink, Hadoop, Map-Reduce - Persistence: PostgreSQL, MySQL ### Responsibilities - Software Engineering: Write clean, concise, maintainable big data jobs. Comfortable authoring code on a distributed compute platform. Author clear and purposeful stories. Drive automation at every step from code to deploy. Problem Solving Capabilities using Data Structures and Algorithms. Promote best practices in development and operations. Ability to work in Agile environment. - Testing: Author unit, integration, and end-to-end tests. Perform load, scale, and performance tests. - Architecture: Understand and critique the overall platform architecture. Implement reusable algorithmic code. Offer constructive feedback on design documents from other team members. Bring a strong focus on innovation and the use of open source technologies. ### Qualifications: - 5+ years of hands-on software development with a bachelors degree in computer science, engineering or relevant field - Must have strong cloud Implementation expertise in cloud architecture. - Technologies: cloud: AWS(Must) - Workflow Orchestration: Airflow, Oozie - Containerization: Docker - Container Orchestration: Kubernetes, Swarm - Programming Languages: Scala(Preferable), Python(Preferable) - Big Data Frameworks: Spark, Hive, Flink, Hadoop, Map-Reduce - Persistence: PostgreSQL, MySQL