Big Data Developer

Job Description: Experience in working on Spark framework, good understanding of core concepts, optimizations, and best practices Good hands-on experience in writing code in PySpark, should understand design principles and OOPS Good experience in writing complex queries to derive business critical insights Hands-on experience on Stream data processing Understanding of Data Lake vs Data Warehousing concept Knowledge on Machin learning would be an added advantag Experience in NoSQL Technologies – MongoDB, Dynamo DB Good understanding of test driven development Flexible to learn new technologies Roles & Responsibilities: Design and implement solutions for problems arising out of large-scale data processing Attend/drive various architectural, design and status calls with multiple stakeholders Ensure end-to-end ownership of all tasks being aligned including development, testing, deployment and support Design, build & maintain efficient, reusable & reliable code Test implementation, troubleshoot & correct problems Capable of working as an individual contributor and within team too Ensure high quality software development with complete documentation and traceability Fulfil organizational responsibilities (sharing knowledge & experience with other teams/ groups)