Big Data Engineer

Design and develop large scale data architectures, reusable frameworks and components picking best in class technologies Marry the business requirements with technology, considering best possible performance and doing a thorough gap analysis Perform PoCs to accelerate development and help the team get past any technical roadblock Optimise performance of the deployments and troubleshoot issues along with the team Setup and deploy development and production environments with appropriate monitoring and alerting Identify NFRs in the architecture and choose the right technology to suffice Represent company and its technical expertise in customer interactions at different levels including CxOs Design, debate and Review architectures across the organisation Work along with the team, promoting and educating architecture, its best practices and standards. Closely work with the business team balancing the timeline with the deliverables About the role Do High and low level technical designs for projects in different technical areas like, real time analytics, data warehousing, data lakes. Build and deploy cloud native solutions on AWS Have expertise in deployment automation and ML workflows Have extensive technical expertise in AWS Big data Stack, distributed computing using technologies like Spark, Storm, Flink and schema design for Data Warehouses using column oriented DWH like Redshift Optimise performance of the deployed solution in terms of Processing Time, Query Runtimes, Read/Write Performance Balance cost with the technical solution to give a cost and performance optimised solution Actively Participate in Requirement Gathering with the Product owner Guide and Educate the team during the course of the project on different technical aspects Help the team debug, resolve and correctly estimate the stories Identify risks and spikes upfront and help the team resolve them before Iteration start Ensure code and design quality at all levels in the solution by doing regular reviews and inspections Have decent technical know how of serverless architectures and frontend technologies Active participation and keen interest in growing in the technical space Have excellent written and oral communication skills Added bonuses you have... Knowledge of GCP/Azure Knowledge of SQL Knowledge of any other language apart from python Java or Scala