Senior Big Data Engineer

Senior Big Data Engineer is an integral part of the Data Science Innovation team that works closely with Internal/External customer in all phases of the development Work with key stakeholders and understand their needs to develop new or improve existing solutions around data and analytics Work in a cross-functional, matrix organization, at times under ambiguous circumstances Partner in development of scalable solutions using large datasets with other data scientists on the teamResearch innovative data solutions to solve real market problems Conceptualize, analyze and develop actionable recommendations for strategic challenges facing the organization Manage data analysis to develop fact-based recommendations for innovation projects Mine Big Data and other unstructured data to tap untouched data sources and deliver insight into new and emerging solutions Work with cross-functional teams to develop ideas and execute business plans Remain current on new developments in data analytics, Big Data, predictive analytics, and technology .Education, Experience, Skills and Abilities Required for Consideration as a Candidate: BTech/MCA degree or higher. Minimum 5 year experience. Candidates must be proficient in -Java, Scala, Python Apache Spark, Hadoop, Hive, Spark SQL, Spark Streaming, Apache KafkaWell versed in various Predictive Algorithms, MllibCassandra, RDMS (MYSQL, MS SQL, etc.), NOSQL, Columnar Databases, Big table. Demonstrate a deep understanding of search engine technology. Ability to configure, index and maintain enterprise scale search applications. Proficient in writing custom handlers for Elasticsearch/Solr. Agile development including Scrum and other lean techniques. Excellent problem solving skills with the ability to design algorithms, which may include data cleaning, data mining, data clustering and pattern recognition methodologies Ability to work cross-functionally in a highly matrix driven organization, at times under ambiguous circumstances Personal qualities desired: creativity, tenacity, curiosity, and passion for deep technical excellence.