Big Data Developer

Bachelor s degree in Computer Science or a related stream Bachelor s degree in Computer Science or a related stream Responsibilities Understand the problem statement, client requirements and design and build complex solutions using Programming languages and Big Data service platform Translate business requirements into technical terms and drive team effort to design, build and manage technology solutions that solve business problems Implementing and enhancing Big Data pipeline for Data Ingestion, Processing (ETL frameworks) Consumption using Spark HIVE Work closely with technology on solutions to resolve identified production issues which are impacting existing infrastructure/solution covering data quality, data assurance, refresh timeliness, data security governance Extend analytics support spanning across entire gamut of business (Customer Acquisition, Portfolio Management, New Product Development) Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Required Skill Set and Experience Hands-on expertise in extracting and processing large volumes of data using Big Data technologies like Hadoop, Spark, Hive etc Strong coding skills in Python with Spark is a MUST. Handle the installation, configuration, and supporting of Hadoop.