Data Engineer

Collaborates with Big Data Architect for product development by analyzing the requirement, development, testing and final delivery of product

Azure Databricks, Azure Data Factory, SQL experience

Significant experience in Big Data Technologies i.e. Apache Hadoop, Map Reduce, Hive, PIG, Sqoop, Flume etc.

Expert in Big Data concepts around Hadoop architecture and Hadoop Distributed File System, and Hadoop ecosystem

Leads small teams to deliver advanced data modelling and optimization at scale. Proficient in managing data from multiple sources

Adept at exploiting technologies to manage and manipulate data, scaling data models and solutions to support analytics of business insights

Can write high-performance, reliable and maintainable code and ability to write MapReduce jobs

Proficient in setting up and working with huge Big Data clusters, cluster monitoring, and maintenance

Coordinates with Big-Data Architect and Project manager to update about project status

Proficient in data retrieval using tools such as Hive and Impala. Possesses knowledge of workflow scheduler such as Oozie

Expert in programming languages such as Java, R, and Python. Knowledge of package/build tools such as ANT, Maven etc.

Must have worked as a senior contributing member in at least 2 to 3 mid to large-sized data projects

Should be aware of basic information security awareness protocols, software security in the SDLC lifecycle, and OWASP Top 10 concepts

Job type: Contract Division: eTeam Workforce Limited Reference: 22-06418