Big Data Developer

PROJECT:

Compliance IT brings together all areas of financial crime risk management at Client and is dedicated to implementing the most effective global standards to combat financial crime.

FCTM IT is using cutting edge Big Data technology to build tools that enable a global network of Investigators, Intelligence Analysts and Data Scientists to conduct effective intelligence-based investigations. The team covers 20+ live IT Systems and includes +400 IT professionals.

Global Social Network Analytics (GSNA) platform can identify potential financial crime networks in near-real time based on data from billions of transactions in more than 50 countries.

The team is based across China, India, Poland and the UK.

Role overview

The developer will work with the team to research and develop server side components to solve complex data cleansing, entity resolution, network graph building and graph querying problems on a very large (Big Data) scale in a highly performant way.

Key Accountabilities:

• Designing and contributing to the implementation of complex algorithms,

• Responsible for implementing Scala solutions on Hadoop (Spark) and GraphX (Spark GraphDB), development of Elastic Search components may also be required.

• Complex data engineering pipelines,

• Integrate solution with other components of the wider programme,

• Identify and develop the Technical Design documents,

• Provide prioritization, planning, estimating, work assignments, quality assurance,

• Working closely with Project Managers, Technical Leads, Data analysts, server and web developers, QA engineers, and Business Analysts throughout the project lifecycle.

Requirements

• • Development experience in Scala; desired – Hadoop & Spark,

• • Strong development experience in big data processing systems,

• • Overall a good general technical knowledge,

• • Experience in social network analysis,

• • Experience on Google Cloud Platform – nice to have,

• • Skilled at generating actionable insights from data,

• • Strong mathematical background,

• • Developing, iterating and production sing complex data models,

• • Elastic Search/Lucene

• • Hive/SparkSQL. Division: eTeam Workforce Limited Reference: 22-03893