Ab Initio Developers

Ab Initio Developer

Location: Northampton

Duration: until 31st December

Key Accountabilities

• Ab Initio ETL Designer, you will be able to develop complicated Ab Initio ETL processes to turn business requirements into Technology data solutions.

• You will provide technically sound solutions for the ingestion, storage and presentation of enterprise data including ETL design, data storage strategies, data access and security in line with Business requirements/processes and create Analytical Ready Data.

• You will drive the design of scalable solutions while considering recoverable and resiliency requirements.

• You will employ agile techniques such as task estimation, test automation, deployment automation and continuous integration to enhance overall execution speed and product quality.

• You will convert source to target mappings into ETL code.

• You will collaborate with the data modellers and contribute to the physical data model design.

• You will ensure to work in line with Global Data Management Standards and follow all Governance Controls as required for your work.

• SOX/DQ - Performing gap analysis between existing SOX/DQ controls and the data governance/data reconciliation.

• Lineage- Work with SOX Tech delivery team and ensure the lineage captured and Reconciliation between hops are documented.

• Design and implement physical data and metadata repositories in Hive/Impala/HBase (as appropriate) corresponding to logical data models

• Design and implement data service layer in Hadoop

• Replicate data from current RDBMS based systems to the RFT Hadoop Data Lakes

• Utilise Dev-Ops framework during the development activities

Essential Skills/Basic Qualifications:

• Passion for programming and software development

• Extensive knowledge of Ab Initio ETL development in Big Data world specially in Hadoop eco system

• Knowledge of Hadoop Ecosystem– Cloudera distribution is preferred. Knowledge of key Hadoop components mainly HDFS, Zookeeper, YARN, HBASE, Hive, Impala, Spark SQL

• Knowledge of software development using Python, Scala, Spark and Java is critical to this role.

• Usage of DevOps tools and knowledge of it is key to success in this role.

• Working knowledge on Teradata and Oracle databases.

• Experience in creating Narrative documents for Governance to prove existing Controls work.

• Experience in data modelling with good SQL skills in at least 1 enterprise grade RDBMS

• Experience in Test/Behaviour Driven Development (including test automation and mocking tools)

• Strong project and stakeholder management skillset.

• Has an eye for data quality issues and providing solution to resolve and remediate Division: J&C Associates Ltd - EUR Reference: 20-05544