Source description
About the role
Technical
o Fundamentals of Spark using the Dataframe API
o Understanding partitioning of data
o Analysing and performance tuning Spark queries e.g. looking at the DAG
o Knowledge of Hadoop and its ecosystem of technologies especially Hive
o Python
o OOP concepts using Python
o Knowledge of Conditional Statements & Loops: If-else Control Structures, For/While Loops
o Demonstrate a comprehensive understanding of Complex Data Types: Shallow & Deep Copies, Working with Lists & Tuples, Dictionaries & Sets
o Understand Fundamental Data Structures & their Implementation
o Good knowledge of Exceptions & Command Line Arguments
o Contributes to quality assurance by writing unit and functional tests.
o Ensures development happens for all Software Components in accordance with Detailed Software Requirements specification, the functional design and the technical design document.
o Basic knowledge of UNIX
o Demonstrate source control knowledge (preferably GIT)
o Ability to analyse databases directly using query language tools such as SQL
o Experience on ETL process on Big Data
o Have an understanding of data relationships, normalisation
- Non-Technical
o Use of JIRA / Confluence
o Appreciation of release management and software maintenance
o Provides Level 3 support
o Contributes to problem and root cause analysis.
o Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).
o Strong analytical skills.
o Should have good understanding of architecture
o Ability to work in virtual teams
o Excellent team player and open minded approach
o Ability to share information, transfer knowledge and expertise to team members.
o Ability to design and write code in accordance with provided business requirements
o Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.
o Candidate is expected to have high desire to learn new technologies and implement various solutions in fast paced environment.
- Nice To Have
o Knowledge of control M
o Hands on experience of Team City
o Understanding of Financial Products
o Ability to interpret and write complex SQLs Job type: Contract Division: eTeam Workforce Limited Reference: 21-05210
More at eTeam