Data Engineer

Required Qualifications:

4 plus years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.

Minimum 4 years of handon experience with:

Building data pipeline using bigdata stack (Hadoop, Hive, pySpark, python)

Amazon AWS S3 – Object storage, security, data service integration with S3

Data modelling and database design.

Job Scheduler – Autosys

PowerBI, Dremio

Unix/shell scripting, CICD pipeline

Exposure in GCP cloud data engineering is a plus.

Note:

Manager Notes:

The candidates need to be proactive; they can't wait to be told what to do

Must be accountable along with the technical skills

The tech stack mentioned, these are the technologies being used to build data pipelines

They need to model, design the data, build pipelines, applying logic to the data to transform the data and troubleshoot

They should have a strong understanding and implementation of Autosys

Ability to automate using spark, Python, Hadoop/Hive

Should have a fundamental background in database design (MySQL or any standard database)

Exposure to Cloud data engineering is a big plus, not required

Financial services experience is a plus, but not requiredhaving domain knowledge is helpful

Technical Assessment:

Client needs a clear understanding of tech work experience; they need to be able to describe the work they have done

Overall problem solving, so given a problem how efficiently does their thought process drive towards a solution?

PART OF THE PILOT PROGRAM:

Duration: 24month contract with possible conversion to FTE

Location:

Chandler, AZ only option

3 days a week in office.