Data Engineer

Job Title: Data Engineer (Financial background)

Location: Newark, NJ Hybrid Locals only

Duration: 12 months

Hands-on experience in Python, AWS (Lambda, Glue, Redshift), data streaming (Kinesis, SQS), REST APIs, full-stack (React, Spring Boot, Node.js), microservices, and secure DevOps practices, with a strong financial or insurance industry background.

Job Description:

We are seeking a highly skilled Data Engineer with expertise in AI/ML, AWS, and distributed systems. The ideal candidate will have strong programming skills, experience with data streaming, API development, and knowledge of software security and DevOps practices. This role involves building scalable data solutions, integrating with cloud-based architectures, and working with cross-functional teams to develop and deploy high-performance applications.

Key Responsibilities:

Develop, implement, and optimize data pipelines using AWS services (Lambda, S3, Glue, Redshift, Athena, Fargate, ECS, CloudWatch, CodeDeploy).

Work with distributed systems, multi-threading, concurrency, and parallel processing to build efficient solutions.

Design and develop RESTful APIs and implement Service-Oriented Architecture (SOA) patterns.

Implement data streaming solutions using SQS, Kinesis, and other real-time processing tools.

Utilize NoSQL and relational databases (MongoDB, MySQL, etc.) to structure and manage data.

Apply design patterns, microservices architecture, and object-oriented programming principles to software development.

Develop software using React, Spring Boot, Node.js within full-stack environments such as MERN/MEAN.

Implement automated testing, unit testing, and functional testing practices.

Ensure accessibility awareness and compliance in application development.

Apply secure coding practices, web application security, and DevSecOps methodologies.

Use GitHub, Bitbucket, or Subversion for version control and apply branching techniques.

Monitor and log system performance using SDLC best practices.

Collaborate with teams to adopt design thinking and architectural patterns.

Required Skills & Experience:

Candidates should have hands-on experience with several of the following:

Programming & Development:

Python for data processing and automation

Object-oriented programming, design patterns, and microservices architecture

Multi-threading, concurrency, and parallel processing

Full-Stack Development: MERN / MEAN stack (React, Spring Boot, Node.js)

Databases & Data Streaming:

NoSQL & Relational databases (MongoDB, MySQL)

Data streaming platforms (SQS, Kinesis)

APIs & Integration:

REST, JSON, SOAP, XML, JDBC

Service-Oriented Architecture (SOA) implementation

Testing & Security:

Automated testing tools and frameworks

Web application security & DevSecOps best practices

Authentication & authorization: OAuth 2.0, OpenID Connect, JWT, SAML 2.0, SSL, web service proxies, firewalls

DevOps & Cloud Services:

AWS core services (Lambda, S3, Glue, Redshift, Athena, Fargate, ECS, CloudWatch, CodeDeploy)]

DevOps tools: GitHub, Bitbucket, Jenkins

Preferred Qualifications

• AWS Development & Architecture expertise

• Knowledge of financial or insurance industry standards

• Experience with actuarial model input/output data structures and reporting use cases

• Experience with design thinking methodologies