DATA ENGINEER

Role: Data Engineer

Location: Okemos, MI(Hybrid) Duration: 6 month+ contract

Title: Data Engineer

looking for someone who has experience working with Snowflake and ideally Streamsets. Matillion or Fivetran are okay though. As well as T-SQL or PL/SQL and automating processes. Python scripting is great to have as well as creating CICD pipelines

Project:

This team is currently supporting 2 major projects: Customer Data Platform – this platform will allow customers who pay to use an in-house tool called Rosevelt to access their data via real-time streaming in Snowflake and manipulate it in whatever way they want Phone System Migration – DDMI is transitioning to a cloud-hosted phone system. There are a lot of reports and data elements that DDMI needs to migrate. They are receiving some data from Snowflake and some data from an on-prem call system. They need to integrate the data and make it reportable for the Data Insights team to use

Responsibilities

Design and develop data pipelines in Snowflake and StreamSets – they have some templates built out for the Customer Platform project, but these may or may not work for the Phone System project. Will be using existing templates and developing new pipelines from scratch Execute ETL processes to integrate on-prem data with data stored in Snowflake Participate in on-call rotation – each team member is on-call for 2 weeks, about every 8 weeks

Must Haves:

3+ years of experience in Snowflake StreamSets or similar tool – Matillion, FiveTran, etc. Experience with T-SQL PL/SQL or both Experience automating processes

What Will Win:

Experience creating CICD pipelines from scratch Healthcare claims experience – “medium nice to have” – will be more relevant during the data transformation project Python scripting – will be useful for future projects

Job Description:

We are looking for a Data Engineer to join our Data Engineering Team. The ideal candidate should have a minimum of 3 years of experience with excellent analytical reasoning and critical thinking skills. The candidate will be a part of a team that does Enterprise Data Warehousing (EDW) work, general extract, transform, and load (ETL) work, along with creating data pipelines that use change data capture (CDC) mechanisms to move data to a cloud provider.

Responsibilities

Participates in the analysis and development of technical specifications, programming, and testing of Data Engineering components. Participates creating data pipelines and ETL workflows to ensure that design and enterprise programming standards and guidelines are followed. Assist with updating the enterprise standards when gaps are identified. Follows technology best practices and standards and escalates any issues as deemed appropriate. Follows architecture and design best practices (as guided by the Lead Data Engineer, BI Architect, and Architectural team). Responsible for assisting in configuration and scripting to implement fully automated data pipelines, stored procedures and functions, and ETL workflows. Follows standard change control and configuration management practices. Participates in 24-hour on-call rotation in support of the platform.

Required Skills/Qualifications

Drive and desire to automate repeatable processes Excellent interpersonal skills and communication, as well as the willingness to collaborate with teams across the organization Database Platforms: Oracle, EDB PostgreSQL, Snowflake, and SQL Server OS Platforms: Windows Server and Linux OS Languages: PL/SQL, Python, and T-SQL Informatica PowerCenter and StreamSets

Desired Skills/Qualifications Experience working with near-real time data pipelines and traditional EDW workflows

Thanks & Regards, Ramyasree US IT RECRUITER Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6302164696 Email:ramyasree@thoughtwavesoft.com LinkedIn: https://www.linkedin.com/in/ramya-sree-kolla-519839221/

A Certified Minority Business Enterprise, Disadvantaged Business Enterprise, SAM.gov, SOC2 & ISO2005, Vendors for: · STATES: IL, PA, TN, AK, OR, CT, GA, VA, ID, IA, UT, FL, MN & CO, · NATIONAL LABS: ARGONNE & FERMI, · COUNTIES: HENNEPIN, MN, FULTON & GA, · PUBLIC SCHOOLS: ATLANTA.