Source description
About the role
Position : Data Engineer Duration : 6 Months Contract Location :100% Remote Must Have : a. 5 + years of data engineering experience b. Experience creating pipelines in ADF c. Understanding of other ETL tools (i.e. SSIS or Informatica) d. Strong SQL skills
Developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance. The Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications. The preferred candidate will be a creative thinker who is comfortable working independently or in teams. They will be a quick learner who is confident they can master a complex ETL model with little guidance. The candidate will be detail-oriented, well organized, and able to manage multiple assignments at once. Minimum Qualifications: • 5+ years of Data engineering experience with a focus on Data Warehousing • 2+ years of experience creating pipelines in Azure Data Factory (ADF) • 5+ years developing ETL using Informatica PowerCenter, SSIS, Azure Data Factory, or similar tools. • 5+ years of experience with Relational Databases, such as Oracle, Snowflake, SQL Server, etc. • 3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL • 2+ years of experience with GitHub, SVN, or similar source control systems • 2+ years of experience processing structured and un-structured data. • Experience with HL7 and FHIR standards, and processing files in these formats. • 3+ years analyzing project requirements and developing detailed specifications for ETL requirements. • Excellent problem-solving and analytical skills, with the ability to troubleshoot and optimize data pipelines. • Ability to adapt to evolving technologies and changing business requirements. • Bachelors or Advanced Degree in a related field such as Information Technology/Computer Science, Mathematics/Statistics, Analytics, Business
More at Thoughtwave Software and Solutions