Source description
About the role
Role:Data Engineer
Location:REMOTE Duration: 6-month contract and will then hire them full-time.
Day to Day work Responsibilities: Design, maintain, and lead the development and implementation of robust ETL pipelines using Apache NiFi and Java Spring Boot microservices, to ingest, transform, and integrate large volumes of complex data from multiple sources. Possess deep technical expertise in Java programming, Spring Boot microservices, and big data technologies in the AWS cloud environment (Redshift, Athena, etc.). Extensive experience in Java programming, Spring Boot microservices, and big data technologies. Strong understanding of data integration principles, ETL best practices, and data governance frameworks. Familiarity with machine learning concepts and data preparation techniques. Lead the optimization of existing ETL scripts for enhanced performance and scalability. Conduct in-depth analysis to integrate complex data sources into a single system, considering optimal data ingestion strategies. Collaborate closely with data scientists and machine learning engineers and provide data preparation and analysis support for model building. Lead the creation and maintenance of comprehensive data documentation, including database design, configuration, and performance reports. Establish and enforce best practices for secure data storage, backup, and archiving and ensure compliance with relevant regulations. Partner with the data management team and data stewards to define and implement data governance initiatives.
Required Qualifications: BS/BA Degree and 2+ years’ experience, MS/MA and 0 years’ experience Must have the ability to obtain and maintain a Public Trust clearance. Extensive Expertise with Apache NiFi, JAVA and JAVA Spring boot Microservices, AWS, Red Shift, Athena and Big Data technologies Experienced with CI/CD processes
Preferred Qualifications
BS/BA Degree and 5+ years’ experience, MS/MA and 3+ years’ experience Agile / SAFe Certified Knowledge of AWS or AWS GovCloud & native AWS administrative tools and dashboards. Knowledge of SonarQube, Burp Suite, Apache JMeter Knowledge of New Relic, Splunk and Quicksight Skilled with RESTful APIs and Angular development Familiar with HTML and CSS, Java and JavaScript, Jenkins, Ansible, and Nexus. Experience with Center for Medicare and Medicaid (CMS) or other Federal Healthcare Programs Strong Leadership and communication skills. JIRA system experience required.
More at Thoughtwave Software and Solutions