Padmi

Data Engineer

United StatesPosted 1 month ago
Software engineeringUnspecified
Apply at Thoughtwave Software and Solutions

Opens the source posting on atsapp.swarmhr.com

Source description

About the role

View original

Role:Data Engineer

Location:REMOTE Duration: 6-month contract and will then hire them full-time.

Day to Day work Responsibilities: Design, maintain, and lead the development and implementation of robust ETL pipelines using Apache NiFi and Java Spring Boot microservices, to ingest, transform, and integrate large volumes of complex data from multiple sources. Possess deep technical expertise in Java programming, Spring Boot microservices, and big data technologies in the AWS cloud environment (Redshift, Athena, etc.). Extensive experience in Java programming, Spring Boot microservices, and big data technologies. Strong understanding of data integration principles, ETL best practices, and data governance frameworks. Familiarity with machine learning concepts and data preparation techniques. Lead the optimization of existing ETL scripts for enhanced performance and scalability. Conduct in-depth analysis to integrate complex data sources into a single system, considering optimal data ingestion strategies. Collaborate closely with data scientists and machine learning engineers and provide data preparation and analysis support for model building. Lead the creation and maintenance of comprehensive data documentation, including database design, configuration, and performance reports. Establish and enforce best practices for secure data storage, backup, and archiving and ensure compliance with relevant regulations. Partner with the data management team and data stewards to define and implement data governance initiatives.

Required Qualifications: BS/BA Degree and 2+ years’ experience, MS/MA and 0 years’ experience Must have the ability to obtain and maintain a Public Trust clearance. Extensive Expertise with Apache NiFi, JAVA and JAVA Spring boot Microservices, AWS, Red Shift, Athena and Big Data technologies Experienced with CI/CD processes

Preferred Qualifications

BS/BA Degree and 5+ years’ experience, MS/MA and 3+ years’ experience Agile / SAFe Certified Knowledge of AWS or AWS GovCloud & native AWS administrative tools and dashboards. Knowledge of SonarQube, Burp Suite, Apache JMeter Knowledge of New Relic, Splunk and Quicksight Skilled with RESTful APIs and Angular development Familiar with HTML and CSS, Java and JavaScript, Jenkins, Ansible, and Nexus. Experience with Center for Medicare and Medicaid (CMS) or other Federal Healthcare Programs Strong Leadership and communication skills. JIRA system experience required.

One address, no account. We’ll tell you when matching roles go live.

More at Thoughtwave Software and Solutions

Related open roles

View all roles