DATA ENGINEER

Role:Azure Data Engineer

Duration:12 months Location:Remote

top 3 MUST HAVE technologies of the position:

1. Azure
2. Databricks using PySpark and SparkSQL
3. Advanced SAS Programming 4.Azure Data Factory, and Azure Data Lake experience

Logistics Requirements: Must sit in Atlanta. Can consider relo candidates as long as they can commit to relocating for a hybrid schedule 2-3 days a week.

Day to Day Responsibilities/typical day look like:

Selling Points for Candidates: Perks? What is exciting about position? Company?

1. Chance to help with CDC’s massive modernization initiative
2. Get CDC experience which will open lots of other opportunities

NICE TO HAVES (OR WHAT GETS THE WIN)?

1. Azure 70-532 Cert -Developing Microsoft Azure Solutions
2. Strong Databricks engineer

Job Qualifications: Skills: Databricks Platform, Microsoft Azure, Microsoft Power BI, SAS, Structured Query Language (SQL) Certifications: Developing Microsoft Azure Solutions (Azure 70-532) - Microsoft

Experience: 5 + years of related experience US Citizenship Required: Yes Job Description: The Azure Databricks Developer is responsible for building, implementing, and supporting Microsoft BI solutions to meet CDC NCIRD business requirements. The Azure Databricks Developer will often work on complicated systems with limited supervision so excellent problem-solving skills are necessary.

Responsibilities

Azure Data engineering with Databricks using PySpark and SparkSQL. Migrating existing SAS application to Azure cloud. Cloud migration and as well as guide the team members with the migration process. Designing & building data architectures including the design & set-up of scalable Modern Data Platforms incl. infrastructure-as-code, proper CICD, solid DevOps and the best-fit technologies for the use case. Advanced Base SAS Programming. Working together with the BI developers deploying data pipelines & data transformations which turn the raw data into relevant datasets and insights (using Databricks, Azure Data Factory) Working with Data Scientist deploying machine learning into scalable services in a perfect fit with the data architecture (MLFlow) Assisting the project team in deploying data applications including, if needed, close-to real-time architectures such as streaming pipelines (Spark Structured Streaming or Azure Functions) You will work (standalone or in team) with clients and have a responsibility on managing project timeline, status meetings and coaching & training of colleagues and customers. Architect, develop and deploy (both hybrid cloud & full cloud) data architectures in Microsoft Azure Act as a Data Engineer Expert on the latest trends in the data analytics landscape and share best practices with the internal team. Leverage Open-Source technology in building scalable and best-practice set-ups (incl. Spark & Python) Inspire customers with insights & opportunities on new data-driven use cases. Work with external vendors and partner technologies including (but not limited to) Azure. Embrace project management aimed towards getting the job done. This will include working with client data engineers and data scientists but also business stakeholders.

Additional responsibilities may include:

Development of reports and database procedures to help resolve data quality issues. Implement proactive system performance monitoring tools and procedures. Effectively communicate SQL Server SSIS architecture and approaches. Exhibit competency in problem solving, data analysis, business rule validation, data integration, data quality, dependency analysis and estimation and delivery of complex Azure data solutions. Working closely with client stakeholders, architects, analysts, and SMEs to validate and/or elicit information requirements for database design and architecture. Analysis of source data to assist in preparing iterative design changes, database refactoring, and creating or modifying reference data. Experienced in database design with the ability to progress from concept to implementation, creating and maintain entity relationship diagrams, data dictionaries, and ability to create implementation scripts. Evaluating of existing databases for performance bottlenecks to recommend solutions for improvement. Develop Power BI reports. Qualifications

Required skills and experience: Bachelor’s degree plus 10 years’ experience or master’s degree plus 8 years’ experience; preferred degree in Computer Science or related area. Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required. Expertise in Azure, AWS cloud services, and DevOps/CI/CD frameworks. 4+ years of Azure Databricks and Azure Data-factory. Experience with on prem to cloud migration. 3+ years of current experience with development and implementation of Microsoft SQL Server Integration Services (SSIS) and SAS solutions Experience in the development of modular SSIS solutions which include the implementation of robust error handling, logging, archival, and other foundational capabilities. Design and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services Experience in designing and hands-on development in cloud-based analytics solutions.

Desired skills and experience:

Experience with Azure Data Lake is preferred. Experience in the public health domain and HL7 is a plus. Knowledge and understanding of implementing Webservices a plus. Experience working in an Agile development team. Must be able to work as part of a team, as well as independently. Must grasp new concepts easily and be willing to continually learn. Must be flexible and willing to help other team members in support of project goals.

Thanks & Regards, Ramya Sree US IT RECRUITER Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6302164696 Email:ramyasree@thoughtwavesoft.com LinkedIn: https://www.linkedin.com/in/ramya-sree-kolla-519839221/