Cloud Engineer - Data

Design, develop, migrate, and maintain scalable data pipelines and ETL processes on Microsoft Fabric and utilize Azure data & analytics resources.

Design and implement data integration processes to extract, transform, and load (ETL) data from various sources both on-prem, external 3 rd party applications, and other cloud providers.

Understand, design and implement data solutions following industry standard architectural frameworks such as Data Mesh, Data Lake, Data Fabric and Data Warehouse architectures.

Design and implement industry standard data modeling techniques for semantic modeling for Power BI such as “Star” or “Snowflake” schemas.

Create data processing workflows and pipelines to support data analytics, machine learning, and other analytic-driven applications.

Implement CI/CD pipelines for automating data engineering processes using Azure DevOps or GitHub.

Collaborate with cross-functional teams to understand data requirements and implement effective data integration solutions.

Set up monitoring solutions using Azure Monitor, Azure Log Analytics, Fabric Data Activator, and other Azure solutions to track the performance of data pipelines or analytics workflows to ensure data quality, integrity, and performance.

Work with cloud security teams to set up and configure various Microsoft security solutions such as Purview and Sentinel to monitor and alert security and compliance best practices throughout the data & analytics lifecycle.

Conduct thorough testing and validation of data solutions to ensure the accuracy, completeness, and reliability of the delivered data products.

Implement, optimize, and maintain cost-effective data & analytics solutions by leveraging Azure Cost Management tools and best practices.

Stay updated on industry regulations and implement necessary changes to maintain compliance.