Source description
About the role
Design, develop, deploy, and maintain robust data pipelines and ETL (Extract, Transform, Load) processes to transform data into actionable insights Collaborate with stakeholders to understand reporting requirements and translate them into scalable pipelines, queries, and Power BI reports Identify and implement best practices for Spark application development, data ingestion, and data transformation Implement data quality checks and ensure data accuracy, consistency, and integrity Optimize Spark MS Fabric jobs for performance, scalability, and reliability. Collaborate with DevOps teams to automate deployment and management of Spark notebooks and pipelines Mandatory Skills(ONLY 2 or 3) Microsoft Fabric / Azure Data stack Pyspark SQL Power BI
More at CLIFYX INC