Source description
About the role
As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and ETL processes using Azure services. You will utilize SQL, Python, and Pyspark for data processing and transformation tasks. Additionally, you will implement data storage solutions using Azure Fabric and ensure effective data retrieval. Collaboration with cross-functional teams to gather requirements and translate them into technical specifications will be a key part of your role. You will also optimize data workflows to enhance performance and scalability and monitor and troubleshoot data pipeline issues, providing timely resolutions. Ensuring data security and compliance with organizational standards is essential. Qualifications: - Bachelors degree in Computer Science, Information Technology, or a related field. - Proven experience as a Data Engineer with a strong background in Azure technologies. - Proficiency in SQL, Python, and Pyspark for data manipulation and analysis. - Familiarity with Azure Fabric and cloud-based data solutions. - Strong problem-solving skills and attention to detail. - Excellent communication and collaboration abilities. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and ETL processes using Azure services. You will utilize SQL, Python, and Pyspark for data processing and transformation tasks. Additionally, you will implement data storage solutions using Azure Fabric and ensure effective data retrieval. Collaboration with cross-functional teams to gather requirements and translate them into technical specifications will be a key part of your role. You will also optimize data workflows to enhance performance and scalability and monitor and troubleshoot data pipeline issues, providing timely resolutions. Ensuring data security and compliance with organizational standards is essential. Qualifications: - Bachelors degree in Computer Science, Information Technology, or a related field. - Proven experience as a Data Engineer with a strong background in Azure technologies. - Proficiency in SQL, Python, and Pyspark for data manipulation and analysis. - Familiarity with Azure Fabric and cloud-based data solutions. - Strong problem-solving skills and attention to detail. - Excellent communication and collaboration abilities.
More at KPI PARTNERS INC