Data Engineer

We are looking for a highly skilled Data Engineer with 0 to 60 days of notice period. The ideal candidate will have expertise in Azure, Python/Pyspark, Fast API, Pydantic, SQL Alchemy, Snowflake or SQL, Azure Data Factory (ADF), CI/CD, Azure fundamentals, GIT, and integration of data solutions with CETRM trading systems. Roles and Responsibility Design and develop scalable data pipelines using Azure Data Factory (ADF) and other relevant tools. Collaborate with cross-functional teams to integrate data solutions with CETRM trading systems. Develop and maintain large-scale data warehouses using Snowflake or similar technologies. Implement data quality checks and validation processes to ensure data integrity. Optimize data processing workflows for performance and efficiency. Work closely with stakeholders to understand business requirements and develop solutions accordingly. Job Requirements Strong proficiency in programming languages such as Python/Pyspark and experience with data frameworks like Spark and Hadoop. Experience with cloud-based platforms like Azure, including Azure Data Factory (ADF) and Azure Synapse. Knowledge of database management systems like SQL Alchemy and Snowflake. Familiarity with CI/CD pipelines and version control systems like GIT. Excellent problem-solving skills and attention to detail. Ability to work collaboratively in a team environment and communicate effectively with stakeholders. Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.