Data Engineer

Azure Data Engineer for a freelancer full time project to work India Location: India - Remote Duration: 6+ Months Azure Databricks Python Spark Azure Power Apps Azure Power BI Job Title: Data Engineer Job Description: We are seeking an experienced Data Engineer with expertise in Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and processing pipelines. You will work closely with cross-functional teams to ensure efficient data workflows, optimize data processing, and enable data-driven decision-making throughout the organization. Responsibilities: Design, develop, and implement data pipelines and ETL processes using Azure Databricks and Spark. Collaborate with data scientists and analysts to understand data requirements and translate them into scalable data solutions. Optimize data workflows for performance, scalability, and reliability, ensuring data quality and integrity. Integrate data from various sources and formats, ensuring seamless data ingestion and transformation. Develop and maintain data models and data warehouses to support business reporting and analytics needs. Collaborate with software developers to build data-driven applications using Azure Power Apps. Work with Azure Power BI to create interactive dashboards, reports, and visualizations to communicate data insights effectively. Monitor and troubleshoot data pipelines, addressing any data processing or integration issues promptly. Stay updated with emerging technologies, tools, and best practices in the data engineering and analytics space, and propose innovative solutions to enhance data processing capabilities. Qualifications: Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. Proven experience as a Data Engineer, working on large-scale data projects using Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI. Strong programming skills in Python and proficiency in working with Spark for distributed data processing. In-depth knowledge of data engineering concepts, data modeling, and ETL principles. Experience with cloud-based data platforms and services, particularly Microsoft Azure. Familiarity with Azure Power Apps for building custom applications and Azure Power BI for data visualization. Strong SQL skills for data manipulation and querying. Ability to work in a collaborative and cross-functional environment, effectively communicating complex technical concepts to both technical and non-technical stakeholders. Strong problem-solving and analytical skills, with a focus on delivering high-quality data solutions. If you are a passionate Data Engineer with expertise in Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI, and you thrive in a fast-paced, data-centric environment, we would love to hear from you. Apply now and join our team as we drive data-driven insights and enable data-driven decision-making across the organization.