Senior Data Engineer (Lead + Team)

Job Requisition: Senior Data Engineer

Key Responsibilities • Design and Development: o Architect, implement, and optimize scalable data solutions. o Develop and maintain data pipelines, ETL/ELT processes, and workflows to ensure the seamless integration and transformation of data. • Collaboration: o Work closely with data scientists, analysts, and business stakeholders to understand requirements and deliver actionable insights. o Partner with cloud architects and DevOps teams to ensure robust, secure, and cost-effective data platform deployments. • Data Management: o Manage and maintain data lakes, data warehouses, and real-time analytics systems. o Ensure high data quality, integrity, and security across the organization. • Performance Optimization: o Monitor and enhance system performance, troubleshoot issues, and implement optimizations as needed. o Leverage Microsoft Fabric’s advanced analytics and AI capabilities for innovative data solutions. • Best Practices & Leadership: o Lead and mentor junior engineers to foster a culture of technical excellence. o Stay updated with industry trends and best practices, especially in the Microsoft ecosystem.

Qualifications Required

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. • 5+ years of experience in data engineering, with a proven track record of working on large-scale data platforms. • Expertise in Microsoft Fabric and its components (e.g., Synapse, Data Factory, Azure Data Lake, Power BI). • Strong proficiency in SQL, Python, and Spark. • Experience with cloud platforms, particularly Microsoft Azure. • Solid understanding of data modeling, data warehousing, and ETL/ELT best practices. • Excellent problem-solving, communication, and project management skills. Preferred: • Familiarity with other cloud platforms (e.g., AWS, GCP). • Experience with machine learning pipelines or integrating AI into data workflows. • Certifications in Microsoft Azure or related technologies.