Databricks Architect (Mumbai)

Role Overview: Responsibilities: - Lead discussions with stakeholders to gather requirements, understand the data landscape, and identify opportunities for leveraging Databricks to solve complex data challenges. Facilitate discovery exercises and demonstrate proof of concepts. - Architect end-to-end data solutions using Azure Databricks, Delta Lake, and other relevant Azure services. Focus on designing scalable ELT/ETL pipelines, optimizing data models for performance, and ensuring data quality and governance. - Provide technical guidance to the implementation team, conducting detailed code reviews and ensuring that best practices in Databricks development, including performance optimization and cost management, are followed. Mentor and upskill team members in Databricks and related technologies. - Develop and optimize complex data pipelines, leveraging the power of Databricks for big data processing, real-time streaming, and batch processing. Implement robust data engineering practices to ensure data reliability, efficiency, and scalability. - Identify and resolve performance bottlenecks in Databricks workflows, optimize Spark jobs, and ensure efficient resource utilization in the cloud workplace. - Ensure robust data governance practices are integrated into Databricks solutions, including data security, lineage, and compliance with regulatory requirements. - Work closely with cross-functional teams, including data scientists, analysts, and DevOps engineers, to integrate Databricks solutions into broader data architectures. .