Azure Data Bricks (Pune)

Job Summary Responsibilities - Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security. - Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle ensuring seamless deployment and continuous integration. - Utilize Python and PySpark to design and implement efficient data processing pipelines optimizing performance and reliability. - Create and manage Databricks SQL queries to extract transform and load data supporting business intelligence and analytics initiatives. - Oversee the execution of Databricks Workflows ensuring timely and accurate data processing to meet project deadlines. - Provide technical expertise and support to team members fostering a collaborative and innovative work environment. - Analyze complex data sets to identify trends and insights contributing to data-driven decision-making processes. - Ensure data quality and integrity by implementing robust validation and error-handling mechanisms. - Collaborate with stakeholders to understand business requirements and translate them into technical specifications. - Document technical designs processes and procedures to facilitate knowledge sharing and future reference. - Support the development of data management strategies aligning with organizational goals and objectives. - Contribute to the continuous improvement of development practices enhancing efficiency and effectiveness. Qualifications - Demonstrate proficiency in Databricks Unity Catalog Azure Data Lake Store and Azure DevOps. - Exhibit robust programming skills in Python and PySpark for data processing and analysis. - Possess experience in Databricks SQL and Workflows for data management and analytics. - Have a background in Data Management Hedge Fund Accounting or Account Management as a plus. - Show ability to work in a hybrid model with excellent communication and collaboration skills. Certifications Required .