Source description
About the role
Role description Job Summary Seeking a Specialist with 5 to 7 years of experience in Scala Spark and Databricks to design develop and optimize scalable data solutions leveraging Azure Data Factory ADF Job Description Design and develop scalable and efficient data pipelines using Databricks Spark Scala and Azure Data Factory ADF to support business analytics and reporting needs Collaborate with crossfunctional teams including data engineers analysts and business stakeholders to gather and translate data requirements Ensure data quality consistency and governance across multiple data sources and cloud environments Stay updated with emerging trends and best practices in Databricks Spark Scala and Azure Data Factory to drive innovation in data processing workflows Participate in technical discussions and contribute to architectural decisions related to data integration and transformation solutions Roles and Responsibilities Develop and implement robust ETLELT processes using Scala Spark Databricks and Azure Data Factory for data ingestion transformation and preparation Monitor troubleshoot and resolve data pipeline issues to ensure reliable and uninterrupted data flow Analyze existing data architectures and recommend improvements to enhance scalability performance and efficiency Document data workflows pipeline configurations and technical specifications to facilitate knowledge sharing and maintenance Drive best practices in data governance security compliance and data modeling Mentor and guide junior team members to promote continuous learning and skill development Preferred Location : Mumbai /Pune/Chennai/Bangalore Role description Job Summary Seeking a Specialist with 5 to 7 years of experience in Scala Spark and Databricks to design develop and optimize scalable data solutions leveraging Azure Data Factory ADF Job Description Design and develop scalable and efficient data pipelines using Databricks Spark Scala and Azure Data Factory ADF to support business analytics and reporting needs Collaborate with crossfunctional teams including data engineers analysts and business stakeholders to gather and translate data requirements Ensure data quality consistency and governance across multiple data sources and cloud environments Stay updated with emerging trends and best practices in Databricks Spark Scala and Azure Data Factory to drive innovation in data processing workflows Participate in technical discussions and contribute to architectural decisions related to data integration and transformation solutions Roles and Responsibilities Develop and implement robust ETLELT processes using Scala Spark Databricks and Azure Data Factory for data ingestion transformation and preparation Monitor troubleshoot and resolve data pipeline issues to ensure reliable and uninterrupted data flow Analyze existing data architectures and recommend improvements to enhance scalability performance and efficiency Document data workflows pipeline configurations and technical specifications to facilitate knowledge sharing and maintenance Drive best practices in data governance security compliance and data modeling Mentor and guide junior team members to promote continuous learning and skill development Preferred Location : Mumbai /Pune/Chennai/Bangalore
More at LTM
Related open roles
Senior Specialist - Package Implementation
Bangalore · Hyderabad · Mumbai
Specialist - Package Implementation
Bangalore · Hyderabad · Mumbai
Data scientist
Mumbai
Specialist - Package Implementation
Bangalore · Hyderabad · Mumbai
AI/ML with Python, Data Science
Hyderabad
Weekend Drive For Azure Databricks
Delhi NCR