Source description
About the role
JOB SUMMARY:
We are seeking a highly experienced Senior Technical Consultant with strong expertise in Databricks and Machine Learning. The ideal candidate will have a proven track record in designing, building, and optimizing scalable data and ML solutions, along with hands-on experience in modern data platforms. This role requires both technical depth and the ability to work closely with stakeholders to deliver high-impact solutions.
JOB RESPONSIBILITIES:
Design and implement end-to-end data and machine learning solutions using Databricks
Develop and optimize data pipelines, ETL/ELT processes, and ML workflows
Build, train, and deploy machine learning models for real-world business use cases
Work with large-scale structured and unstructured datasets
Collaborate with cross-functional teams to gather requirements and translate them into technical solutions
Provide technical leadership and best practices in data engineering and ML architecture
Optimize performance, scalability, and cost-efficiency of data platforms
Ensure data quality, governance, and security standards are met
Support troubleshooting, debugging, and continuous improvement of data and ML systems
Stay updated with the latest advancements in Databricks and ML technologies
JOB QUALIFICATIONS:
Strong hands-on experience with Databricks
Proven experience in Machine Learning (model development, training, deployment)
Proficiency in Python and SQL
Experience with Apache Spark / PySpark
Strong understanding of data engineering concepts and modern data architectures
Experience working with cloud platforms (e.g., Azure, AWS, or GCP)
Ability to design scalable and efficient data and ML solutions
Strong problem-solving and analytical skills
Excellent communication and stakeholder management skills
More at Dysrupit