Sr Data Engineer -

Job Summary We are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end-to-end ownership of data pipelines, ML workflows, and production AI systems. Key Responsibilities Design and implement scalable ETL pipelines using Databricks & Spark Build Lakehouse architecture using Delta Lake Develop and deploy ML models using MLflow Implement MLOps pipelines for training, testing, and serving models Optimize cluster performance and reduce compute cost Build RAG and LLM-based solutions using Mosaic AI Integrate analytics with BI tools (Power BI, Tableau) Implement data governance using Unity Catalog Collaborate with Data Scientists and Business teams Ensure data quality, security, and compliance Required Skills Mandatory 5+ years of Databricks & Apache Spark Strong Python & PySpark Experience with Delta Lake & Lakehouse MLflow & MLOps experience Cloud platform (AWS/Azure/GCP) Git & CI/CD Preferred Experience with LLMs & Generative AI RAG pipelines & Vector Databases Deep Learning frameworks Databricks certifications Power BI integration Requirements Job Summary We are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end-to-end ownership of data pipelines, ML workflows, and production AI systems. Key Responsibilities Design and implement scalable ETL pipelines using Databricks & Spark Build Lakehouse architecture using Delta Lake Develop and deploy ML models using MLflow Implement MLOps pipelines for training, testing, and serving models Optimize cluster performance and reduce compute cost Build RAG and LLM-based solutions using Mosaic AI Integrate analytics with BI tools (Power BI, Tableau) Implement data governance using Unity Catalog Collaborate with Data Scientists and Business teams Ensure data quality, security, and compliance Required Skills Mandatory 5+ years of Databricks & Apache Spark Strong Python & PySpark Experience with Delta Lake & Lakehouse MLflow & MLOps experience Cloud platform (AWS/Azure/GCP) Git & CI/CD Preferred Experience with LLMs & Generative AI RAG pipelines & Vector Databases Deep Learning frameworks Databricks certifications Power BI integration