Source description
About the role
We're Hiring: Lead Data Engineer (Databricks | GenAI | LLM | Cloud) Location: Bengaluru (Hybrid 3 Days/Week) Employment Type: Full-Time Experience: 10+ Years Are you passionate about building next-generation data platforms and enabling AI-powered applications We're looking for an experienced Lead Data Engineer to lead the design and development of scalable data solutions while driving innovation across modern data engineering, cloud technologies, and Generative AI. Must-Have Skills 10+ years of Data Engineering experience with enterprise-scale platforms Strong expertise in Databricks (Delta Lake, Delta Live Tables, Databricks Workflows, Unity Catalog) Hands-on experience implementing Medallion Architecture Deep expertise in Apache Spark, PySpark, and Spark SQL Advanced Python & SQL programming skills Experience building scalable batch & streaming ETL/ELT pipelines Strong knowledge of Data Lakes, Data Warehouses, and Lakehouse architecture Experience with AWS, Azure, or GCP data services Proven experience migrating legacy platforms to cloud/lakehouse solutions Expertise in distributed computing, performance tuning, governance, security, and CI/CD GenAI & LLM Experience We're especially looking for candidates with knowledge of: Large Language Models (LLMs)Retrieval-Augmented Generation (RAG)Prompt EngineeringEmbeddingsVector DatabasesAI-ready data pipelines Interested Apply now or share your updated resume with us. Feel free to tag or refer someone in your network who would be a great fit! priyanka.tiwari@trantorinc.com We're Hiring: Lead Data Engineer (Databricks | GenAI | LLM | Cloud) Location: Bengaluru (Hybrid 3 Days/Week) Employment Type: Full-Time Experience: 10+ Years Are you passionate about building next-generation data platforms and enabling AI-powered applications We're looking for an experienced Lead Data Engineer to lead the design and development of scalable data solutions while driving innovation across modern data engineering, cloud technologies, and Generative AI. Must-Have Skills 10+ years of Data Engineering experience with enterprise-scale platforms Strong expertise in Databricks (Delta Lake, Delta Live Tables, Databricks Workflows, Unity Catalog) Hands-on experience implementing Medallion Architecture Deep expertise in Apache Spark, PySpark, and Spark SQL Advanced Python & SQL programming skills Experience building scalable batch & streaming ETL/ELT pipelines Strong knowledge of Data Lakes, Data Warehouses, and Lakehouse architecture Experience with AWS, Azure, or GCP data services Proven experience migrating legacy platforms to cloud/lakehouse solutions Expertise in distributed computing, performance tuning, governance, security, and CI/CD GenAI & LLM Experience We're especially looking for candidates with knowledge of: Large Language Models (LLMs)Retrieval-Augmented Generation (RAG)Prompt EngineeringEmbeddingsVector DatabasesAI-ready data pipelines Interested Apply now or share your updated resume with us. Feel free to tag or refer someone in your network who would be a great fit! priyanka.tiwari@trantorinc.com
More at TRANTOR INC