Source description
About the role
Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using DataBricks. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop scalable and efficient algorithms for processing large datasets using Generative AI techniques. Ensure high-quality data governance by implementing semantic models and quality control checks. Job Requirements : 6-10 years of experience in Data Engineering with expertise in DataBricks. Strong understanding of generative AI concepts such as neural networks, GANs, etc. Experience working on big-data platforms like Hadoop, Spark, Kafka etc. . Proficiency in developing complex SQL queries for querying large datasets.
More at Peoplefy Infosolutions