Source description
About the role
Client: TCS | Engagement: Full-time | Work mode: ONSITE | Experience: 6-8 | Publisher job id: JOB-000700
Role Overview
This role is for a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. Key Responsibilities: Design, develop, and optimize scalable data pipelines and cloud-based data solutions. Implement ETL/ELT processing, data modeling, performance tuning, and data governance. Work independently and take ownership of end-to-end solution delivery. Collaborate effectively with cross-functional teams and business stakeholders. Required Skills: Strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Delta Lake, Azure Data Factory (ADF), and ADLS Gen2. Proficiency in Python, SQL, GitHub, and CI/CD practices. Experience working on large-scale, cloud-native data platforms (Azure preferred). Strong experience building REST or GraphQL APIs. Experience with Kubernetes (AKS preferred) for API deployment. Understanding of API security, contracts, error handling, and performance. Strong understanding of data governance and security. Qualifications: 6-8 years of relevant experience. Preferred Skills: Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.).
More at Prophecy Technologies