Data Engineer

Job Title: Data Engineer Location: Chennai or Hyderabad, India (Preferred) I Anywhere in India About Korcomptenz Korcomptenz is a global technology and business transformation company with over two decades of experience helping organizations modernize operations, unlock data-driven insights, and accelerate digital transformation. The company serves clients across manufacturing, healthcare, financial services, insurance, retail, logistics, and other industries through enterprise technology, cloud, data, analytics, AI, and managed services. With deep expertise across Microsoft, Salesforce, Data & AI, Enterprise Applications, and Industry Solutions, Korcomptenz has established itself as a trusted partner for organizations seeking to improve operational performance and business outcomes. About ALTIARIS ALTIARIS is Korcomptenz's strategic Enterprise Intelligence Platform and represents the company's investment in the future of AI-driven decision intelligence, agentic AI, and autonomous enterprise operations. The platform transforms operational, enterprise, and connected data into an AI-driven intelligence fabric that delivers real-time insights, decisions, and coordinated action across people, systems, and AI agents. Position Overview We are seeking a skilled and proactive Data Engineer with 6+ years of experience in building scalable data pipelines and analytics platforms. The ideal candidate will have strong expertise in Azure Synapse Analytics, Azure Databricks and Microsoft Fabric. This role requires hands-on experience in modern data architecture, data lakes, Delta Lake, medallion architecture, and cloud-based data engineering best practices. Key Responsibilities: Design, develop, and optimize ETL/ELT pipelines using Azure Synapse, Databricks, and Microsoft Fabric Work with structured and semi-structured data across various storage systems including ADLS Gen2 and OneLake Implement and manage medallion architecture (Bronze, Silver, Gold) in Delta Lake or Lakehouse environments Collaborate with BI developers, data scientists, and business stakeholders to understand data requirements Tune Spark and SQL jobs for performance and cost efficiency Build dataflows, notebooks, pipelines in Fabric to support reporting, analytics, and archival workflows Maintain and monitor data quality, lineage, and governance using tools like Purview, Fabric Data Activator, etc. Automate data workflows and enforce data security and PII masking policies Participate in cloud migration and modernization initiatives related to data platforms Required Skills and Qualifications: 6+ years of data engineering experience with strong hands-on work in Azure Synapse Analytics (Dedicated SQL Pools, Pipelines, Serverless SQL) Azure Databricks (PySpark, Delta Lake, notebooks, job orchestration) Microsoft Fabric (Lakehouse, Warehouse, Dataflows Gen2, Notebooks, Pipelines) Strong SQL and PySpark coding skills Experience with Data Lake architecture, partitioning, data modeling, and performance tuning Solid understanding of CI/CD for data pipelines using DevOps or Git Familiar with Power BI integration and use of Fabric workspaces Experience with Dataverse, D365, or exporting data from ERP/CRM systems is a plus Knowledge of data security, archival strategies, and data lifecycle management Preferred Qualifications: Azure certifications (e.g., DP-203, AZ-305, Fabric certifications) Experience with Delta Live Tables, Fabric KQL, or Real-Time Analytics Familiarity with tools like ADF, Event Grid, Power Automate, or Logic Apps Exposure to big data monitoring and cost optimization strategies