Azure Data Engineer

As a Senior Associate 1 (SA1) Azure Data Engineer at GDC Technology Solutions (GTS), you will be contributing to the Audit Data & Analytics domain by developing proficiency in proprietary Data & Analytics tools and applying audit methodology to deliver results. Your key responsibilities will include: - Team Leadership & Collaboration: - Lead, mentor, and manage a team of 46 data engineers to ensure high performance and professional development. - Foster a collaborative and inclusive team environment by promoting knowledge sharing and best practices. - Maintain accurate project status for yourself and the team, ensuring timely delivery of milestones. - Coach junior team members and facilitate knowledge transfer for engagements of varying complexity. - Technical Delivery: - Perform and oversee data transformation and integration projects using Azure Databricks, Azure Data Factory, and Python/PySpark. - Design and manage scalable data processing pipelines and workflows to support analytics and audit requirements. - Apply advanced concepts such as partitioning, optimization, and performance tuning for efficient data processing. - Integrate Databricks with ERP or third-party systems via APIs, developing robust business transformation logic. - Debug, optimize, and resolve issues in large-scale data workflows, proposing effective solutions with minimal guidance. - Data Handling & Workflow Development: - Demonstrate advanced knowledge of Azure cloud services, including Azure Databricks, Data Factory, Data Lake Storage, and related technologies. - Utilize tools such as Alteryx and PowerBI for data analysis and visualization. - Apply understanding of audit processes, financial data structures, and risk assessment routines. - Explore and apply Azure AI services to enhance business processes. - Additional Skills: - Working knowledge of KQL (Kusto Query Language) and Azure REST APIs is a plus. - Enthusiasm to explore and apply Azure AI services in business processes. Technical Skills: - Minimum 58 years of experience in data engineering, with deep expertise in Azure technologies. - Proficiency in Azure, DataBricks Notebooks, SQL, Python or Pyspark notebooks development. - Knowledge on any ERP and about the dataflows in ERP. - Strong knowledge of ETL tools and processes. - Hands-on experience with Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS). - Comprehensive knowledge of Azure cloud services. - Experience with Databricks notebooks for building transformations and creating tables. - Experience in Alteryx and PowerBI for data analysis and visualization purpose. - Microsoft Fabric and Azure AI services is an added advantage. - Understanding of audit processes, financial data structures, and risk assessment routines. Education Requirements: - B. Tech/B.E/MCA (Computer Science / Information Technology) Please email your resume to shikha@tdnewton.com for consideration. As a Senior Associate 1 (SA1) Azure Data Engineer at GDC Technology Solutions (GTS), you will be contributing to the Audit Data & Analytics domain by developing proficiency in proprietary Data & Analytics tools and applying audit methodology to deliver results. Your key responsibilities will include: - Team Leadership & Collaboration: - Lead, mentor, and manage a team of 46 data engineers to ensure high performance and professional development. - Foster a collaborative and inclusive team environment by promoting knowledge sharing and best practices. - Maintain accurate project status for yourself and the team, ensuring timely delivery of milestones. - Coach junior team members and facilitate knowledge transfer for engagements of varying complexity. - Technical Delivery: - Perform and oversee data transformation and integration projects using Azure Databricks, Azure Data Factory, and Python/PySpark. - Design and manage scalable data processing pipelines and workflows to support analytics and audit requirements. - Apply advanced concepts such as partitioning, optimization, and performance tuning for efficient data processing. - Integrate Databricks with ERP or third-party systems via APIs, developing robust business transformation logic. - Debug, optimize, and resolve issues in large-scale data workflows, proposing effective solutions with minimal guidance. - Data Handling & Workflow Development: - Demonstrate advanced knowledge of Azure cloud services, including Azure Databricks, Data Factory, Data Lake Storage, and related technologies. - Utilize tools such as Alteryx and PowerBI for data analysis and visualization. - Apply understanding of audit processes, financial data structures, and risk assessment routines. - Explore and apply Azure AI services to enhance business processes. - Additional Skills: - Working knowledge of KQL (Kusto Query Language) and Azure REST APIs is a plus. - Enthusiasm to explore and apply Azure AI services in business processes.