Source description
About the role
he Senior Associate 1 (SA1) Azure Data Engineer will be part of the GDC Technology Solutions (GTS) team, contributing to the Audit Data & Analytics domain . This role involves developing proficiency in proprietary Data & Analytics tools and applying audit methodology to deliver Key Responsibilities: Team Leadership & Collaboration Lead , mentor, and manage a team of 46 data engineers , ensuring high performance and professional development. Foster a collaborative and inclusive team environment, promoting knowledge sharing and best practices. Maintain accurate project status for self and team, ensuring timely delivery of milestones. Coach junior team members and facilitate knowledge transfer for engagements of varying complexity. Technical Delivery Perform and oversee data transformation and integration projects using Azure Databricks, Azure Data Factory, and Python/PySpark. Design and manage scalable data processing pipelines and workflows to support analytics and audit requirements. Apply advanced concepts such as partitioning, optimization, and performance tuning for efficient data processing. Integrate Databricks with ERP or third-party systems via APIs, developing robust business transformation logic. Debug, optimize, and resolve issues in large-scale data workflows, proposing effective solutions with minimal guidance. Data Handling & Workflow Development Demonstrate advanced knowledge of Azure cloud services , including Azure Databricks , Data Factory, Data Lake Storage , and related technologies. Utilize tools such as Alteryx and PowerBI for data analysis and visualization. Apply understanding of audit processes, financial data structures, and risk assessment routines. Explore and apply Azure AI services to enhance business processes. Additional Skills Working knowledge of KQL (Kusto Query Language) and Azure REST APIs is a plus. Enthusiasm to explore and apply Azure AI services in business processes. Technical Skills Minimum 58 years of experience in data engineering , with deep expertise in Azure technologies. Proficiency in Azure, DataBricks Notebooks , SQL , Python or Pyspark notebooks development. Knowledge on any ERP and about the dataflows in ERP Strong knowledge of ETL tools and processes. Hands-on experience with Azure Databricks , Azure Data Factory ( ADF ), Azure Data Lake Storage ( ADLS ) Comprehensive knowledge of Azure cloud services . Experience with Databricks notebooks for building transformations and creating tables Experience in Alteryx and PowerBI for data analysis and visualization purpose. Microsoft Fabric and Azure AI services is an added advantage Understanding of audit processes, financial data structures, and risk assessment routines. Education Requirements B. Tech/B.E/MCA (Computer Science / Information Technology) pls share resume at shikha@tdnewton.com he Senior Associate 1 (SA1) Azure Data Engineer will be part of the GDC Technology Solutions (GTS) team, contributing to the Audit Data & Analytics domain . This role involves developing proficiency in proprietary Data & Analytics tools and applying audit methodology to deliver Key Responsibilities: Team Leadership & Collaboration Lead , mentor, and manage a team of 46 data engineers , ensuring high performance and professional development. Foster a collaborative and inclusive team environment, promoting knowledge sharing and best practices. Maintain accurate project status for self and team, ensuring timely delivery of milestones. Coach junior team members and facilitate knowledge transfer for engagements of varying complexity. Technical Delivery Perform and oversee data transformation and integration projects using Azure Databricks, Azure Data Factory, and Python/PySpark. Design and manage scalable data processing pipelines and workflows to support analytics and audit requirements. Apply advanced concepts such as partitioning, optimization, and performance tuning for efficient data processing. Integrate Databricks with ERP or third-party systems via APIs, developing robust business transformation logic. Debug, optimize, and resolve issues in large-scale data workflows, proposing effective solutions with minimal guidance. Data Handling & Workflow Development Demonstrate advanced knowledge of Azure cloud services , including Azure Databricks , Data Factory, Data Lake Storage , and related technologies. Utilize tools such as Alteryx and PowerBI for data analysis and visualization. Apply understanding of audit processes, financial data structures, and risk assessment routines. Explore and apply Azure AI services to enhance business processes. Additional Skills Working knowledge of KQL (Kusto Query Language) and Azure REST APIs is a plus. Enthusiasm to explore and apply Azure AI services in business processes. Technical Skills Minimum 58 y
More at BIG4