Padmi

Lead Data Engineer(10-15 Years) - Kochi, Chennai, Coimbatore, Mumbai, Pune

MumbaiPosted 1 month ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Anlage Digital

Opens the source posting on shine.com

Source description

About the role

View original

Hi, Urgently looking out for Lead Data Engineer with one of my esteemed client for Kochi, Chennai, Coimbatore, Mumbai, Pune location. Years of experince:10-15 Years Location: Kochi, Chennai, Coimbatore, Mumbai, Pune ***Only Immediate joiners should apply *** Role Summary We are seeking a strong Data Engineer with hands-on expertise in Databricks, PySpark, and SQL/T-SQL interpretation to support a legacy-to-Databricks migration program. The ideal candidate should have worked predominantly as a Data Engineer throughout their career, ideally beginning with Oracle, SQL Server/T-SQL, ETL, or Data Warehouse technologies and later transitioning into modern cloud-based Data Engineering. The role requires the ability to understand existing T-SQL logic and migrate transformation rules into scalable Databricks and PySpark solutions. Important screening criterion: The candidate must have worked predominantly and consistently as a Data Engineer throughout their career. Profiles that are primarily BI, reporting, dashboarding, analytics, or only recently shifted into data engineering should not be prioritized. Roles & Responsibilities Analyze legacy data warehouse, SQL Server, Oracle, ETL, and T-SQL based implementations for migration to Databricks. Read and interpret complex T-SQL scripts, stored procedures, functions, views, joins, transformation rules, and data flows. Convert business logic from legacy SQL/T-SQL processes into optimized Databricks and PySpark workflows. Design, develop, and maintain scalable ETL/ELT pipelines in Databricks. Support ingestion, transformation, validation, and reconciliation of enterprise data across legacy and modern platforms. Collaborate with architects, senior engineers, business analysts, and migration teams to understand source-to-target mapping requirements. Perform data quality checks, unit testing, integration testing, and defect resolution during migration execution. Optimize PySpark jobs, SQL queries, and Databricks notebooks for better performance and reliability. Document migration logic, transformation rules, dependencies, and technical design details. Participate in code reviews and follow Data Engineering best practices. Must Have Skills 8+ years of relevant Data Engineering experience, with the majority of career spent in Data Engineering roles. Strong hands-on experience in Databricks development. Strong PySpark programming experience for data transformation and pipeline development. Strong SQL/T-SQL understanding, especially the ability to read and interpret existing T-SQL code. Experience in legacy data technologies such as SQL Server, Oracle, traditional ETL tools, or Data Warehouse platforms. Experience in ETL/ELT development, data ingestion, transformation, and data pipeline implementation. Good understanding of Data Warehousing, Data Modeling, and dimensional concepts. Ability to migrate or re-engineer legacy SQL/ETL logic into Databricks/PySpark. Strong analytical, debugging, and problem-solving skills. Good communication skills to work with technical and business teams. Candidates interested in the above mentioned Job Description can shared across their updated resume at ramandeep.k@anlage.co.in .

One address, no account. We’ll tell you when matching roles go live.

More at Anlage Digital

Related open roles

View all roles