Source description
About the role
Job Overview : Role : Sr. / Lead Data Engineer Description : Location : Pune (Office-based; relocation support available) Experience : 8+ years Role Type : Technical Leadership (Hands-on) The Core Mission : You will lead the design and delivery of a modern data platform. This involves building automated pipelines, managing cloud infrastructure, and mentoring a team to ensure high-quality, cost-efficient data solutions. Your Tech Stack : - Cloud : Azure (Data Factory, Functions, ADLS Gen2, Key Vault) - Warehouse : Snowflake (Advanced SQL, optimization, and scaling) - Transformation : dbt (Modular modeling, testing, and documentation) - Languages : Python or C# (for serverless logic and custom APIs) Key Responsibilities : - Pipeline Architecture : Build end-to-end ETL/ELT flows from APIs and databases into Snowflake. - Custom Coding : Use Azure Functions (Python/C#) for complex logic and API authentication. - Data Modeling : Use dbt to create a "single source of truth" and SQL for high-performance transformations. - Team Leadership : Conduct code reviews, manage task allocation, and mentor junior engineers. - Security & Optimization : Manage credentials via Key Vault and tune Snowflake/Azure resources for maximum cost-efficiency. What You Need to Succeed : - 8+ Years in Data : A deep background in data warehousing and dimensional modeling. - Azure Mastery : Hands-on experience with ADF, Azure Functions, and Data Lake security. - Lead Experience : A proven track record of managing teams and stakeholder expectations. - Code Quality : Proficiency in Python and advanced SQL optimization. Bonus Points For : - Azure DevOps (CI/CD) and Git. - Databricks (PySpark) experience. - Streaming/Real-time data experience. Job Overview : Role : Sr. / Lead Data Engineer Description : Location : Pune (Office-based; relocation support available) Experience : 8+ years Role Type : Technical Leadership (Hands-on) The Core Mission : You will lead the design and delivery of a modern data platform. This involves building automated pipelines, managing cloud infrastructure, and mentoring a team to ensure high-quality, cost-efficient data solutions. Your Tech Stack : - Cloud : Azure (Data Factory, Functions, ADLS Gen2, Key Vault) - Warehouse : Snowflake (Advanced SQL, optimization, and scaling) - Transformation : dbt (Modular modeling, testing, and documentation) - Languages : Python or C# (for serverless logic and custom APIs) Key Responsibilities : - Pipeline Architecture : Build end-to-end ETL/ELT flows from APIs and databases into Snowflake. - Custom Coding : Use Azure Functions (Python/C#) for complex logic and API authentication. - Data Modeling : Use dbt to create a "single source of truth" and SQL for high-performance transformations. - Team Leadership : Conduct code reviews, manage task allocation, and mentor junior engineers. - Security & Optimization : Manage credentials via Key Vault and tune Snowflake/Azure resources for maximum cost-efficiency. What You Need to Succeed : - 8+ Years in Data : A deep background in data warehousing and dimensional modeling. - Azure Mastery : Hands-on experience with ADF, Azure Functions, and Data Lake security. - Lead Experience : A proven track record of managing teams and stakeholder expectations. - Code Quality : Proficiency in Python and advanced SQL optimization. Bonus Points For : - Azure DevOps (CI/CD) and Git. - Databricks (PySpark) experience. - Streaming/Real-time data experience.