Padmi

Snowflake Lead Data Engineering

New York · OnsitePosted 29 days ago
Infrastructure And DatabasesSenior
Apply at Tata Consultancy Services

Opens the source posting on ibegin.tcsapps.com

Source description

About the role

View original

Must Have Technical/Functional Skills

Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend ETL

Roles & Responsibilities

The Snowflake Lead will serve as the onsite technical lead for CLEARBROOK ’s enterprise data platform, responsible for end to end Snowflake solution design, development leadership, and AI/advanced analytics enablement. The role requires deep hands on expertise in Snowflake, strong data engineering fundamentals, and the ability to integrate AI/ML driven use cases into the Snowflake ecosystem while coordinating with offshore teams.

Snowflake Production Support

• Perform root cause analysis for job failures and data analysis & fixes

• Perform Month End Closing Activities

Snowflake Development & Architecture

• Lead design and development of Snowflake schemas, tables, views, streams, tasks, and Snowpipes

• Define and enforce best practices for performance optimization (warehouse sizing, clustering, query tuning)

• Own Snowflake security architecture: RBAC, role hierarchy, data masking, row/column level security

• Oversee promotion of code across environments using CI/CD practices

Data Engineering & Integration

• Lead development of batch and near real time ingestion pipelines using Talend / Qlik Replicate / Snowpipe

• Ensure data quality checks, reconciliation, and schema drift handling

• Guide integration from insurance source systems (Policy, Claims, Billing, Reinsurance) into Snowflake

• Provide technical oversight for SQL, Python, and ELT based transformations

AI / Advanced Analytics Enablement

• Enable AI/ML use cases on Snowflake, including:

o Feature engineering datasets for ML models

o Snowpark (Python)–based data processing

o Integration with external ML platforms (Databricks / SageMaker / Azure ML where applicable)

• Support AI driven insights such as:

o Claims triage & risk scoring

o Fraud detection inputs

o Premium leakage and pricing analytics

• Guide teams in using Python, SQL, and Snowflake native capabilities for data science workloads

Core Technical Skills

• Snowflake: Advanced SQL, Performance Tuning, Security, Snowpipe, Streams & Tasks

• Data Engineering: ELT/ETL patterns, data modeling, CDC concepts

• Python: Data processing, automation, Snowpark (preferred)

• Strong understanding of cloud data platform architecture (AWS preferred)

AI / Analytics Skills

• Hands on exposure to AI/ML pipelines (feature preparation, training data creation)

• Experience supporting ML models through data engineering and operationalization

• Familiarity with Python ML libraries (scikit learn, pandas, NumPy) – applied from a data engineering perspective

• Understanding of model lifecycle support (data refresh, monitoring, retraining inputs)

Domain & Soft Skills

• Insurance domain experience (P&C / Specialty Insurance strongly preferred)

• Strong communication skills for onsite customer interaction

• Ability to translate business requirements into scalable data & AI solutions

Salary Range: $110,000 to $130,000 per year

</div

Role: Developer

Desired skills: Talend

Qualifications: BACHELOR OF COMPUTER SCIENCE

  • Experience: 12 - 15 Years

  • Job function: TECHNOLOGY

  • Location: New York, NY

Salary range: $110,000–$130,000

Apply by: 2026-09-25 00:00:00

One address, no account. We’ll tell you when matching roles go live.

More at Tata Consultancy Services

Related open roles

View all roles