Source description
About the role
Must Have Technical/Functional Skills
Databricks
-
Python – Spark
-
AWS
– Production experience, query optimization
- SQL – Complex queries, indexing, schema design
Cloud & DevOps
-
AWS – Experience with EC2, S3, Lambda, Glue, EKS
-
CI/CD – Jenkins / GitLab / GitHub Actions
GOOD-TO-HAVE SKILLS
AI / ML Integration
-
LangChain or LLM orchestration frameworks
-
OpenAI API integration experience
-
Prompt engineering and embeddings
-
Semantic search implementation
Roles & Responsibilities
KEY RESPONSIBILITIES
• Design, develop, and optimize large-scale data processing solutions using Databricks.
• Build and maintain robust ETL/ELT pipelines using Python and Databricks.
• Develop scalable data ingestion, transformation, and integration frameworks from multiple data sources.
• Leverage Databricks features including Delta Lake, Spark SQL, Unity Catalog, Workflows, and ML capabilities.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Work with AWS services to support cloud-based data platforms and analytics workloads.
• Implement data quality checks, monitoring, performance tuning, and operational support processes.
• Participate in architecture discussions and contribute to best practices for data engineering and cloud adoption.
• Ensure compliance with security, governance, and data management standards.
• Actively participate in Agile ceremonies including sprint planning, backlog grooming, daily standups, sprint reviews, and retrospectives.
Generic Managerial Skills, If any
Collaboration
-
Translate requirements into technical designs
-
Work with product, data, and AI teams
-
Communicate technical decisions to stakeholders
Salary Range: $110,000 -$125,000 year
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
#LI-SP1
Role: Technical Lead
Desired skills: AWS | Python
Qualifications: BACHELOR OF COMPUTER SCIENCE
-
Experience: 8 - 20 Years
-
Job function: TECHNOLOGY
-
Location: Bloomfield, CA
Salary range: $110,000–$125,000
Apply by: 2026-09-27 00:00:00
More at Tata Consultancy Services