Platform Engineer - Databricks and Cloud

Skip to main content.

View More Jobs

Platform Engineer - Databricks and Cloud

Trending

Apply Now

Job Info

• Job Identification16560
• Posting Date07/01/2026, 03:20 PM
• Job RoleCloud Engineer-Cloud DevOps Engineer
• Experience (In Years)6-9
• Job LocationNew York / Remote

Job Description

EXL is seeking an experienced Platform Engineer to design, implement, automate and operate cloud infrastructure for large scale analytics and data engineering workloads. This role focuses on building and managing Databricks on AWS, Infrastructure-as-Code, CI/CD automation, platform reliability, and cloud governance. The ideal candidate will bring strong hands-on experience across AWS cloud services, Terraform, DevOps practices, and a solid understanding of data engineering platforms, pipelines, and workload orchestration.

Responsibilities

• • Design, build, and manage scalable AWS infrastructure including EC2, EKS, Lambda, API Gateway, VPCs, IAM, Security Groups, Load Balancers, and routing components

• • Implement Infrastructure-as-Code (IaC) using Terraform/AWS CDK to automate provisioning, scaling, and environment management

• • Set up and manage DevOps pipelines using GitHub, GitHub Actions, CodeBuild, CodeDeploy and ArgoCD to support automated build, test, and deployment workflows.

• • Design, deploy, and manage Databricks workspaces, clusters, cluster policies, Unity Catalog, networking, and security integrations on AWS.

• • Partner with data engineering teams to enable reliable execution of pipelines, data ingestion frameworks, batch processing, and workflow orchestration.

• • Automate deployment and lifecycle management of data platform components, including Databricks jobs, workflows, libraries, secrets, service principals, and environment configurations.

• • Collaborate with data engineering teams to support infrastructure components such as AWS Glue, Lambda, Databricks on AWS, DynamoDB, and Redshift.

• • Monitor and optimize platform performance, reliability, and cloud costs for data engineering workloads and analytics platforms. Troubleshoot platform, connectivity, and workload issues

• • Utilize AWS Well-Architected Framework principles to design secure, reliable, cost-efficient, and high-performing solutions

• • Implement platform governance, access controls, security standards, and operational best practices across cloud and data platforms.

• • Contribute to establishing DevOps best practices, reusable templates, and standard operating procedures across engagements

Qualifications

• • Strong hands-on experience managing AWS infrastructure through Terraform, including networking, security, compute, storage, and IAM services.

• • Practical experience working with Databricks on AWS, including workspace administration, compute management, job orchestration, and platform operations.

• • Good understanding of data engineering concepts such as ETL/ELT pipelines, data lakes, workflow orchestration, batch processing, and data platform architecture.

• • Working knowledge of data engineering ecosystems and tools (e.g., Databricks, AWS Glue, Redshift).

• • Practical experience designing and maintaining CI/CD pipelines.

• • Solid understanding of cloud architecture patterns, DevOps workflows, automation, and monitoring practices.

Nice to Have

• Experience implementing container orchestration using Kubernetes / EKS.

• Knowledge of cost optimization, FinOps practices, and cloud governance.

• Exposure to multi-account AWS setups using Control Tower, Organizations, or Landing Zone.

• Familiarity with logging and observability tools such as CloudWatch, Grafana, Prometheus, or ELK.

• Experience working with cross-functional agile teams in a consulting environment.

Required Skills

• Attention To Consistency
• Cloud Architecture
• Interpersonal Dynamics with Coworkers
• Leadership Capabilities
• Reporting Skills
• Results Orientation
• Risk Management
• Time Management Skills
• Working under Pressure
• Writing Communication Skills

Similar Jobs

• Home
• About Us
• Investors Relations

I am an employee

IMP NoticeLearn more

ACCEPT COOKIESDECLINE OPTIONAL COOKIES

Are You Still With Us?

It seems you've been gone for a while. For security reasons we will end your session automatically in 03:00 unless you would like to continue working.

End SessionContinue Working

Work Summary

This summary is generated by AI Assist. Click inside the summary text box to make changes as necessary.

DiscardAdd Summary

Page Platform Engineer - Databricks and Cloud - EXL Talent Acquisition Team Careers loaded