Padmi

AWS Databricks Data Engineer | Remote | Freelance

IndiaPosted 1 month ago
Infrastructure And DatabasesMid-levelFull Time; Regular
Apply at ThreatXIntel

Opens the source posting on shine.com

Source description

About the role

View original

About the Company ThreatXInte l is a fast-growing Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions. Our expertise spans cloud security, web & mobile application security testing, DevSecOps, vulnerability assessments, IT consulting, and professional staffing services. We support global corporate clients by deploying skilled professionals across IT and finance domains, helping organizations strengthen compliance, optimize operations, and scale efficiently. About the role We are looking for an experienced AWS Databricks Data Engineer to join our team on a remote freelance contract. The ideal candidate will have strong expertise in Databricks, PySpark, Delta Lake, SQL, and AWS, with experience building scalable data pipelines and modern lakehouse solutions. Experience in the Healthcare Payer domain (MMIS) is highly preferred. AWS Databricks Data Engineer Location: Remote Job Type: Freelance / Contract Key Responsibilities Design and develop scalable batch and streaming data pipelines using PySpark, Delta Lake, Auto Loader, and Delta Live Tables (DLT). Build and optimize cloud-native data solutions on AWS using S3, IAM, AWS Glue, and AWS Lambda. Implement data governance, security, and lineage using Databricks Unity Catalog. Automate data pipeline deployments using Databricks Workflows, Apache Airflow, and CI/CD tools. Collaborate with business and technical teams to develop feature stores and prepare high-quality datasets for analytics and reporting. Optimize data processing performance and ensure data quality across enterprise platforms. Required Skills 35 years of hands-on experience with Databricks Strong expertise in PySpark and Advanced SQL Experience with Apache Spark and Delta Lake Strong AWS experience (S3, IAM, Glue, Lambda) Experience with Unity Catalog Knowledge of Delta Live Tables (DLT) and Auto Loader Experience with Apache Airflow CI/CD experience using GitHub or GitLab Healthcare Payer/MMIS domain experience is highly preferred Interested candidates, please share: Updated Resume Total Experience Relevant Databricks Experience AWS Experience Healthcare/MMIS Experience Current Location Notice Period Availability for Interview .

One address, no account. We’ll tell you when matching roles go live.

More at ThreatXIntel

Related open roles

View all roles
AWS Databricks Data Engineer | Remote | Freelance at ThreatXIntel · Padmi