DATA ENGINEER

DATA ENGINEER – Join Our Team .job-posting-container {font-family: Arial, sans-serif; line-height: 1.6; color: #333; margin: 0; padding: 20px; background-color: #ffffff; box-sizing: border-box;} .job-posting-container * {box-sizing: border-box;} .job-posting-content {background-color: #ffffff; padding: 30px; max-width: 800px; margin: 0 auto; box-shadow: 0 0 10px rgba(0,0,0,0.1); border-radius: 10px;} .job-posting-container h1, .job-posting-container h2 {color: #004080; margin: 15px 0;} .job-posting-container h1 {font-size: 22px;} .job-posting-container h2 {font-size: 20px; border-bottom: 1px solid #ccc; padding-bottom: 5px; margin-top: 30px;} .job-posting-container ul {margin-left: 20px;} .job-posting-container .section {margin-bottom: 25px;} .job-posting-container .highlight {background-color: #eef6ff; padding: 15px; border-left: 4px solid #004080; margin-bottom: 15px; border-radius: 5px;} .job-posting-container strong {color: #333;} .job-posting-container li {margin-bottom: 8px;} DATA ENGINEER Location: Boston, Massachusetts, USA | Type: Full-time (C2C) | Experience: 8+ years Position Overview We are looking for a skilled Data Engineer to join our team in Boston. This role requires extensive hands-on experience with modern data engineering technologies and a strong focus on building scalable data solutions. Why Join Us? Work with cutting-edge data technologies in a collaborative environment Opportunity to work on complex, large-scale data projects Competitive compensation aligned with industry standards Professional growth and development opportunities Key Responsibilities Design and implement ETL/ELT data pipelines using Databricks, Scala, and Spark Develop and optimize Spark jobs, data transformations, and processing workflows Build and maintain data solutions using Delta Lake, Unity Catalog, and Auto Loader Implement Lakehouse and Medallion architecture patterns for data organization Configure and manage Databricks clusters, job orchestration, and serverless options Handle complex data streaming and transformations using Structured Streaming Monitor, debug, and resolve issues in live Databricks production jobs Provide data ingestion, streaming, and transformation development solutions Qualifications Minimum 8+ years of extensive data engineering experience with Databricks and ETL/ELT pipelines Strong proficiency in Scala, PySpark, Spark, and SQL with hands-on development experience Deep understanding of Databricks platform including Delta Lake, Unity Catalog, Auto Loader, and Lakehouse architecture Experience with Medallion architecture, serverless computing, DataFrames, and job orchestration Proven track record with Azure Databricks for large volume data streaming and transformations Experience with data warehouse and data lakehouse implementations Strong troubleshooting skills for DevOps pipelines, Azure services, and AKS Knowledge of containerization technologies such as Docker and Kubernetes is a plus Background in Apache big data technologies with programming proficiency in PySpark, R, or Java is advantageous Ready to Apply? If you meet the qualifications and are excited about this opportunity, we encourage you to apply today. Contact: muthu@dprsolutionsinc.com Phone: 5719339984 Take the next step in your career!