Sr. Data Engineer (Databricks)

Work Location: Hyderabad (Hybrid Model) Prestige Skytech, Financial District Experience: 6 - 8 years Mandatory Skills: Databricks, Python/Pyspark, SQL Job Summary We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark, Databricks, and SQL. The ideal candidate should have hands-on experience building enterprise-scale batch and real-time data pipelines, optimizing high-volume workloads, and designing modern data architectures. Key Responsibilities Design and develop scalable batch and streaming data pipelines using PySpark and DatabricksBuild and optimize enterprise data models and transformation pipelines using Snowflake and DBTDevelop advanced SQL scripts, stored procedures, and performance-optimized queriesDesign and implement real-time streaming architecturesBuild integrations using APIs, event-driven architectures, and cloud-native servicesOptimize workloads for performance, scalability, and cost efficiencyDesign enterprise data platforms using Lakehouse, Data Mesh, Data Vault, and Fabric principlesWork with cross-functional teams to build scalable analytics and data engineering solutionsImplement CI/CD and DevOps practices for data engineering pipelinesProvide technical leadership and mentor engineering teams Required Skills Strong hands-on experience with Python / PySparkExpertise in DatabricksAdvanced SQL expertiseStrong experience with Stored Procedures and complex SQL optimizationHands-on experience with streaming frameworks and real-time processingExperience with REST APIs and enterprise integrationsStrong understanding of distributed data processingWorking knowledge of AWS and/or AzureExcellent analytical and debugging skills Strong Knowledge Of Data WarehousingData Vault ModelingData MeshData Lake & Lakehouse ArchitectureEnterprise Data Architecture Patterns Good to Have Kafka/Event Hub/KinesisAirflowTerraformUnity CatalogDelta Live TablesCI/CD pipelines Skills: sql,enterprise data,data Work Location: Hyderabad (Hybrid Model) Prestige Skytech, Financial District Experience: 6 - 8 years Mandatory Skills: Databricks, Python/Pyspark, SQL Job Summary We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark, Databricks, and SQL. The ideal candidate should have hands-on experience building enterprise-scale batch and real-time data pipelines, optimizing high-volume workloads, and designing modern data architectures. Key Responsibilities Design and develop scalable batch and streaming data pipelines using PySpark and DatabricksBuild and optimize enterprise data models and transformation pipelines using Snowflake and DBTDevelop advanced SQL scripts, stored procedures, and performance-optimized queriesDesign and implement real-time streaming architecturesBuild integrations using APIs, event-driven architectures, and cloud-native servicesOptimize workloads for performance, scalability, and cost efficiencyDesign enterprise data platforms using Lakehouse, Data Mesh, Data Vault, and Fabric principlesWork with cross-functional teams to build scalable analytics and data engineering solutionsImplement CI/CD and DevOps practices for data engineering pipelinesProvide technical leadership and mentor engineering teams Required Skills Strong hands-on experience with Python / PySparkExpertise in DatabricksAdvanced SQL expertiseStrong experience with Stored Procedures and complex SQL optimizationHands-on experience with streaming frameworks and real-time processingExperience with REST APIs and enterprise integrationsStrong understanding of distributed data processingWorking knowledge of AWS and/or AzureExcellent analytical and debugging skills Strong Knowledge Of Data WarehousingData Vault ModelingData MeshData Lake & Lakehouse ArchitectureEnterprise Data Architecture Patterns Good to Have Kafka/Event Hub/KinesisAirflowTerraformUnity CatalogDelta Live TablesCI/CD pipelines Skills: sql,enterprise data,data