Lead I - Data Engineering

As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines within the Azure ecosystem. Your expertise in Databricks, PySpark, and data lake architectures will be essential in building efficient data ingestion and transformation workflows. You will collaborate with cross-functional teams to troubleshoot, optimize, and support production workloads. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Azure and Databricks - Build efficient data ingestion and transformation workflows with PySpark and Delta Lake - Develop, optimize, and maintain ETL/ELT pipelines using Python and SQL - Implement data modeling, data quality, and governance best practices - Work with relational databases (e.g., PostgreSQL) and lakehouse architectures (e.g., Delta Lake) - Collaborate with cross-functional teams to troubleshoot, optimize, and support production workloads Qualifications Required: - 5+ years of data engineering experience - Strong proficiency in the Azure ecosystem, including Azure Databricks, Azure Data Lake Storage (ADLS), Azure Functions, and Azure Data Factory (preferred) - Advanced PySpark and SQL expertise, including performance tuning - Deep understanding of ETL/ELT design patterns and data warehousing concepts - Experience with Delta Lake (ACID transactions, schema evolution, time travel) - Hands-on experience with PostgreSQL or similar RDBMS - Strong analytical, problem-solving, and communication skills - Self-motivated and comfortable in fast-paced, agile environments The company TEKSALT is an E-Verified & WOSB Certified Company operating in various industries such as Healthcare, Pharma, Manufacturing, Insurance, Financial, and Retail. For more information, you can visit their website www.teksalt.com. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines within the Azure ecosystem. Your expertise in Databricks, PySpark, and data lake architectures will be essential in building efficient data ingestion and transformation workflows. You will collaborate with cross-functional teams to troubleshoot, optimize, and support production workloads. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Azure and Databricks - Build efficient data ingestion and transformation workflows with PySpark and Delta Lake - Develop, optimize, and maintain ETL/ELT pipelines using Python and SQL - Implement data modeling, data quality, and governance best practices - Work with relational databases (e.g., PostgreSQL) and lakehouse architectures (e.g., Delta Lake) - Collaborate with cross-functional teams to troubleshoot, optimize, and support production workloads Qualifications Required: - 5+ years of data engineering experience - Strong proficiency in the Azure ecosystem, including Azure Databricks, Azure Data Lake Storage (ADLS), Azure Functions, and Azure Data Factory (preferred) - Advanced PySpark and SQL expertise, including performance tuning - Deep understanding of ETL/ELT design patterns and data warehousing concepts - Experience with Delta Lake (ACID transactions, schema evolution, time travel) - Hands-on experience with PostgreSQL or similar RDBMS - Strong analytical, problem-solving, and communication skills - Self-motivated and comfortable in fast-paced, agile environments The company TEKSALT is an E-Verified & WOSB Certified Company operating in various industries such as Healthcare, Pharma, Manufacturing, Insurance, Financial, and Retail. For more information, you can visit their website www.teksalt.com.