Lead Data Engineer (Databricks)

Job Title: Data Engineer Location: Hyderabad / Ahmedabad (Hybrid) Experience: 7+ Years Key Responsibilities: Required Skills: Python, Pyspark, SQL, Databricks Please apply if you can join in less than 30 days. About the Role: We are seeking a Data Engineer with 7+ years of experience to develop scalable and high-performance data solutions. The ideal candidate will have strong expertise in Python, PySpark, SQL, and Databricks, along with a deep understanding of big data processing and cloud technologies. Key Responsibilities: Design, develop, and enhance ETL/ELT data pipelines using Python and PySpark. Build and maintain large-scale data processing frameworks with Databricks. Write and optimize SQL queries, stored procedures, and data models for efficient data management. Work with both structured and unstructured data to enable business intelligence and analytics. Ensure data pipeline efficiency, scalability, and reliability through continuous optimization. Implement data governance, security, and compliance best practices. Collaborate closely with data scientists, analysts, and business stakeholders to deliver data-driven insights. Identify and resolve data quality issues, performance bottlenecks, and system failures in production environments. Must-Have Skills: Python – Proficient in writing clean, efficient, and scalable code for data processing. PySpark – Hands-on experience with distributed data processing and optimization. SQL – Strong ability to write complex queries and optimize database performance. Databricks – Practical experience in building and managing large-scale data solutions.