Databricks + Pyspark Engg_6+ years_Pune_Immediate joiners

HI, Greetings for the day !!! We at HCL are looking for Databricks engineers with exp in Pyspark Location: PUNE If interested reach us on srikanth.domala@hcltech.com Provide us the details below: Total years of exp: Exp in Databricks: Exp in python/pyspark: Current CTC: Expected CTC: Notice Period: Current location: Preferred location: Detailed Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark. Implement advanced ETL workflows to ingest, transform, and load data from diverse sources, ensuring seamless data integration. Optimize, fine-tune, and monitor data systems for peak performance, scalability, and reliability. Ensure data quality, security, and compliance with organizational and industry standards. Develop and document robust data architecture, ETL workflows, data mappings, and process changes. Collaborate with data scientists, analysts, and business teams to understand requirements and deliver trusted data solutions. Troubleshoot and resolve data-related issues, proactively identifying and resolving system bottlenecks. Review and implement best practices for data transformation and ingestion, including CDC, schema evolution, and advanced error handling. Support and guide team members, delegate tasks effectively, and contribute subject matter expertise to achieve collective objectives. Stay current with emerging technologies, Databricks features, and industry best practices to continually enhance data capabilities. Skill Requirements Bachelors or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field. Minimum 5 years of professional experience in data engineering or a related domain. Proven expertise as a Data Engineer with strong hands-on experience in Databricks and PySpark. Proficient in programming with SQL and Python. Experience with cloud computing platforms, preferably Microsoft Azure. Familiarity with data visualization or virtualization tools (e.g., Denodo, Tableau) is advantageous. Deep understanding of CDC ingestion patterns (e.g., watermarks, change tables, log-based ingestion). Advanced skills in error handling, observability, and performance optimization. Excellent analytical, problem-solving, and communication skills. Strong teamwork and collaboration abilities; able to work autonomously and guide others. Proficiency in English; German language skills are a plus. Certifications in Microsoft Azure or Databricks are highly desirable. Other Requirements (Optional) Demonstrated ability to perform complex activities, support and mentor others, delegate responsibilities, and contribute to team success. Passion for continuous learning and professional growth.