AWS Data Bricks (Chennai)

We are looking for an experienced Databricks Engineer with strong expertise in Databricks, AWS, PySpark, and SQL. The ideal candidate should have hands-on experience in designing, developing, optimizing, and supporting large-scale data processing solutions on the Databricks platform. The role involves both development and production support responsibilities, requiring solid troubleshooting, performance tuning, and collaboration skills. Key Responsibilities - Design, develop, test, and deploy scalable data processing solutions using Databricks. - Build and optimize ETL/ELT pipelines using PySpark and SQL. - Work with AWS services, particularly S3, for data storage and processing. - Develop high-performance Databricks solutions following industry best practices. - Monitor and support production workloads, investigate issues, and implement fixes. - Perform root cause analysis and provide timely resolution for production incidents. - Collaborate with business stakeholders, architects, and development teams to understand requirements and deliver solutions. - Recommend architecture improvements, code optimizations, and performance enhancements. - Ensure data quality, reliability, and scalability across data platforms. - Participate in code reviews, testing, deployment, and release activities. Required Skills - 7+ years of overall IT experience. - 5+ years of hands-on experience with Databricks development. - Strong experience with PySpark and SQL. - Hands-on experience with AWS services, especially S3. - Good understanding of Databricks architecture and optimization techniques. - Experience in developing, debugging, and maintaining production data pipelines. - Knowledge of data engineering best practices, performance tuning, and troubleshooting. - Experience handling production support activities and incident management. - Strong analytical and problem-solving skills. - Excellent communication and stakeholder management skills. Preferred Skills - Databricks Certificat .