Pyspark Developer Data Engineer Hyderabad (India)

Skills Required: 6+ years of hands-on experience designing and developing enterprise-scale applications, data platforms, or distributed systems. 6+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem. Solid hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies. Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services. Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway. Robust experience with advanced Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support. Strong understanding of data engineering concepts, including data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization. Excellent analytical and problem-solving skills. Solid communication and presentation skills, with the ability to explain technical concepts clearly to both technical and non-technical audiences. Experience with version control and CI/CD tools, including Git and Jenkins, for source code management, build automation, testing, and deployment workflows. Ability to work effectively in cross-functional Agile/Scrum teams. .