Source description
About the role
Location: Bangalore Experience: 6 - 9 Years Role Overview: We are looking for a Data Engineer with strong expertise in Python, PySpark, AWS Glue, and Lambda . The ideal candidate should have experience in data processing, transformation, and cloud-based data workflows . A strong foundation in PL/SQL and PostgreSQL is required, and experience with AWS services such as SNS and Step Functions, along with Java API development, would be a plus . Key Responsibilities:
Develop and optimize ETL pipelines using AWS Glue, Lambda, and PySpark .
Work with large-scale data processing and transformation using Python and Spark .
Design and implement data workflows for structured and unstructured data.
Optimize queries and data storage for performance and cost efficiency.
Develop and maintain data models, schemas, and database structures using PL/SQL and PostgreSQL .
Integrate AWS services such as SNS, Step Functions, and other cloud-based workflows .
Collaborate with cross-functional teams to support business data needs.
Troubleshoot and optimize data pipelines for scalability and reliability.
Must-Have Skills: ✅ Python & PySpark – Strong hands-on experience
✅ AWS Glue & Lambda – Experience in serverless data processing
✅ PL/SQL & PostgreSQL – Basic database development and querying skills Good to Have: SNS & Step Functions – AWS workflow automation Java API – Experience in API development and integration
More at Photon
Related open roles
Data Architect/Lead | Offshore
Bangalore
Sr Data Architect - GCP, AbInitio, Tableau - Chennai, India
Chennai
Senior Software Engineer - Oracle, AWS Cloud - Chennai
Chennai
Sr Platform Engineer - GCP - Chennai, India
Chennai
DevOps Engineer| Tonik | Chennai
Chennai
Cloud Engineer (Kubernetes) | TN, India
Chennai