Padmi

Sr. Data Engineer

HyderabadPosted 2 months ago
Software engineeringSeniorFull Time
Apply at Insight Global

Opens the source posting on foundit.in

Source description

About the role

View original

Key Responsibilities Design and develop real-time data pipelines using Kafka, Spark, AWS Kinesis , and related technologies. Build and support scalable data processing solutions on AWS . Modernize legacy ingestion frameworks using cloud-native services. Develop and optimize large-scale distributed data processing systems. Troubleshoot and support production data platforms and streaming applications. Collaborate with cross-functional teams on enterprise data integration initiatives. Required Skills & Experience 10+ years of experience in Data Engineering, Software Engineering, or related fields. Strong expertise in AWS Cloud Services and cloud-native architectures. Hands-on experience with Apache Spark (Scala & PySpark) . Strong knowledge of the Hadoop Ecosystem and distributed computing. Experience with Kafka , streaming technologies, and real-time data pipelines. Experience with AWS Kinesis, Kinesis Firehose, Flume , or similar ingestion platforms. Strong programming skills in Python, Scala, and Java . Experience with Big Data, Enterprise Data Warehousing, and Distributed Systems .

One address, no account. We’ll tell you when matching roles go live.

More at Insight Global

Related open roles

View all roles