Padmi

Data Engineer Lead

New YorkPosted 1 month ago
Software engineeringUnspecified
Apply at Thoughtwave Software and Solutions

Opens the source posting on atsapp.swarmhr.com

Source description

About the role

View original

Responsibilities: · Migrating legacy pipelines to Cloud · Platform feature enhancement · Managing real-time ecosystems with millions of pieces of data per minute · Providing holiday support for a large-scale eCommerce system · Evaluating and providing tune ups to meet demand · Unit and functional testing · Leads the discovery phase of medium to large projects to come up with high level design. · Leads and participates in end to end service implementations, data feeds ingestion, and orchestration. · Designs and implements low latency services. · Troubleshoots business and production issues Technical Skills: · Real time streaming in Kafka · Experience with Cloud Technologies (GCP, Azure or AWS) · Big Data fundamentals · Spark, Scala, Java · Batch processing experience · Experience supporting Kubernetes, CICD pipelines, etc. Nice to have: · Search + optimization experience · Experience leading small teams, 4-10 people in size · Experience with automation testing · eCommerce experience

One address, no account. We’ll tell you when matching roles go live.

More at Thoughtwave Software and Solutions

Related open roles

View all roles
Data Engineer Lead at Thoughtwave Software and Solutions · Padmi