Padmi

Data Engineer Lead

New YorkPosted 3 months ago
Software engineeringUnspecified
Apply at Thoughtwave Software and Solutions

Opens the source posting on atsapp.swarmhr.com

Source description

About the role

View original

Responsibilities: · Migrating legacy pipelines to Cloud · Platform feature enhancement · Managing real-time ecosystems with millions of pieces of data per minute · Providing holiday support for a large-scale eCommerce system · Evaluating and providing tune ups to meet demand · Unit and functional testing · Leads the discovery phase of medium to large projects to come up with high level design. · Leads and participates in end to end service implementations, data feeds ingestion, and orchestration. · Designs and implements low latency services. · Troubleshoots business and production issues Technical Skills: · Real time streaming in Kafka · Experience with Cloud Technologies (GCP, Azure or AWS) · Big Data fundamentals · Spark, Scala, Java · Batch processing experience · Experience supporting Kubernetes, CICD pipelines, etc. Nice to have: · Search + optimization experience · Experience leading small teams, 4-10 people in size · Experience with automation testing · eCommerce experience

One address, no account. We’ll tell you when matching roles go live.

More at Thoughtwave Software and Solutions

Related open roles

View all roles