Data Engineer

Must Haves: - STRONG streaming experience with Spark AND Kafka - MUST HAVE: LEAD EXPERIENCE (team of 4 and above) - 6+ YOE in Data Engineering/IT background - Large Enterprise experience dealing with large amounts of data - Cloud: GCP, Azure, AWS - Experience with Scala, Java or Spring boot Migrating legacy pipelines to Cloud  Platform feature enhancement  Managing real-time ecosystems with millions of pieces of data per minute  Providing holiday support for a large-scale eCommerce system  Evaluating and providing tune ups to meet demand  Unit and functional testing  Leads the discovery phase of medium to large projects to come up with high level design.  Leads and participates in end to end service implementations, data feeds ingestion, and orchestration.  Designs and implements low latency services.  Troubleshoots business and production issues . Technical Skills:  Real time streaming in Kafka  Experience with Cloud Technologies (GCP, Azure or AWS)  Big Data fundamentals  Spark, Scala, Java  Batch processing experience  Experience supporting Kubernetes, CICD pipelines, etc. Nice to have:  Search + optimization experience.  Experience leading small teams, 4-10 people in size.  Experience with automation testing.  eCommerce experience.