Source description
About the role
Role- Data Pipeline/Testing Suppor Duration- 9 Months Location- Remote This is a mid—senior level candidate, with a minimum of 5 years’ of experience. Project Scope / Components: Data pipeline work Python and spark pipelines Automating testing of pipelines Using kafka for real time can train, but a sr resource should have this Both batch and real time streaming depending on need, ok to train up a mid person on real time Must-Haves (Concepts & Tools): Python SQL Airflow Batch jobs Spark—very nice to have Kafka—very nice to have Nice-to-Haves (Concepts & Tools): AWS -- ---- Thanks & Regards, Tejash - Technical Recruiter Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6304918494 EXTN: 157 Email :tejash@thoughtwavesoft.com Website:www.thoughtwavesoft.com https://www.linkedin.com/in/tejash-chettipalli-342aa2246
More at Thoughtwave Software and Solutions