Source description
About the role
Role:Datawarehouse Developer/Architect
Location:Plano, TX(Hybrid) Duration:6+ Months
Must Haves:
- Python – Data Pipelining
- SQL – used for Data Validations
- Shell Scripting
- AWS – S3 & Lambda
Expectations: Understand existing workflows and underlying frameworks Migrate these existing workflows to new CapitalOne specific data ingestion framework Collaborate with and across Agile teams to gather metadata to meet the current data governance standards Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Build scripts/utilities to accelerate migration Analyze data & generate reports Learn-unlearn-relearn concepts with an open and analytical mindset. Troubleshooting & Critical thinking Develop & review technical documentation for artifacts delivered.
Requirements
Minimum 7 years of experience in data engineering and Data Pipelines Minimum 5 years of extensive experience in Python Programming Minimum 3 years of extensive experience in SQL, Unix/Linux Shell Scripting Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities. Minimum 3 year of AWS experience Basic Knowledge of CI/CD Excellent communication skills and Good Customer Centricity.
Nice to Haves: Prior experience with data migration project Experience with Kafka Streams/building data intensive streaming applications (stream processing, e.g. Kafka, Spark Streaming) Experience/Knowledge of Scala or Java Programming Experience with at least one Cloud DW such as Snowflake Experience with Distributed Computing Platforms
Bhargavi Ankam IT Recruiter Staffing | Thoughtwave Software and Solutions Limited 6306891366 bhargavi@thoughtwavesoft.com www.thoughtwavesoft.com 314 N. Lake St, Suite 6, Aurora IL 60506 A Certified Minority Business Enterprise, Disadvantaged Business Enterprise, SAM.gov, SOC2 & ISO2005, Vendors for: · STATES: IL, PA, TN, AK, OR, CT, GA, VA, ID, IA, UT, FL, MN & CO, · NATIONAL LABS: ARGONNE & FERMI, · COUNTIES: HENNEPIN, MN, FULTON & GA, · PUBLIC SCHOOLS: ATLANTA.
More at Thoughtwave Software and Solutions