Python/Snowflake SME

Hello, our client is looking for a strong Python/Snowflake consultant. If you have a matching candidate, feel free to forward them along.

Job Title: Python/Snowflake SME

Location: Chicago, IL - ideally but anywhere EST or CST for the right candidate

Length: 6 months

Role description/ nice to have

Deep hands-on experience with Python, PySpark, Airflow and Kafka jobs implementation

Working experience with Snowflake, DBT and Advanced SQL with FS knowledge

Person will be required to play lead DE role with 70% hands on and 30% leading the tech team and working with users.

Develop automated data pipelines and data stores in a cloud environment. This includes designing, implementing, testing, debugging, and deploying. Good Python Development experience is also needed.

Build metadata driven solutions that is repeatable and highly configurable.

Automate testing and deployment in AWS and Azure.

Partner with business analysts to craft stories and develop work items to satisfy those stories. Work on an agile team to quickly iterate and release solutions.

Provide technical advice and assist end-users in solving problems.

Serve as a key subject matter expert and drive evolution of the cloud-based Data Warehouse Solutions.

Qualifications Experience and Skills

• Minimum of a B.S. in Computer Science, MIS or related degree and 6+ years of related experience.

• In depth knowledge of the following software languages and technologies:

• Strong Python coding skills with advanced concepts like Multi-threading & Multi-processing, Memory management & Garbage collection, advanced regular expressions and advanced python libraries etc

• Enhanced skills with data pipeline and data modelling with Streaming Applications like PySpark and Kafka streaming

• Along with coding experience Snowflake cloud services -MUST HAVE, non-starter if no Snowflake exp

• Strong SQL - Complex queries, joins, cursors, procedures, dynamic tables

• Good Unix/Linux exposure with ad-hoc bash scripts

• Proficiency with relational database, ETL/ELT and data modeling concepts.

• Airflow with Python or other programming languages exposure is almost must have

• Experience in the below is expected:

• o AWS or Azure cloud services o Large volume of data from files (CSV, JSON etc.), REST API and Kafka

• o Docker and Kubernetes

• o Power BI or Tableau

• o GIT or BitBucket Source Control

• o Agile methodologies, Scrum and Kanban o Automated CI/CD pipeline.

• Experience with one or more of the below is desirable:

• o Terraform

• o CircleCI

• o Alteryx

• o Jira and Confluence

• o Buy-Side financial technologies

• Logging tools splunk/EKL--