Padmi

SNOWFLAKE AZURE DATA ENGINEER

United StatesPosted 1 month ago
Infrastructure And DatabasesUnspecified
Apply at Thoughtwave Software and Solutions

Opens the source posting on atsapp.swarmhr.com

Source description

About the role

View original

ROLE: Sr. Snowflake Azure Data Engineer

Location: Remote Duration: 6+ month contract

Must Haves: Snowflake, Azure Data Factory – these are the core tools, non-negotiable, need to be within the same project Other Azure modules they use are Blob Storage and Key Vault Experience with data security, data governance, dynamic masking – there are a lot of restrictions about how this data can be used/moved due to HIPAA Communication skills – will be working with the Dublin team, need to have good communication, someone who is concise, self-starter, driven, etc.

Responsibilities

• Create & maintain data pipelines using Azure & Snowflake as primary tools • Create SQL Stored procs, Macros to perform complex transformation • Creating logical & physical data models to ensure data integrity is maintained • CI CD pipeline creation & automation using GIT & GIT Actions • Tuning and optimizing data processes • Design and build best in class processes to clean and standardize data • Code Deployments to production environment, troubleshoot production data issues • Modelling of big volume datasets to maximize performance for our BI & Data Science Team • Create Docker images for various applications and deploy them on Kubernetes

Qualifications

  • Required Qualifications: • Computer Science bachelor's degree or similar • Min 3-6 years of industry experience as a Hands-on Data engineer • Excellent communication skills • Excellent knowledge of SQL, Python • Excellent knowledge of Azure Services such as - Blobs, Functions, Azure

Data Factory, Service Principal, Containers, Key Vault etc. • Excellent knowledge of Snowflake - Architecture, best practices • Excellent knowledge of Data warehousing & BI Solutions • Excellent Knowledge of change data capture (CDC), ETL, ELT, SCD etc. • Knowledge of CI CD Pipelines using GIT & GIT Actions • Knowledge of different data modelling techniques such as Star Schema,

Dimensional models, Data vault • Hands on experience on the following technologies: o Developing data pipelines in Azure & snowflake o Writing complex SQL queries o Building ETL/ELT/data pipelines using SCD logic o Exposure to Kubernetes and Linux containers (i.e. Docker) o Related/complementary open-source software platforms and languages (e.g. Scala, Python, Java, Linux) • Previous experience with Relational Databases (RDBMS) & Non- Relational

Database • Analytical and problem-solving experience applied to a Big Data datasets • Good understanding of Access control and Data masking • Experience working in projects with agile/scrum methodologies and high

performing team(s) • Exposure to DevOps methodology • Data warehousing principles, architecture and its implementation in large environments • Very good understanding of integration with Tableau

-- Thanks & Regards, Pallavi Reddy| Technical Recruiter Thoughtwave Software and Solutions Desk: 6302289745 ,EXTN:167 Email: pallavi@thoughtwavesoft.com Linked in: https://www.linkedin.com/in/pallavi-batchu-2756a8296/

A Certified Minority Business Enterprise, Disadvantaged Business Enterprise, SAM.gov, SOC2 & ISO2005, Vendors for: ·STATES: IL, PA, TN, AK, OR, CT, GA, VA, ID, IA, UT, FL, MN & CO ·NATIONAL LABS: ARGONNE & FERMI ·COUNTIES: HENNEPIN, MN, FULTON & GA ·PUBLIC SCHOOLS: ATLANTA.

SECURITY NOTICE: This communication, including any accompanying document(s), is for the sole use of the intended recipient and may contain confidential information. Unauthorized use, distribution, disclosure or any action taken or omitted to be taken in reliance on this communication is prohibited, and may be unlawful. If you are not the intended recipient, please notify the sender (admin@thoughtwavesoft.com) by return e-mail or telephone (630-448-6681) and permanently delete or destroy all electronic and hard copies of this e-mail.

One address, no account. We’ll tell you when matching roles go live.

More at Thoughtwave Software and Solutions

Related open roles

View all roles