Data Engineer

Title: Data Engineer

Description:

Must have: DBT, SnowFlake, Python, Dagster, AWS, S3

Experience with OCI (Oracle Cloud Infrastructure) and Oracle Cloud services, including Oracle Fusion, is a big plus.

Responsibilities

• Writing and building Python-based data pipelines

• Scheduling and parameterizing those pipelines using Dagster

• Parameterizing means making things easily adjustable so the data pipelines can adapt to different needs instead of having to be completely redone every time there's a new business need.

• Working in an AWS + Snowflake environment

• Handling data stored in S3

• Moving data into Snowflake from various sources

• Nice to Have Skills:

• Ability to model up through medallion architecture using DBT. Which means:

• This means the person knows how to organize and transform data in a structured way using DBT (a data transformation tool), following something called the medallion architecture.

• Medallion architecture: A layered approach to data transformation that separates data into:

• Bronze (raw data),

• Silver (cleaned and filtered),

• Gold (final, business-ready data).

• Retail industry experience a plus or someone who has worked in multiple industries.