Padmi
Raylu logo
Raylu

AI origination platform · private markets

Senior Data Engineer

New York · Onsite$165k–$250k/yrPosted 7 days ago
Software engineeringSeniorFull Time
Apply at Raylu

Opens the source posting on jobs.gem.com

Source description

About the role

View original

Company logo

View all jobs

Senior Data Engineer

NYC

Engineering

In office

Full-time

Position Summary

We’re hiring a Senior Data Engineer to own data at truly massive scale. You’ll design and run pipelines that clean, enrich, and serve data spanning hundreds of attributes across 80M+ companies and 800M+ people. The role blends classic data engineering with data operations, vendor/BPO orchestration, and data partnerships.

What we’re looking for

  • Core stack: Python, Dagster, DuckDB
  • Pipelines at scale: Building resilient ELT/ETL with strong contracts, idempotency, and lineage.
  • Data operations: Set quality bars, manage BPO workflows, and run SLAs with external data partners.
  • Serving & access: Position data for production use from serving infrastructure, documentation, and SLAs for internal consumers.
  • Cost & performance: You tune storage/compute and keep a sharp eye on unit economics.
  • Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.

Responsibilities

  • Own end-to-end data flows: ingestion, normalization, entity resolution, enrichment, and delivery.
  • Stand up monitoring for freshness, completeness, and accuracy; drive RCA and prevention.
  • Build internal tools that make data discoverable and usable by engineering and product.
  • Recruit, onboard, and manage BPO vendors; negotiate and run data partnerships.

Nice to have

  • Experience with big data, columnar storage formats, vector indexes, and privacy/compliance in data products.

Logistics

  • Compensation: $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)
  • Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
  • Benefits:
  • Generous health, dental, and vision insurance
  • 401k with 3% automatic contribution (no vesting)
  • Paid Lunches
  • Wellness and Citi Bike benefit

Ready to apply?

Powered by

Gem Logo

First name *

Last name *

Email *

LinkedIn URL

Resume *

Click to upload or drag and drop here

Professional Personal Website

If there's a relevant professional personal website we should look at.

I understand that this is a 5-days in office role in NYC (midtown Manhattan) and that fits with what I am looking for.

We can be very flexible in every way EXCEPT this one for the right candidate.

Yes, I live in NYC and am

Yes, I do not live in NYC but am willing to relocate

No, but I would request an exception be made to allow me to work remotely

Are you authorized to work in the U.S.?

Yes

No

Will you now or in the future require sponsorship for employment visa status (e.g., H-1B visa status)?

Yes

No

Github

If you have a github with publicly visible projects please include a link here

What is your hottest tech take or most against the grain product decision you've made? *

Feel free to take this question in whatever direction you want - our goal is to understand how you can be opinionated and high ownership in your work. P.S. don't ask ChatGPT to write this for you. We look at LLM generated text all day and we'll know.

Apply

Req ID: R6

More at Raylu

Related open roles

View all roles