Senior Data Engineer (Go / GCP / Kafka)

Senior Data Engineer (Go / GCP / Kafka)

100% Remote (St. Louis, MO) Contract

Need Solid profile only

Strong Go backend engineer with experience building data-intensive REST APIs, handling large-scale datasets, real-time/streaming systems (Kafka), Kubernetes-based deployments on cloud (AWS/GCP/Azure), and solid data modeling with clear business impact.

Role Overview

We are seeking a Senior Data Engineer to join a high-impact team focused on building scalable data platforms that support next-generation agricultural solutions. This role involves working with massive, complex scientific datasets to drive innovation in crop systems, biotechnology, and predictive analytics.

You will play a key role in transforming large-scale data into actionable insights and software solutions that directly contribute to global food sustainability initiatives.

Key Responsibilities:

Design and develop distributed data processing systems for large-scale datasets

Build and maintain data-intensive RESTful APIs

Develop and optimize stream processing pipelines using Apache Kafka

Collaborate with cross-functional teams to solve complex data challenges

Implement scalable cloud-based solutions (GCP/AWS/Azure)

Work with containerized environments (Docker/Kubernetes)

Apply best practices in software engineering, testing (TDD), and system design

Contribute to architecture decisions and explore new technologies

Support data modeling for large-scale relational and NoSQL databases

Required Skills:

7+ years of experience in software engineering / data engineering

Strong programming experience in Go (Golang)

Hands-on experience building RESTful APIs

Experience with Apache Kafka (stream processing)

Solid understanding of data structures & algorithms

Experience with cloud platforms (GCP, AWS, or Azure)

Experience with Docker and containerized deployments

Strong experience with data modeling (SQL/NoSQL)

Familiarity with unit testing and TDD methodologies

Preferred / Nice-to-Have Skills:

Experience with gRPC and Protocol Buffers

Hands-on with Google Cloud Platform (GCP), Dataflow, Apache Beam

Experience with Kubernetes / Google Kubernetes Engine (GKE)

Exposure to scientific or bioinformatics datasets

Experience with large-scale data mining, genomics, or variant analysis

Background in applying quantitative science to business problems