Software Engineer

View all jobs

Software Engineer

Sunnyvale, CA

Engineering

In office

Full-time

About Realm Labs

Realm Labs is building the infrastructure that makes AI safe for enterprises. Our platform helps organizations securely deploy, monitor, and govern AI applications through real-time detection, policy enforcement, and security controls.

Our systems process billions of AI tokens across production workloads and solve challenging problems in distributed systems, inference infrastructure, security, and developer tooling.

We’re a small, engineering-driven team where every engineer owns meaningful pieces of the product and works directly with customers.

What You’ll Do

• As a Software Engineer at Realm Labs, you’ll build production systems that power enterprise AI deployments. Your work will span backend services, distributed systems, infrastructure, and customer-facing features.

Responsibilities include

• Design and build scalable backend services in Python or Go.
• Develop APIs and internal services used by enterprise customers.
• Work with distributed systems, asynchronous processing, and message queues.
• Design efficient database schemas and optimize query performance.
• Build reliable integrations with cloud services and AI platforms.
• Debug production issues and improve system reliability and observability.
• Collaborate closely with product, infrastructure, and AI engineers to ship features quickly.
• Participate in code reviews and help maintain a high engineering bar.

What We’re Looking For

Required

• 2+ years of professional software engineering experience.
• Strong programming skills in Python, Go, Java, C++, or a similar language.
• Solid understanding of computer science fundamentals, including:
• Data structures and algorithms
• Operating systems
• Concurrency and multithreading
• Experience designing and consuming REST or gRPC APIs.
• Experience working with relational databases such as PostgreSQL or MySQL.
• Understanding of distributed systems concepts such as replication, consistency, caching, partitioning, queues, and fault tolerance.
• Experience with cloud platforms (AWS, GCP, or Azure).
• Strong debugging and problem-solving skills.
• Excellent communication skills and ability to work in a fast-moving startup.

Nice to Have

• Experience building distributed systems at scale.
• Experience with Docker and Kubernetes.
• Familiarity with Redis, RabbitMQ, Kafka, or similar technologies.
• Experience with observability tools (OpenTelemetry, Prometheus, Grafana).
• Experience with AI/LLM infrastructure.
• Experience working in startups or shipping customer-facing products.

Technologies We Use

You don’t need experience with everything below, but you’ll likely work with many of them:

• Python
• Go
• PostgreSQL
• Redis
• Docker & Kubernetes
• AWS, GCP, Azure
• FastAPI
• Terraform
• GitHub Actions
• OpenTelemetry
• LLM APIs and inference infrastructure

What We Value

• We’re looking for engineers who:

• Take ownership from idea to production.

• Care about writing clean, maintainable code.

• Think systematically about reliability and scalability.

• Enjoy learning new technologies.

• Move quickly without sacrificing quality.

• Are excited about building products in the AI infrastructure and security space.

Why Join Realm Labs?

• Build foundational infrastructure for the next generation of AI applications.
• Solve challenging distributed systems and infrastructure problems.
• Work directly with experienced engineers from companies like Google, Apple, Microsoft, and leading security organizations.
• High ownership with significant impact from day one.
• Competitive salary and meaningful equity.
• Opportunity to help define the future of enterprise AI security.

Ready to apply?

Powered by

First name *

Last name *

Email *

LinkedIn URL

Resume *

Click to upload or drag and drop here

By applying you agree to Gem's terms and privacy policy.

Save your info to apply to other roles faster & help employers reach you.

Apply and saveApply without saving

Req ID: R12