Lead devops engineer

Lead devops engineer San Francisco, CA 6 months Job Description : Looking for a resource more senior in the DevOps space, with a leaning toward site reliability engineering. Docker containers, Kubernetes automation Mostly focused on the automation, current pain points around deployments reliability around their data engineering processes. SRE who can go beyond the memory, what kind of memory is being used, how do we optimize CPU, disc size, how does a disc work. Their in-house tool leverages both batch and real-time streaming processes. If an internal team is having issues with their pipelines, looking from the perspective of where is the snag happening? Pipeline lags, runtimes too long. How can we troubleshoot from the containers and pipeline automation perspective? Have 1000 pipelines already built in Spark/Scala. Looking for no-code/low-code solutions down the line (more-so for data engineering roles that could be coming). Does NOT need to know Spark programming, but understanding of how Spark works against the Kubernetes automation. Looking for more of a Senior Engineer right now who can step into more of a true leadership role. Immediately involved in mentorship, escalations. Could eventually lead a team as they build out additional roles. Must Have: Kubernetes Docker CI/CD and Jenkins Production support Splunk or similar logging/observability experience (ELK, Kibana, etc) Nice to Have: Spark Scala or Java

Down the line/as they hire Data Engineers: Data engineer with core programming Java/Scala Knowing Spark streaming framework, might use Flink or Spring Boot eventually

Process: Internal Screening + 1 round interview: schedule for an hour