Padmi
Braintrust logo
Braintrust

AI observability · LLM evaluation

DevOps Engineer

MumbaiPosted 2 months ago
Software engineeringMid-levelFull Time; Regular
Apply at Braintrust

Opens the source posting on shine.com

Source description

About the role

View original

As a DevOps engineer at Braintrust, you will be responsible for authoring and validating Infrastructure-as-Code (IaC) tasks. Your role will involve designing realistic infrastructure scenarios, building ground-truth solutions, and defining automated checks to ensure correct and safe outcomes. You will work hands-on to encode best practices for real infrastructure operations into verifiable tasks using tools like Terraform, Pulumi, CloudFormation, and cloud CLI for AWS or GCP. Key Responsibilities: - Author IaC tasks based on real-world AWS and GCP scenarios. - Develop idempotent IaC solutions that converge to the desired end state. - Create automated checks to verify the correctness of infrastructure outcomes. - Review and QA tasks created by other engineers for accuracy and robustness. - Enhance task security against potential vulnerabilities. - Clearly document task intent, assumptions, edge cases, and scoring rationale. Qualifications Required: - 4+ years of experience in DevOps or cloud engineering. - Proficiency in Infrastructure-as-Code tools such as Terraform (mandatory), and familiarity with Pulumi, CloudFormation, or CDK. - Strong knowledge of AWS and GCP cloud platforms. - Ability to script in Python and/or Bash for automation and validation purposes. - Understanding of correctness and verification principles in infrastructure coding. - Background in AI evaluation, benchmarking, or expert data annotation is advantageous. - Prior exposure to LocalStack is a plus. Braintrust is a global talent network facilitating connections between independent professionals and top companies for high-quality, flexible work opportunities. They streamline the hiring process for organizations and provide professionals with access to vetted projects from innovative teams. As a DevOps engineer at Braintrust, you will be responsible for authoring and validating Infrastructure-as-Code (IaC) tasks. Your role will involve designing realistic infrastructure scenarios, building ground-truth solutions, and defining automated checks to ensure correct and safe outcomes. You will work hands-on to encode best practices for real infrastructure operations into verifiable tasks using tools like Terraform, Pulumi, CloudFormation, and cloud CLI for AWS or GCP. Key Responsibilities: - Author IaC tasks based on real-world AWS and GCP scenarios. - Develop idempotent IaC solutions that converge to the desired end state. - Create automated checks to verify the correctness of infrastructure outcomes. - Review and QA tasks created by other engineers for accuracy and robustness. - Enhance task security against potential vulnerabilities. - Clearly document task intent, assumptions, edge cases, and scoring rationale. Qualifications Required: - 4+ years of experience in DevOps or cloud engineering. - Proficiency in Infrastructure-as-Code tools such as Terraform (mandatory), and familiarity with Pulumi, CloudFormation, or CDK. - Strong knowledge of AWS and GCP cloud platforms. - Ability to script in Python and/or Bash for automation and validation purposes. - Understanding of correctness and verification principles in infrastructure coding. - Background in AI evaluation, benchmarking, or expert data annotation is advantageous. - Prior exposure to LocalStack is a plus. Braintrust is a global talent network facilitating connections between independent professionals and top companies for high-quality, flexible work opportunities. They streamline the hiring process for organizations and provide professionals with access to vetted projects from innovative teams.

One address, no account. We’ll tell you when matching roles go live.

More at Braintrust

Related open roles

View all roles