Sr. DevOps Engineer

Senior DevOps Engineer: Company: Ethara AI Location: 5th Floor, Plot No. 273, Udyog Vihar II Road, Udyog Vihar Phase 1, Sector 20, Gurugram, Haryana 122016 Employment Type: Full-Time Experience Required: 5+ Years Role Overview We are looking for a highly skilled Senior DevOps Engineer with strong expertise in cloud infrastructure, containerization, and automation. In this role, you will be responsible for designing, deploying, and managing scalable, secure, and high-performance infrastructure that supports AI-driven platforms and production-grade systems. You will play a key role in driving DevOps maturity, implementing best practices, and enabling seamless deployment and observability across distributed systems. Key Responsibilities Design and manage scalable, secure cloud infrastructure on AWS, including VPC, IAM, EC2, S3, RDS, ECR, Route 53, and Secrets Manager Build and maintain Infrastructure as Code (IaC) using Terraform, Pulumi, or AWS CDK Develop and manage CI/CD pipelines using Git, GitHub Actions, Jenkins, and ArgoCD with GitOps practices Design, build, and optimize containerized applications using Docker , including image creation, multi-stage builds, and runtime optimization, and deploy them on Kubernetes (EKS) using Helm, HPA, RBAC, and IRSA Own end-to-end container lifecycle management , including image optimization, security hardening, versioning, and efficient deployment across environments Implement advanced Kubernetes capabilities such as Karpenter, Istio service mesh, mTLS, and canary deployments Set up and manage observability and monitoring systems using CloudWatch, Prometheus, Grafana, Loki, and OpenSearch Design and manage streaming and messaging systems using Kafka, MSK, and Schema Registry Ensure robust security practices, including IAM policies, container security, TLS/SSL, and shift-left security approaches Handle incident management, perform root cause analysis (RCA), and improve system reliability Optimize infrastructure for cost, performance, and scalability Collaborate with engineering and AI teams to support LLM infrastructure and deployment workflows, including AWS Bedrock integration Required Skills & Qualifications 5+ years of experience in DevOps / Cloud / Infrastructure Engineering Strong hands-on experience with AWS services: VPC, IAM, EC2, S3, RDS, ECR, Route 53, Secrets Manager Strong hands-on experience with Docker , including containerization, image optimization, multi-stage builds, and debugging containerized environments Deep expertise in Kubernetes (EKS), including Helm, HPA, RBAC, IRSA, Karpenter, and Istio Strong experience with CI/CD tools: Git, GitHub Actions, Jenkins, ArgoCD Hands-on experience with Infrastructure as Code tools such as Terraform (preferred), Pulumi, or AWS CDK Experience with monitoring and observability tools: CloudWatch, Prometheus, Grafana, Loki, OpenSearch Working knowledge of Kafka/MSK and distributed streaming systems Strong understanding of Linux systems, networking, DNS, TLS/SSL, ALB/NLB Proficiency in scripting (Python and/or Bash) Strong understanding of security best practices (IAM, RBAC, container security) Experience in incident management and reliability engineering Preferred / Bonus Skills Experience with AWS Bedrock and AI/ML infrastructure Familiarity with service mesh (Istio) and mTLS architectures Exposure to MLOps tools such as Kubeflow or MLflow Proven experience in cost optimization at scale Prior experience working in AI/LLM-driven environments Certifications (Preferred) AWS Solutions Architect certifications Certified Kubernetes Administrator (CKA) or Developer (CKAD) Terraform Associate Certification DevSecOps or Security+ Certification Why Join Us Work on cutting-edge AI/ML infrastructure and LLM systems Design and scale production-grade distributed systems Be part of a high-growth, high-impact engineering team Opportunity to shape DevOps architecture and best practices Competitive compensation and continuous learning opportunities