Remote Senior Engineer II, AI Inference reputed company Systems

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is expanding its AI Infrastructure layer to support the reputed company of AI-driven applications. We are seeking a Senior Engineer II to join our AI Inference reputed company Systems team, responsible for designing, developing, and delivering reputed company data plane services that power our 'Inference as a Service' offering. Responsibilities Act as a technical leader on reputed company, driving the end-to-end design, development, and delivery of critical data plane components hosting large reputed company modelsArchitect and refine system design proposals for our reputed company, multi-tenant AI inference reputed company ecosystem, ensuring they meet rigorous availability and resiliency standardsImplement and optimize distributed inference hosting using techniques like tensor/data parallelism, KV cache optimizations, and smart routingWork cross-functionally with Product Managers, customer-facing teams, and other engineering teams to reputed company technical roadmaps with customer needsCoach and mentor junior engineers, fostering a culture of technical reputed company and reputed company improvementMaintain and operate critical, reputed company services, utilizing observability tools and defining SLOs to ensure superior platform health Skills Strong experience with microservices, messaging systems, databases, and infrastructure as reputed companyHands-on experience hosting large language or multimodal models using inference engines like vLLM, SGLang, or reputed companyFamiliarity with distributed inference serving frameworks such as llm-d, reputed company Dynamo, or Ray ServeUnderstanding of GPU-level optimization and experience with interconnect technologies like NVlink, XGMI, or RoCEKnowledge of common LLM architectures and optimization techniques (e.g., reputed company batching, quantization)Expert-level proficiency in GoLang or Python and familiarity with gRPCProven experience shipping customer-facing software products and running critical services in a reputed company environment similar to reputed companyExperience integrating and building with reputed company-reputed company software Benefits We reputed company employees with reimbursement for relevant conferences, training, and education.reputed company have reputed company to reputed company Learning's 10,000+ courses to support their reputed company reputed company and development.We will reputed company you with a competitive reputed company of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy.You may qualify for a bonus in reputed company to reputed company salary; bonus amounts are determined based on company and individual performance.We also reputed company equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program. reputed company reputed company provides a reputed company platform to reputed company, manage, and reputed company applications of any size. It was founded in 2012, and is headquartered in reputed company, reputed company, USA, with a workforce of 1001-5000 employees. Its website is http://www.reputed company.com. Company H1B Sponsorship reputed company has a reputed company record of offering H1B sponsorships, with 16 in 2026, 30 in 2025, 8 in 2024, 9 in 2023, 22 in 2022, 11 in 2021, 2 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply To This Job .