AI SW Stack Deployment Architect

As a Software Architect with 12+ years of experience, you will be responsible for leading the application/framework layer and deployment stack for the Next Generation Accelerator AI platform at Sandisk. Your role will involve ensuring the correctness, performance, and scalability of models running on the platform from vLLM, PyTorch, TensorFlow, to production deployment. Key Responsibilities: - Architect integration of vLLM, PyTorch, TensorFlow, JAX/XLA into Next Generation Accelerator stack - Define framework compiler runtime APIs and contracts - Own LLM execution behavior including batching, KV cache, and streaming inference - Design and implement end-to-end deployment workflows for packaging, versioning, and reproducibility - Drive performance optimization across model frameworks and runtime - Collaborate cross-functionally with compiler, runtime, and low-level SW teams - Support customer workloads, model onboarding, and debugging Qualifications: Required: - 10+ years in AI/ML systems or software architecture - Strong experience with PyTorch/Transformers/LLMs - Hands-on experience with LLM deployment and scalable inference engine systems e.g., vLLM, Triton, SGLang, etc. - Experience building scalable AI platforms (cloud/edge) - Expertise in system design, APIs, and cross-layer integration Preferred: - Experience with vLLM or similar LLM serving systems - Familiarity with XLA/MLIR/compiler frameworks - Exposure to AI accelerators (GPU/NPU) and runtime systems - Experience in distributed or multi-agent AI systems At Sandisk, diversity is celebrated and embraced as a source of power and potential. The company believes that diversity leads to the best outcomes for employees, customers, and communities. Sandisk is dedicated to creating an inclusive environment where every individual can flourish through a sense of belonging, respect, and contribution. Sandisk also ensures that opportunities are accessible to applicants with disabilities by offering accommodations during the hiring process. If you require accommodations, please contact jobs.accommodations@sandisk.com with details of your request, including the job title and requisition number. As a Software Architect with 12+ years of experience, you will be responsible for leading the application/framework layer and deployment stack for the Next Generation Accelerator AI platform at Sandisk. Your role will involve ensuring the correctness, performance, and scalability of models running on the platform from vLLM, PyTorch, TensorFlow, to production deployment. Key Responsibilities: - Architect integration of vLLM, PyTorch, TensorFlow, JAX/XLA into Next Generation Accelerator stack - Define framework compiler runtime APIs and contracts - Own LLM execution behavior including batching, KV cache, and streaming inference - Design and implement end-to-end deployment workflows for packaging, versioning, and reproducibility - Drive performance optimization across model frameworks and runtime - Collaborate cross-functionally with compiler, runtime, and low-level SW teams - Support customer workloads, model onboarding, and debugging Qualifications: Required: - 10+ years in AI/ML systems or software architecture - Strong experience with PyTorch/Transformers/LLMs - Hands-on experience with LLM deployment and scalable inference engine systems e.g., vLLM, Triton, SGLang, etc. - Experience building scalable AI platforms (cloud/edge) - Expertise in system design, APIs, and cross-layer integration Preferred: - Experience with vLLM or similar LLM serving systems - Familiarity with XLA/MLIR/compiler frameworks - Exposure to AI accelerators (GPU/NPU) and runtime systems - Experience in distributed or multi-agent AI systems At Sandisk, diversity is celebrated and embraced as a source of power and potential. The company believes that diversity leads to the best outcomes for employees, customers, and communities. Sandisk is dedicated to creating an inclusive environment where every individual can flourish through a sense of belonging, respect, and contribution. Sandisk also ensures that opportunities are accessible to applicants with disabilities by offering accommodations during the hiring process. If you require accommodations, please contact jobs.accommodations@sandisk.com with details of your request, including the job title and requisition number.