Engineer Staff-AI and Machine Learning with embedded/C++

ResponsibilitiesIn this role, you will spearhead the development and commercialization of the Qualcomm AI Runtime. As an AI inferencing expert, you'll push the limits of performance from large models. Your mastery in deploying large C/C++ software stacks using best practices will be essential. You'll stay on the cutting edge of GenAI advancements, understanding LLMs/Transformers and the nuances of edge-based GenAI deployment. Most importantly, your passion for the role of edge in AI's evolution will be your driving force. QualificationsMasters/Bachelors degree in computer science or equivalent.9-15 years of relevant work experience in software development.Strong in C++ programming, Design Patterns and OS concepts.Experience with optimizing algorithms for AI hardware accelerators (CPU/GPU/NPU).Understanding of Generative AI models LLM, LVM, LMMs and building blocks (selfattention, cross attention, kv caching etc.).Floatingpoint, Fixedpoint representations and Quantization concepts.Excellent analytical and debugging skills.Good communication skills (verbal, presentation, written).Ability to collaborate across a globally diverse team and multiple interests.Preferred QualificationsStrong understanding of SIMD processor architecture and system design.Proficiency in objectoriented software development and familiarity.Familiarity with Linux and Windows environment.Strong background in kernel development for SIMD architectures.Familiarity with frameworks like llama.cpp, MLX, and MLC is a plus.Good knowledge of PyTorch, TFLite, and ONNX Runtime is preferred.Experience with parallel computing systems and languages like OpenCL and CUDA is a plus.Equal Opportunity StatementApplicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disabilityaccommodations@qualcomm.com or call Qualcomm's tollfree number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making its workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries). .