Staff Software Engineer & AI/ML

Role Overview: As a part of the Crunchyroll team, you will play a crucial role in defining and delivering platform capabilities that drive end-to-end automation of complex business workflows using model-driven and LLM-powered systems. Your responsibilities will include designing scalable architectures for processing and transforming large volumes of structured and unstructured data, establishing patterns for orchestrating workflows, and implementing strategies for integrating large language models and generative AI services. Your expertise will contribute to ensuring consistent quality, reliability, and performance of model-driven systems in production while collaborating with cross-functional stakeholders to drive system design and delivery. Key Responsibilities: - Define and deliver platform capabilities for end-to-end automation of complex business workflows using model-driven and LLM-powered systems. - Design scalable architectures for processing, enriching, and transforming large volumes of structured and unstructured data. - Establish patterns for orchestrating model-driven workflows, including sequencing, dependency management, retries, and failure handling. - Implement strategies for integrating and orchestrating large language models and generative AI services, including prompt design, evaluation, and optimization. - Define model serving strategies and system architectures that balance latency, throughput, accuracy, and cost across batch and real-time workloads. - Implement evaluation and validation frameworks to ensure consistent quality, reliability, and performance of model-driven systems. - Define and enforce data quality, lineage, and auditability standards for traceability and reproducibility of outputs. - Lead system design and delivery across cross-functional stakeholders to drive alignment between engineering, data, and business teams. Qualifications Required: - 12+ years of software engineering experience with a focus on building and operating large-scale distributed systems. - Experience in designing and delivering AI/ML or model-driven systems in production environments. - Hands-on experience working with LLMs and generative AI systems, including prompt design, evaluation, and production integration. - Strong proficiency in Python and building backend services using modern languages like TypeScript/Node. - Experience with cloud platforms (GCP or AWS), Kubernetes, and infrastructure as code. - Proven ability to design systems balancing scalability, reliability, and cost efficiency. - Experience in implementing observability, monitoring, and reliability practices for production systems. - Strong system design skills and the ability to lead complex technical initiatives across teams. (Note: The additional details about the company's values have been omitted as per the provided instructions.) Role Overview: As a part of the Crunchyroll team, you will play a crucial role in defining and delivering platform capabilities that drive end-to-end automation of complex business workflows using model-driven and LLM-powered systems. Your responsibilities will include designing scalable architectures for processing and transforming large volumes of structured and unstructured data, establishing patterns for orchestrating workflows, and implementing strategies for integrating large language models and generative AI services. Your expertise will contribute to ensuring consistent quality, reliability, and performance of model-driven systems in production while collaborating with cross-functional stakeholders to drive system design and delivery. Key Responsibilities: - Define and deliver platform capabilities for end-to-end automation of complex business workflows using model-driven and LLM-powered systems. - Design scalable architectures for processing, enriching, and transforming large volumes of structured and unstructured data. - Establish patterns for orchestrating model-driven workflows, including sequencing, dependency management, retries, and failure handling. - Implement strategies for integrating and orchestrating large language models and generative AI services, including prompt design, evaluation, and optimization. - Define model serving strategies and system architectures that balance latency, throughput, accuracy, and cost across batch and real-time workloads. - Implement evaluation and validation frameworks to ensure consistent quality, reliability, and performance of model-driven systems. - Define and enforce data quality, lineage, and auditability standards for traceability and reproducibility of outputs. - Lead system design and delivery across cross-functional stakeholders to drive alignment between engineering, data, and business teams. Qualifications Required: - 12+ years of software engineering experience with a focus on building and operating large-scale distributed systems. - Experience in designing and delivering AI/ML or model-driven systems in production environments. - Han