AI Infrastructure Architect

We're building India's leading AI-powered credit advisory product to get personalized credit guidance through AI. As we scale to millions of daily interactions, we need an engineer who can architect low-latency, resilient AI systems that handle real money decisions for real people. Location : Bangalore (WeWork Bellandur) - In-office role What You'll Own AI Infrastructure Architecture : Design and implement asynchronous multi-agent orchestration Own end-to-end latency from user message to AI response Build resilient inference pipelines that gracefully degrade under load Implement intelligent request routing and load balancing for AI workloads Migrate critical AI conversation flow from monolith to dedicated services Implement WebSocket/streaming infrastructure for real-time chat Design circuit breakers and fallback strategies for AI model failures Build comprehensive observability for AI system performance Optimize credit data retrieval and caching strategies Technical Requirements Must-Have Experience : 3-5 years building production systems handling >10k concurrent users Proven experience with async/event-driven architectures (not just REST APIs) Hands-on experience scaling ML/AI inference in production Deep understanding of caching strategies (Redis, in-memory, CDN) Experience with message queues and real-time communication protocols AI-Specific Expertise Built systems integrating multiple LLM/AI models in production Experience with AI model serving frameworks (TensorFlow Serving, Triton, etc.) Understanding of AI inference optimization (batching, caching, model quantization) Knowledge of conversation state management and context handling Has debugged production issues under high AI inference load Growth Path Direct impact on customer subscription retention through performance Exposure to cutting-edge AI infrastructure challenges Ownership of technical decisions affecting revenue-generating conversations Path to leading AI platform team as you scale Interview Process Technical Assessment: Intro + AI/ML focused technical discussion (60 minutes) System Design: Architecture and scaling conversations (60 minutes) Final Round: Cultural alignment and team interaction Next Steps : Ready to help millions of Indians build better financial futures through AI We'd love to hear from you. Apply With Your resume highlighting relevant AI/ML experience Brief note on what excites you about this opportunity Links to relevant projects or GitHub repositories (optional) (ref:hirist.tech)