Solution Architect AI/ML, LLM, AWS

About the Role We are seeking a highly experienced Solution Architect to design, guide, and govern scalable software solutions across the organizationranging from individual components to fully integrated enterprise platforms. This role requires strong expertise in AWS cloud technologies, AI infrastructure, and advanced AI governance practices, ensuring solutions align with business strategy, security standards, and responsible AI policies. Responsibilities Architecture & Solution Design Design end-to-end architectures spanning:Component-level services (microservices, APIs)Domain platformsEnterprise-wide ecosystemsDefine architecture patterns, standards, and reusable frameworksTranslate business requirements into scalable and secure technical solutionsEnsure interoperability across systems, data layers, AI services, and platforms Enterprise Architecture Strategy Develop and maintain enterprise architecture roadmapsAlign IT strategy with business goals and digital transformation initiativesEstablish governance models (TOGAF/SAFe or similar)Lead architecture review boards and technical decision-making processes Cloud Architecture (AWS) Architect and optimize cloud-native and hybrid solutions using AWS servicesDefine cloud migration strategies and modernization approachesEnsure high availability, resiliency, cost optimization, and performanceImplement Infrastructure-as-Code and automation best practices AI, Data & Intelligent Systems Architecture Design AI/ML infrastructure, pipelines, and enterprise integration patternsArchitect solutions incorporating LLMs, generative AI, and intelligent agentsGuide adoption of AI technologies within enterprise platforms and productsEstablish patterns for:RAG (Retrieval-Augmented Generation)Feature stores and data pipelinesModel deployment, versioning, and scaling AI Governance, Observability & Control Define and implement enterprise AI governance frameworks covering:Responsible AI usage (fairness, bias mitigation, explainability)Data privacy, lineage, and complianceAI risk classification and policy enforcementEstablish AI observability and monitoring capabilities, including:End-to-end tracing of AI/ML and LLM flows using tools such as OpenTelemetryMonitoring of prompts, responses, latency, and model behavior using platforms like Langfuse or equivalentMetrics for model performance, drift, hallucination rates, and usage patternsDesign and enforce agent governance and control mechanisms, including:Monitoring and auditing of autonomous and semi-autonomous AI agentsGuardrails for agent behavior, tool usage, and decision boundariesHuman-in-the-loop (HITL) workflows and escalation patternsPolicy-based control over agent actions and integrationsImplement AI lifecycle governance, including:Model validation, approval workflows, and audit trailsContinuous evaluation and feedback loopsSecure model and prompt management Cross-Disciplinary Architecture Leadership Act as a strategic liaison across Semantic, Data, and ML architecture domainsFacilitate alignment between knowledge graphs, ontologies, data platforms, and ML systemsProvide architectural guidance to specialized architects, ensuring cohesive enterprise integrationBridge gaps between business semantics, data engineering, and machine learning pipelines Security, Compliance & Governance Ensure architectures meet enterprise security standards (e.g., Zero Trust)Define policies for data governance, access control, and auditabilityAlign AI and cloud solutions with regulatory and compliance frameworks Collaboration & Leadership Work with engineering, product, data, and AI teams to align solutionsMentor architects and senior engineersAct as a trusted advisor to leadership and stakeholders Qualifications Core Architecture8-12+ years in software engineering and architecture rolesProven experience designing large-scale distributed systemsStrong knowledge of: Microservices and event-driven architecturesAPI management and integrationsEnterprise integration patterns (EIPs)AWS Glue, Lake FormationStrong communication and stakeholder managementStrategic thinking with hands-on technical depthAbility to influence senior leadership and cross-functional teams Required Skills AWS TechnologiesCompute & ContainersAmazon EC2, AWS LambdaAmazon ECS / EKS (Kubernetes)Networking & IntegrationAmazon VPC, Route 53, API GatewayAWS App Mesh, EventBridge, SNS, SQSData & StorageAmazon S3, EBS, GlacierAmazon RDS, Aurora, DynamoDB, Redshift About the Role We are seeking a highly experienced Solution Architect to design, guide, and govern scalable software solutions across the organizationranging from individual components to fully integrated enterprise platforms. This role requires strong expertise in AWS cloud technologies, AI infrastructure, and advanced AI governance practices, ensuring solutions align with business strategy, security standards, and responsible AI policies. Responsibilities Architecture & Soluti