Agentic AI Engineer

Key Responsibilities Agent Cognitive Architecture Design the reasoning framework for how agents decompose complex ERP tasks into structured decision trees with governance checkpoints at each stage. Build agent personas and behavioral profiles for each Rimini Solution domain (Finance, Procurement, Supplier Management, Expense, Support) defining domain-specific reasoning patterns, risk tolerances, and escalation triggers. Architect dynamic tool selection strategies where agents choose which MCP tools to invoke based on context, confidence, and task requirements rather than hardcoded sequences. Design conversation state management for long-running agent sessions that span multiple interactions, tool calls, and human-in-the-loop approvals. Build confidence scoring frameworks that translate LLM output uncertainty into actionable governance decisions (proceed, verify, escalate, halt). Multi-Agent Coordination Design A2A (Agent-to-Agent) communication patterns for collaborative workflows where multiple specialized agents contribute to a single business outcome. Architect supervisor/worker agent hierarchies with clear delegation, progress monitoring, and result aggregation patterns. Build conflict resolution strategies for when agents produce contradictory assessments (e.g., risk agent says halt, efficiency agent says proceed). Design shared context and memory patterns that allow agent teams to build collective understanding of a business situation without redundant processing. Autonomous Decision Governance Translate OPA policy definitions into agent-actionable decision boundaries bridging the gap between policy-as-code and agent reasoning. Design the autonomy progression model: how agents earn increased autonomy through demonstrated accuracy, how trust degrades after errors, and how the system self-corrects. Build the explainability layer that enables agents to articulate their reasoning chain to human reviewers in business-meaningful terms. Design circuit breaker patterns at the cognitive level agents that recognize when they are outside their competence boundary and proactively escalate rather than guessing. Knowledge Integration & Institutional Memory Design retrieval-augmented reasoning patterns where agents dynamically pull relevant knowledge from vector stores, historical and knowledge data and approval pattern databases during their reasoning process. Build the feedback mechanisms that capture how experienced users correct or override agent recommendations, turning those corrections into improved future reasoning. Agent Evaluation & Quality Design evaluation frameworks for agent behavior not just output accuracy but reasoning quality, appropriate escalation, governance compliance, and user trust metrics. Build scenario-based testing methodologies: synthetic ERP scenarios that test agent behavior across edge cases, ambiguous situations, and adversarial inputs. Define agent performance metrics: task completion rate, escalation accuracy, false positive/negative rates for autonomous decisions, time-to-resolution, and user override frequency. Own the continuous improvement loop: analyze production agent behavior, identify reasoning failures, and refine cognitive architecture to prevent recurrence. Required Experience 7+ years of software engineering experience with strong Python and/or Java proficiency. 3+ years working with AI/ML systems in production, including LLM-based applications. 1+ years designing or building agentic AI systems autonomous agents that reason, plan, use tools, and take actions (not just chatbots or simple RAG). Demonstrated experience with agent frameworks: LangChain/LangGraph, Pydantic AI, CrewAI, AutoGen, Semantic Kernel, or equivalent. Experience with tool-calling / function-calling patterns in LLMs (MCP, OpenAI function calling, Anthropic tool use). Understanding of evaluation methodologies for non-deterministic systems testing outputs that arent binary right/wrong. Experience building systems that handle human-in-the-loop workflows knowing when to pause for human judgment. Required Technical Skills Advanced proficiency. Pydantic AI is primary agent framework; must be fluent.Python: Deep experience with Claude (Anthropic), GPT (OpenAI), or equivalent. Understanding of system prompts, tool calling, streaming, structured output.LLM APIs: Hands-on with at least one: Pydantic AI, LangChain/LangGraph, CrewAI, AutoGen. Ability to evaluate framework trade-offs.Agent Frameworks: Understanding of tool definition, invocation patterns, and how agents interact with external systems through standardized protocols.MCP (Model Context Protocol): Multi-agent communication patterns. Agent discovery, task delegation, capability negotiation.A2A Protocol: How agents retrieve and apply knowledge. Vector search, reranking, context assembly, citation.RAG Architecture: Agent evaluation frameworks (TruLens, Ragas, or custom). Scenario-based testing, adversarial testing, regression testing for agent behavior.Evaluation & Testing: Understanding of durable execution (Restate/Temporal) and how agent reasoning integrates with workflow orchestration. Not owning Restate thats the Platform Engineer but designing agent behavior that works within durable execution patterns.Orchestration Awareness: Preferred Skills Experience with ERP systems (SAP, Oracle EBS, JD Edwards) even basic familiarity with AP, GL, procurement processes is valuable. Java / Quarkus experience the platform stack is Java-native; ability to work across both Python (agents) and Java (platform) is a strong advantage. Reinforcement learning from human feedback (RLHF) or similar alignment techniques. Knowledge graph design representing institutional knowledge as structured, queryable relationships. Formal decision theory or risk assessment frameworks useful for designing autonomy governance. Experience in regulated industries (financial services, healthcare, government) where AI systems must be explainable and auditable. Technical writing this role must document agent architectural decisions, reasoning patterns, and governance frameworks for the broader team.