Eve library

Skills System Gap Analysis Report

Guide

Revision 1

On this page

Date: 2026-04-11 Scope: Complete audit of every skill touchpoint across the Oshun monorepo, cross-referenced with April 2026 SOTA in AI skill systems, auto-generation, composition, evaluation, and improvement.


Executive Summary#

The Oshun monorepo contains 30+ independent skill-like systems across its 45+ domains — from Iris agent tools to Maya game abilities to Nous training methods to Veritas newsroom agents. However, these systems are entirely siloed with no unified framework, no cross-domain composition, no automatic skill generation, no autonomous skill library growth, and no skill-specific quality tracking.

The AI skills landscape has undergone a revolution in 2025-2026:

  • Agent Skills Open Standard (Anthropic, Dec 2025): SKILL.md format adopted by 16+ major AI tools
  • Memento-Skills (March 2026): Agent-designing agents that autonomously grow skill libraries (235 skills, doubled HLE performance)
  • OpenSpace (March 2026): Self-evolving skill engine via MCP, 4.2x performance improvement
  • MCP-Zero (June 2025): Active tool discovery via RL, 98% token reduction
  • SkillX (April 2026): Three-tiered hierarchical skill knowledge (planning/functional/atomic)
  • Skills.sh (Vercel, Jan 2026): Skill marketplace with 147 new skills/day
  • xLAM-2 (Salesforce): SOTA open-source tool-use models, #1 on BFCL

Oshun has none of these. The gap between current state and SOTA is massive.


1. Current Skill Systems Inventory#

1.1 Where Skills Exist Today (30+ Systems Found)#

Domain Skill System Skills Count Has Registry Has Versioning Has Quality Tracking Has Auto-Generation
Iris Agent tool framework 50+ tools Yes Yes Partial No
Iris Computer-use agent 20+ actions No No No No
Iris Agent archetypes 5 archetypes No No No No
Psyche Avatar expression skills 50+ expressions No No Partial No
Psyche Action safety framework 20+ policies No No Yes No
Psyche Accessibility skills 15+ checks No No Yes No
Hathor NPC behavior/dialogue 30+ behaviors No No Partial No
Hathor Quest/narrative skills 20+ operations No No Partial No
Maya Character abilities 100+ abilities Yes (tree) Yes (ranks) Yes (balance) No
Maya Skill tree system 50+ nodes Yes (graph) Yes (ranks) Yes No
Maya Combat skills 30+ mechanics No No Yes No
Maya Crafting recipes Hundreds Yes No Yes (success rate) No
Maya NPC Souls behaviors 76 Rust modules No No Partial No
Nous Training methods 50+ methods No No Yes (loss) No
Nous Safety checks 25+ detectors No No Yes No
Isis Generation workflows 20+ workflows Yes Yes Yes No
Isis AI provider skills 15+ providers Yes No Partial No
Veritas Newsroom agent roles 11+ agents No No Partial No
Veritas Content generation 10+ operations No No Partial No
Metis Educational agents 10+ agents No No Partial No
Metis Assessment skills 10+ types No No Yes No
Yemaya Production pipeline steps 30+ steps Yes No Yes No
Yemaya QA validator skills 50+ validators No No Yes No
Maat Strategic analysis skills 20+ analyses No No Partial No
Bellona Code generation skills 40+ generators No No Partial No
Euterpe Music generation skills 20+ operations No No Partial No
Shakti Fitness training skills 30+ exercises No No Yes No
Aglaea Beauty technique skills 20+ techniques No No Partial No
Aphrodite Game strategy skills 15+ strategies No No Yes No
Uzume Live production skills 50+ operations No No Partial No

Key Finding: Every domain has skills but NONE has: auto-generation, cross- domain composition, autonomous growth, or standardized quality tracking.

1.2 Existing Skill Infrastructure#

Iris is the most mature with:

  • ToolId, ToolVersion, ToolSchema, ToolDefinition types
  • IToolDiscovery interface with search(), recommend(), discoverFrom(), scan()
  • ToolCategory taxonomy (filesystem, web, code, api, database, etc.)
  • ToolCapability flags (stateless, stateful, async, streaming, etc.)
  • Composable pipelines with ToolStepNode, ParallelToolNode, ConditionalToolNode
  • ToolLimits and ToolSecurityRequirements

All other domains have ad-hoc skill structures with no shared framework.


2. Gap Analysis#

GAP 1: No Unified Skill Framework (CRITICAL)#

30+ independent skill systems with incompatible interfaces. No way to:

  • Discover skills across domains
  • Compose skills from different domains
  • Track quality uniformly
  • Share skills between domains

GAP 2: No Autonomous Skill Library Growth (CRITICAL)#

SOTA systems (VOYAGER, Memento-Skills, OpenSpace) autonomously discover, create, verify, and grow skill libraries. Oshun has zero autonomous skill generation.

GAP 3: No Skill Auto-Generation from Documentation (HIGH)#

Gorilla/ToolFactory/APIGen can generate skills from API docs and OpenAPI specs. Oshun has dozens of internal APIs but no doc-to-skill pipeline.

GAP 4: No MCP Skill Integration (HIGH)#

MCP is the de facto protocol (5,800+ servers, donated to Agentic AI Foundation). Oshun has partial MCP integration in Iris but no MCP-based skill ecosystem.

GAP 5: No Skill Quality Tracking Across Domains (HIGH)#

Each domain tracks quality differently (Maya has balance metrics, Nous has loss curves, Iris has execution monitoring). No unified quality framework.

GAP 6: No Skill-Specific Fine-Tuning (HIGH)#

xLAM-2 (Salesforce) shows SOTA tool-use model training. Oshun has no pipeline for fine-tuning models on domain-specific skill execution data.

GAP 7: No Skill Composition Across Domains (HIGH)#

Cannot compose "research (Sophia) → generate image (Isis) → verify quality (Nous) → publish (Yemaya)" as a single composed skill.

GAP 8: No Skill Marketplace/Registry (MEDIUM)#

Skills.sh has 147 new skills/day. ClawHub has 3,286 versioned skills. AWS Agent Registry launched April 2026. Oshun has no equivalent.

GAP 9: No Process Reward Models for Skill Execution (MEDIUM)#

AgentPRM/ToolPRMBench show step-level rewards for multi-step tool use produce better agents than outcome-only rewards. Not implemented.

GAP 10: No Self-Evolving Skill System (MEDIUM)#

OpenSpace's three evolution modes (FIX, DERIVED, CAPTURED) and Memento-Skills' agent-designing-agent pattern have no equivalent.


3. Domain-by-Domain Skill Gaps#

3.1 Iris (Conversational AI)#

  • Has: Tool registry, discovery, composition, pipelines
  • Missing: VOYAGER-style autonomous tool creation, MCP skill wrapping, tool-use fine-tuning data generation, process reward models for tool chains, skill versioning lifecycle, tool quality regression testing, self-improving tool selection

3.2 Psyche (Virtual Assistant)#

  • Has: Expression skills, accessibility checks, action safety
  • Missing: Skill transfer between avatar/voice/perception subsystems, computer- use skill auto-generation from UI analysis, meeting skill auto-discovery

3.3 Maya (Game Engine)#

  • Has: Richest skill system (abilities, skill trees, combat, crafting, NPC Souls)
  • Missing: Dynamic ability rebalancing from player data, ML-based combo discovery, NPC skill learning from player behavior, procedural ability generation

3.4 Nous (Training Platform)#

  • Has: 50+ training methods, 25+ safety checks
  • Missing: Auto-selection of best training method per task, training recipe composition, safety check ensemble optimization

3.5 Isis (Generative Factory)#

  • Has: Workflow registry, provider skills, quality pipelines
  • Missing: Auto-workflow generation from task description, learned parameter optimization, workflow quality prediction

3.6 Veritas (News Agency)#

  • Has: 11+ newsroom agents with role-based skills
  • Missing: Agent skill improvement from article performance, editorial skill transfer, beat-specific skill specialization

3.7 All Other Domains#

  • Mostly ad-hoc skill structures with no standardized definition, discovery, composition, quality tracking, or improvement mechanisms

4.1 Unified Skill Framework#

Build a universal skill definition, registry, and runtime that all 45+ domains can adopt:

  • Canonical UniversalSkill schema (name, parameters, handler, quality metrics, dependencies, versioning, security)
  • Skill registry service with semantic search and discovery
  • Skill composition engine (sequential, parallel, conditional, loop patterns)
  • Skill quality tracking (success rate, latency, cost, user satisfaction)
  • Skill versioning with semver, rollback, and migration
  • Cross-domain skill composition (Sophia research → Isis generation → Nous safety)

4.2 Autonomous Skill Generation & Growth#

Implement VOYAGER/Memento-Skills/OpenSpace patterns:

  • Automatic skill generation from API documentation (Gorilla/ToolFactory pattern)
  • VOYAGER-style autonomous curriculum for skill discovery
  • Memento-Skills pattern for agent-designing-agent (skills stored as markdown, organic growth from execution experience)
  • OpenSpace-style self-evolving skill engine (FIX, DERIVED, CAPTURED modes)
  • MCP-Zero active tool discovery (RL-trained tool request generation)
  • CREATOR-style LLM tool creation (generate both tool code and documentation)

4.3 Skill-Specific Training & Evaluation#

Build training and evaluation infrastructure for skills:

  • Skill execution data collection for fine-tuning (data flywheel connection)
  • xLAM-style tool-use model training pipeline
  • APIGen-MT synthetic multi-turn tool-use data generation
  • Process reward models for multi-step skill execution (AgentPRM/ToolPRMBench)
  • BFCL-style skill evaluation benchmark
  • Skill degradation detection and auto-improvement

4.4 MCP Skill Ecosystem#

Build the MCP-based skill infrastructure:

  • MCP server for every Oshun domain (expose domain capabilities as MCP tools)
  • MCP skill wrapping (MCP tool + SKILL.md prompt template = composable skill)
  • OpenAPI-to-MCP auto-generation for all internal APIs
  • MCP skill marketplace (internal registry + external community skills)
  • MCP skill composition across domains

4.5 Per-Domain Skill Enhancement#

Enhance each domain's skill system with the unified framework:

  • Iris: VOYAGER-style tool library growth + MCP integration + tool-use fine-tuning
  • Maya: Dynamic ability generation + NPC skill learning + combo discovery
  • Nous: Training recipe auto-selection + safety ensemble optimization
  • Isis: Auto-workflow generation + parameter optimization
  • Veritas: Editorial skill improvement from performance data
  • All domains: Adopt unified skill definition + quality tracking

5. SOTA Systems to Integrate#

System What It Does Priority
Agent Skills Standard (SKILL.md) Universal skill format P0
Memento-Skills Agent-designing-agent, organic skill growth P0
OpenSpace Self-evolving skill engine via MCP P0
MCP-Zero Active tool discovery via RL P1
SkillX Three-tiered hierarchical skill knowledge P1
VOYAGER Autonomous curriculum + skill library P1
xLAM-2 SOTA tool-use model training P1
APIGen-MT Multi-turn tool-use data synthesis P1
ToolFactory Auto-generate tools from API docs P1
Gorilla/RAFT Retriever-aware API calling P2
AgentPRM Process reward models for tool agents P2
CREATOR LLM creates its own tools P2
ReAcTree Hierarchical agent trees for composition P2
OpenAI o3/o4 pattern RL-trained native tool reasoning P2
Plan-and-Act Separated planning/execution P2
Skills.sh integration External skill marketplace P3
ClawHub integration External skill registry P3
BFCL v4 Function calling benchmark P1
tau-2-Bench Agent-user interaction evaluation P1
MCPAgentBench MCP tool use benchmark P1