The
libs/isis/area: ~75 Nx libraries that make up Isis, the generative factory — the AI/LLM provider plane, the ComfyUI/job orchestration plumbing, and a deep stack of text-to-3D, mesh, Gaussian-splatting, audio, and video generation surfaces that Oshun's creative tooling is built on.
What this area is#
Isis is Oshun's generative-AI factory. Where most domains own a single
business surface, libs/isis/ is a sprawling toolkit: roughly 75 libraries
(scope:isis in their project.json tags) ranging from a 174k-line unified
provider layer (@isis/ai-providers) down to single-file workflow studios
(@isis/foley-studio, @isis/relight-studio). They divide into a few clear
sub-systems, described below; the catalog further down has one block per node.
The AI/LLM plane (@isis/ai-providers, isis-llm-providers,
isis-llm-orchestrator, isis-batch-llm-processing, isis-token-budget,
isis-prompt-engineering, isis-react-framework, isis-agent-consensus,
isis-model-fine-tuning, plus the §24 governance pair @isis/managed-models
and @isis/entitlements) is the model-access substrate: typed adapters for
Claude/GPT/Gemini/Grok/Ollama and ElevenLabs, registries, rate-limiting, cost
and budget accounting, prompt templating, ReAct agent loops, multi-agent
consensus, and fine-tuning orchestration.
The factory plumbing (@isis/job-envelope, @isis/workflows,
@isis/workflow-classes, the ComfyUI trio @isis/comfyui-sdk /
@isis/comfyui-nodes / @isis/comfyui-factory, @isis/3d-comfyui-nodes,
isis-operation-orchestrator, isis-event-publisher,
@isis/anomaly-detection, @isis/database, @isis/client, @isis/outputs,
@isis/output-gallery, @isis/curated-cards, @isis/runpod-surface) is the
canonical job envelope, ComfyUI workflow schema/DSL, queue/retry orchestration,
event bus, Prisma persistence, the client SDK, and the operator/creator surfaces
(§24).
The bulk of the area is 3D and media generation: a text/image-to-3D core
(@isis/3d-generation, @isis/3d-inference-local, @isis/three-d-pipelines,
and a family of typed model-contract libraries — @isis/fast-generation,
@isis/score-distillation, @isis/hash-encoding, @isis/part-level-3d,
@isis/gigascale-3d, @isis/3d-control, @isis/3d-video-diffusion,
@isis/scene-from-image-composer, @isis/3d-scene-assembly); mesh/topology/
rigging/texturing (@isis/mesh-transformers, @isis/quad-mesh-gen,
@isis/universal-rigging, @isis/ai-texturing, @isis/text-mesh-editing,
@isis/3d-semantic-editing, @isis/video-to-mesh); a Gaussian-splatting
cluster (@isis/gaussian-splatting, @isis/3dgs-advanced,
@isis/3dgs-diffusion-editing, @isis/3dgs-relighting-pbr,
@isis/3d-browser); asset-library/marketplace/ governance/quality
(@isis/3d-asset-library, @isis/3d-marketplace-ops,
@isis/3d-product-parity, @isis/3d-quality-gates,
@isis/3d-generation-benchmarks, @isis/model-governance-3d,
@isis/3d-post-pipeline); audio (@isis/audio-generation,
@isis/music-generation, @isis/foley-studio, @isis/voice-cloning); and a
broad set of video/AV production studios plus face/portrait/dubbing surfaces.
A note on the "contracts" libraries#
Many of the 3D libraries describe themselves as "contracts." In practice they
are typed capability-and-planning libraries: they export workflow constants
(ISIS_*_WORKFLOW), create*Capabilities descriptors, deterministic
create*Plan planners, and a mix of real deterministic compute (e.g.
computeIsisSdsLoss in @isis/score-distillation, LOD edge-collapse ordering
in @isis/quad-mesh-gen, part-quality metrics in @isis/part-level-3d). They
describe, validate, and plan model-backed workflows; the heavy GPU/model
inference itself runs in external runtimes (@isis/3d-inference-local, ComfyUI,
RunPod). Where a package is thin or still scaffolded, the block below says so.
How it fits the wider system#
These libraries are consumed by Isis's own services and BFF, by the Studio/Admin
front-ends (via @isis/client and the §24 surface/entitlement libraries), and
by sibling creative domains — several video/audio studios are explicitly "for
ISIS and Yemaya," and @isis/3d-post-pipeline / @isis/three-d-pipelines carry
Mawu-Studio asset-creation contracts. The dependency shape is layered:
layer:data (@isis/database), layer:clients (@isis/client), and a large
layer:domain core. The AI plane and job/ComfyUI plumbing sit at the bottom;
the 3D/audio/video generation surfaces compose on top of them. Walk the "used
by" edges on any node below to see exactly who depends on it.
Entity catalog (78)#
The 78 tracked Nx projects in isis, each a code-linked entity node — package, type, source path, declared targets, and its internal dependency graph (depends-on / used-by, resolved from the package manifests, §6/§8), read from the project graph. Grouped by architectural layer; walk the dependency links to travel the system. 75 of these carry an authored deep-dive (what / why / how it fits); the rest are generated scaffolds awaiting one.
clients (1)#
TypeScript client SDK for Isis generative AI services
The TypeScript client SDK (layer:clients, libs/isis/client): IsisClient /
createClient / createClientFromEnv with sub-clients such as generation
(textToImage, waitForJob). The typed entry point external callers use to
submit jobs and poll results.
IsisClient31createClient31createClientFromEnv31HealthStatus31ReadinessStatus31HttpTransport44createHttpTransport44RequestBuilder44ErrorCode50ErrorCodeType50IsisError50NetworkError50TimeoutError50AbortError50 +639 moredata (1)#
Database schema and Prisma client for Isis generative AI services
The Isis persistence layer (layer:data, libs/isis/database): the Prisma
client wrapper (createPrismaClient, transaction, executeRaw,
loadGeneratedPrismaClientModule) plus stable schema-aligned domain types. The
generated client makes this one of the larger libraries by line count.
createPrismaClient10getPrismaClient10loadGeneratedPrismaClientModule10connect10disconnect10isConnected10ransaction10xecuteRaw10queryRaw10resetPrismaClientForTests10domain (65)#
Searchable 3D asset marketplace domain contracts, blueprints, and discovery infrastructure for Isis
The searchable 3D asset marketplace library (libs/isis/3d-asset-library, ~27k
LOC): a module-blueprint manifest plus community, core, provenance,
style, and variation sub-modules for discovery, contracts, and asset
blueprints. The catalog/discovery infrastructure for the 3D marketplace.
get3DAssetLibraryModuleBlueprint8ISIS_3D_ASSET_LIBRARY_MANIFEST8list3DAssetLibraryModuleBlueprints8THREE_D_ASSET_LIBRARY_VERSION13Browser-first 3D viewing, gaussian splatting, editing, and inference surfaces for Isis
Browser-first 3D viewing/splatting/editing/inference contracts
(libs/isis/3d-browser, ~27k LOC): a module/blueprint manifest plus a runtime
capability assessor (assessBrowser3DRuntime) that reads navigator/WebGPU
adapter support snapshots and picks a runtime class with a fallback backend. The
browser-side delivery surface for 3D.
VERSION1THREE_D_BROWSER_VERSION1ISIS_3D_BROWSER_LIBRARY_MANIFEST11getBrowser3DModuleBlueprint11listBrowser3DModuleBlueprints11DEFAULT_BROWSER_NAVIGATOR_CAPABILITIES26assessBrowser3DRuntime26createBrowserNavigatorCapabilitiesSnapshot26BROWSER_MESH_VIEWER_BLUEPRINT100BrowserMeshPbrRenderer100BrowserMeshTurntableController100BrowserMeshTurntableViewer100DEFAULT_BROWSER_MESH_VIEWER_BOOTSTRAP_CONFIG100assessBrowserMeshArQuickLookSupport100 +162 moreTyped ComfyUI 3D node and workflow catalog for Isis
A typed catalog of ComfyUI 3D nodes and workflow templates
(libs/isis/3d-comfyui-nodes): node-family descriptors, conditioning modes,
canonical workflow stage definitions, and a Hunyuan3D local runtime descriptor
(ThreeDComfyUiNodeFamilyDescriptor, ThreeDComfyUiHunyuanLocalRuntime). The
3D counterpart to @isis/workflows/@isis/comfyui-sdk.
get3DComfyUiNodesModuleBlueprint178ISIS_3D_COMFYUI_NODES_MANIFEST178list3DComfyUiNodesModuleBlueprints178VERSION183THREE_D_COMFYUI_NODES_VERSION183create3DComfyUiHunyuanLocalRuntime184create3DComfyUiHunyuanPaintLocalRuntime184create3DComfyUiMeshAnythingV2LocalRuntime184create3DComfyUiSf3DLocalRuntime184create3DComfyUiSpar3DLocalRuntime184create3DComfyUiSparc3DLocalRuntime184create3DComfyUiTripoSGLocalRuntime184create3DComfyUiTrellisApiProvider184create3DComfyUiTrellisLocalRuntime184 +168 more3D ControlNet and reference-control contracts for multi-view generation
3D ControlNet / reference-control contracts (libs/isis/3d-control): IP-Adapter
LoRA variant training (dataset manifests, training plans/gates,
runIsis3dIpAdapterLoraVariantTraining) and a face-identity-preservation plan
for multi-view generation. Plans conditioned/controlled multi-view 3D.
VERSION1ISIS_3D_CONTROL_VERSION1ISIS_3D_IP_ADAPTER_LORA_VARIANTS_WORKFLOW2createIsis3dIpAdapterLoraDatasetManifest2createIsis3dIpAdapterLoraTrainingPlan2createIsis3dIpAdapterLoraVariantsCapabilities2runIsis3dIpAdapterLoraVariantTraining2Isis3dIpAdapterLoraDatasetGate2Isis3dIpAdapterLoraDatasetManifest2Isis3dIpAdapterLoraDatasetManifestRequest2Isis3dIpAdapterLoraStyleDomain2Isis3dIpAdapterLoraStyleDomainScores2Isis3dIpAdapterLoraTrainer2Isis3dIpAdapterLoraTrainerRequest2 +239 moreAI-powered 3D asset generation for Isis generative factory
The text/image-to-3D generation core (libs/isis/3d-generation, ~56k LOC):
request/result types and provider abstractions for text-to-3D and image-to-3D
with post-processing (TextTo3DRequest, ImageTo3DRequest, Generated3DModel,
QualityPreset, Model3DFormat). One of the substantial implementations, not a
thin contract.
VERSION6THREE_D_GENERATION_VERSION7TextureFormat13QualityPreset13Model3DCategory13Model3DMetadata13ImageTo3DRequest13Generated3DModel13GeneratedTexture13Generation3DStatus13Provider3DConfig13Provider3DCapabilities13InteriorFaceRemovalOptions13MeshSmoothingOptions13 +318 moreQuality benchmarking suite for Isis 3D generation pipelines
The 3D-generation benchmarking suite (libs/isis/3d-generation-benchmarks):
standardized image and prompt suites with minimum counts and reference-image
profiles, an automated benchmark runner with concurrency limits, and result
storage versioning. Measures pipeline quality against fixed suites.
get3DGenerationBenchmarkModuleBlueprint9ISIS_3D_GENERATION_BENCHMARKS_MANIFEST9list3DGenerationBenchmarkModuleBlueprints9VERSION14THREE_D_GENERATION_BENCHMARKS_VERSION14AUTOMATED_3D_GENERATION_BENCHMARK_RUNNER_VERSION15DEFAULT_3D_GENERATION_BENCHMARK_MAX_CONCURRENT_EXECUTIONS15THREE_D_GENERATION_BENCHMARK_RESULT_STORAGE_VERSION15THREE_D_GENERATION_BENCHMARK_INFRASTRUCTURE_BLUEPRINT15THREE_D_GENERATION_BENCHMARK_INFRASTRUCTURE_COMPLETED_TASK_IDS15THREE_D_GENERATION_BENCHMARK_INFRASTRUCTURE_PLANNED_TASK_IDS15STANDARDIZED_3D_GENERATION_BENCHMARK_IMAGE_SUITE_VERSION15STANDARDIZED_3D_GENERATION_BENCHMARK_MIN_IMAGE_COUNT15STANDARDIZED_3D_GENERATION_BENCHMARK_MIN_PROMPT_COUNT15 +82 moreSelf-hosted 3D inference kernel for Isis local GPU model serving
The self-hosted 3D inference kernel (libs/isis/3d-inference-local, ~76k LOC):
config and runtime contracts for serving 3D models on local GPUs — server/device
config, a GPU memory manager with pressure levels and allocation results, queue
policy, model cache policy, and dispatch envelopes
(createLocal3DGpuMemoryManagerConfig, Local3DDispatchEnvelope). The largest
3D library and the local execution target the contract libraries plan against.
VERSION6THREE_D_INFERENCE_LOCAL_VERSION7DEFAULT_LOCAL_3D_SERVER_HOST9DEFAULT_LOCAL_3D_SERVER_PORT9createLocal3DGpuDeviceConfig9createLocal3DGpuMemoryManagerConfig9createLocal3DInferenceServerConfig9createLocal3DModelCachePolicy9createLocal3DQueuePolicy9Local3DInferenceServerConfigOverrides9Local3DCompatibleRequest20Local3DDispatchEnvelope20Local3DGenerationKind20Local3DGpuDeviceConfig20 +1465 moreMarketplace trust, IP governance, listing controls, and seller operations for Isis 3D asset commerce
Marketplace trust and IP-governance ops (libs/isis/3d-marketplace-ops, ~2.2k
LOC over many small modules): seller/publisher verification workflows
(planSellerVerificationWorkflow), license declaration, and listing controls.
Bootstrap-manifest style — the seller-operations side of 3D commerce.
ISIS_3D_MARKETPLACE_OPS_LIBRARY_MANIFEST5THREE_D_MARKETPLACE_OPS_DOMAIN_ID5THREE_D_MARKETPLACE_OPS_MODULE_IDS5THREE_D_MARKETPLACE_OPS_VERSION10VERSION10lanSellerVerificationWorkflow19THREE_D_MARKETPLACE_PUBLISHER_TYPE_VALUES19THREE_D_MARKETPLACE_VERIFICATION_REQUIREMENT_VALUES19THREE_D_MARKETPLACE_VERIFICATION_STATUS_VALUES19createRightsDeclarationPlan34THREE_D_MARKETPLACE_DECLARATION_CONTEXT_VALUES34THREE_D_MARKETPLACE_DECLARATION_STATUS_VALUES34THREE_D_MARKETPLACE_LICENSE_GRANT_SCOPE_VALUES34THREE_D_MARKETPLACE_OWNERSHIP_KIND_VALUES34 +48 moreUnified post-processing pipeline orchestration for Isis 3D generation
Unified 3D post-processing orchestration (libs/isis/3d-post-pipeline, ~31k
LOC): a module-blueprint manifest plus Mawu-Studio asset import/attribution
contracts (import receipts, mapped materials, pipeline diagnostics, eval
fixtures/reports). Stitches post-processing stages after generation and bridges
to Mawu Studio.
get3DPostPipelineModuleBlueprint8ISIS_3D_POST_PIPELINE_MANIFEST8list3DPostPipelineModuleBlueprints8createMawuStudioAssetPipelineEvalFixture33importMawuStudioAsset33mapMawuStudioAssetMaterial33MAWU_STUDIO_ASSET_IMPORT_FORMATS33MAWU_STUDIO_ASSET_PIPELINE_EVAL_SCHEMA_VERSION33MAWU_STUDIO_ASSET_TEXTURE_CHANNELS33lanMawuStudioNaniteOptimization33runMawuStudioAssetPipelineEval33VERSION43THREE_D_POST_PIPELINE_VERSION43complete3DPostPipelineExecutionMonitor106 +485 morePrompting, input-quality assistance, review flows, and downstream parity primitives for Isis 3D product workflows
Prompting and product-parity primitives (libs/isis/3d-product-parity, ~2k
LOC): a prompt helper with scored dimensions (create3DPromptHelper) and a
structured prompt builder targeting topology/export targets
(buildStructured3DPrompt), plus review-flow primitives. Input-quality
assistance for 3D product workflows.
ISIS_3D_PRODUCT_PARITY_LIBRARY_MANIFEST5THREE_D_PRODUCT_PARITY_DOMAIN_ID5THREE_D_PRODUCT_PARITY_MODULE_IDS5THREE_D_PRODUCT_PARITY_VERSION10VERSION10create3DPromptHelper16THREE_D_PROMPT_HELPER_DIMENSION_VALUES16buildStructured3DPrompt23THREE_D_PROMPT_EXPORT_TARGET_VALUES23THREE_D_PROMPT_TOPOLOGY_TARGET_VALUES23createPromptEnhancementPlan32createReferenceImagePreprocessPlan38THREE_D_REFERENCE_IMAGE_ACTION_VALUES38createSketchConditioningPlan47 +38 moreRelease-gate taxonomy and review governance primitives for Isis 3D generation
Release-gate taxonomy and review governance (libs/isis/3d-quality-gates): a
failure-taxonomy with count3DQualityFailureDefinitions, a gold-standard
benchmark corpus with coverage summaries and acceptance/approval records, and
corpus/operations/taxonomy blueprints. The quality-gate vocabulary for 3D
output.
count3DQualityFailureDefinitions10get3DQualityGatesModuleBlueprint10ISIS_3D_QUALITY_GATES_MANIFEST10list3DQualityGatesModuleBlueprints10THREE_D_QUALITY_GATES_CORPUS_BLUEPRINT10THREE_D_QUALITY_GATES_OPERATIONS_BLUEPRINT10THREE_D_QUALITY_GATES_TAXONOMY_BLUEPRINT10VERSION19THREE_D_QUALITY_GATES_VERSION19create3DQualityGoldStandardBenchmarkCorpus34get3DQualityGoldStandardBenchmarkExemplarsByCategory34get3DQualityGoldStandardBenchmarkExemplarsByUseCase34ISIS_3D_QUALITY_GOLD_STANDARD_BENCHMARK_CORPUS34list3DQualityGoldStandardBenchmarkExemplars34 +157 moreSemantic scene graph, kitbash assembly, and placement validation primitives for Isis 3D workflows
Semantic scene assembly (libs/isis/3d-scene-assembly, ~1.9k LOC): a semantic
scene graph with nodes/connectors/constraints, material bindings, and provenance
(createThreeDSemanticSceneGraph, ThreeDSceneConstraintKind), backing kitbash
assembly and placement validation. Bootstrap-manifest style with a real
scene-graph core.
ISIS_3D_SCENE_ASSEMBLY_LIBRARY_MANIFEST2THREE_D_SCENE_ASSEMBLY_DOMAIN_ID2THREE_D_SCENE_ASSEMBLY_MODULE_IDS2THREE_D_SCENE_ASSEMBLY_VERSION7VERSION7createThreeDSemanticSceneGraph20THREE_D_CONNECTOR_KIND_VALUES20THREE_D_CONSTRAINT_KIND_VALUES20THREE_D_SCENE_NODE_KIND_VALUES20createThreeDPlacementRulesResult32createThreeDConnectorTaxonomyManifest38THREE_D_CONNECTOR_PROFILE_VALUES38createThreeDCollisionValidationResult48createThreeDSymmetryPlacementPlan54 +260 moreSemantic part decomposition and localized 3D editing contracts for Isis
Semantic part decomposition and localized editing
(libs/isis/3d-semantic-editing): semantic part nodes/assemblies with masks and
confidence, cross-format part metadata read/write for glTF/USDA/blend payloads
(readLocal3DSemanticMetadataFromGltfJson/…Usda/…BlendPayload), and
assembly validation. Bridges semantic part data across DCC formats.
THREE_D_SEMANTIC_EDITING_VERSION1VERSION1createSemanticPartAssembly2createSemanticPartNode2SemanticPartAssembly2SemanticPartConfidence2SemanticPartHierarchyLevel2SemanticPartInstanceLabel2SemanticPartInstanceRole2SemanticPartLabel2SemanticPartMaskRef2SemanticPartMaskSpace2SemanticPartNode2LOCAL_3D_SEMANTIC_METADATA_HANDOFF_VERSION15 +283 moreSV3D-style video diffusion contracts for image-conditioned multi-view 3D reconstruction
SV3D-style video-diffusion contracts for image-conditioned multi-view
reconstruction (libs/isis/3d-video-diffusion): custom camera-trajectory
construction with emphasis frames/regions, and a video-diffusion ↔
mesh-transformer hybrid generator
(generateIsisVideoDiffusionMeshTransformerHybrid).
VERSION1ISIS_3D_VIDEO_DIFFUSION_VERSION1ISIS_CUSTOM_CAMERA_TRAJECTORY_WORKFLOW2createIsisCustomCameraTrajectory2createIsisCustomCameraTrajectoryCapabilities2createIsisCustomCameraTrajectoryPlan2IsisCameraEmphasisFrame2IsisCameraEmphasisRegion2IsisCameraEmphasisTarget2IsisCustomCameraAzimuthRange2IsisCustomCameraInterpolation2IsisCustomCameraOrbitDirection2IsisCustomCameraScalarRange2IsisCustomCameraTrajectoryCapabilities2 +136 moreAdvanced 3D Gaussian Splatting production contracts for Isis
Advanced 3DGS production contracts (libs/isis/3dgs-advanced): GI-GS global
illumination (G-buffer/decomposition plans), MiLo mesh-in-loop extraction,
reflective-GS integration, SplatPainter interactive editing, and
confidence-based mesh extraction, over a shared common module with
scene/camera/light validators. Production-grade splatting techniques as typed
plans.
THREE_DGS_ADVANCED_VERSION1VERSION1createBufferRef2safeArtifactSegment2validateCameraViews2validateEnvironmentLights2validateSceneAsset2Isis3DGSAdvancedBufferRef2Isis3DGSAdvancedCameraView2Isis3DGSAdvancedEnvironmentLight2Isis3DGSAdvancedRuntimeBackend2Isis3DGSAdvancedRuntimeSettings2Isis3DGSAdvancedScalarType2Isis3DGSAdvancedSceneAsset2 +98 moreDiffusion-guided 3D Gaussian Splatting editing contracts for Isis
Diffusion-guided 3DGS editing (libs/isis/3dgs-diffusion-editing): a GaussCtrl
model-integration plan with depth conditioning, latent alignment, cross-view
consistency, and propagation graphs
(createIsis3DGSGaussCtrlModelIntegrationPlan). Plans diffusion-driven edits
over a splat scene.
THREE_DGS_DIFFUSION_EDITING_VERSION1VERSION1ISIS_3DGS_GAUSSCTRL_MODEL_INTEGRATION_WORKFLOW2createIsis3DGSGaussCtrlModelIntegrationCapabilities2createIsis3DGSGaussCtrlModelIntegrationPlan2Isis3DGSGaussCtrlCameraCalibration2Isis3DGSGaussCtrlCapabilities2Isis3DGSGaussCtrlConsistencyPlan2Isis3DGSGaussCtrlDepthConditioningPlan2Isis3DGSGaussCtrlDevice2Isis3DGSGaussCtrlGuidance2Isis3DGSGaussCtrlLatentAlignmentPlan2Isis3DGSGaussCtrlModelIntegrationPlan2Isis3DGSGaussCtrlModelIntegrationRequest2 +243 moreMaterial-decomposed 3D Gaussian Splatting relighting contracts for Isis
Material-decomposed 3DGS relighting (libs/isis/3dgs-relighting-pbr): a
LumiGauss model loader with geometry/material/transfer-coefficient buffer
layouts and integrity checks, plus a LumiGauss training pipeline
(createIsisLumiGaussModelLoaderPlan,
createIsisLumiGaussTrainingPipelinePlan). Decomposes splats into PBR materials
for relighting.
THREE_DGS_RELIGHTING_PBR_VERSION1VERSION1ISIS_LUMIGAUSS_MODEL_LOADER_WORKFLOW2createIsisLumiGaussModelLoaderCapabilities2createIsisLumiGaussModelLoaderPlan2IsisLumiGaussBufferLayoutEntry2IsisLumiGaussBufferLayoutPlan2IsisLumiGaussBufferRef2IsisLumiGaussDevice2IsisLumiGaussDimension2IsisLumiGaussGeometryBuffers2IsisLumiGaussIntegrityCheck2IsisLumiGaussMaterialBuffers2IsisLumiGaussMaterialChannel2 +203 moreUnified AI provider adapters for Isis generative factory
The unified AI-provider layer and the area's largest library (~174k LOC). Its
barrel (libs/isis/ai-providers/src/index.ts) exports typed adapters and
factories for LLMs (Anthropic Claude, OpenAI GPT, Google Gemini, xAI Grok,
Ollama via createClaude/createGPT/…), ElevenLabs TTS and Agents Platform 2.0
conversational AI, the Civitai model registry, RunComfy serverless execution, a
usage/cost/budget tracker, and a caching AIProviderFactory. The provider spine
the rest of Isis calls models through.
VideoProcessingOperation90RTXGPUTier90HardwareCapabilities90MemoryOptimizationConfig90VideoProcessingResolution90ResolutionDimensions90VSRQualityMode90VSRScaleFactor90RTXVSRConfig90VSRRequest90VSRResponse90HDRFormat90ColorSpace90ToneMappingAlgorithm90 +770 moreAI-native PBR texture generation and refinement for Isis 3D pipelines
AI-native PBR texturing (libs/isis/ai-texturing, ~28k LOC): capability
builders for AI-based texture baking, Hunyuan3D-Paint image-guided PBR, and
PBR-aware super-resolution, denoising, detail synthesis, and compression
(createLocal3DHunyuan3DPaintImageGuidedPbrCapabilities, …). Generates and
refines material maps for generated meshes.
VERSION72LOCAL_3D_AI_TEXTURING_TEXTURE_RESOLUTIONS74LOCAL_3D_AI_TEXTURING_NATIVE_TEXTURE_RESOLUTIONS75LOCAL_3D_AI_TEXTURING_POSTSCALED_TEXTURE_RESOLUTIONS76LOCAL_3D_AI_TEXTURING_PLANNED_TEXTURE_RESOLUTIONS77LOCAL_3D_AI_TEXTURING_WORKFLOW_MODES79LOCAL_3D_AI_TEXTURING_PLANNED_WORKFLOW_MODES97Local3DAiTexturingTextureResolution99Local3DAiTexturingNativeTextureResolution101Local3DAiTexturingPostScaledTextureResolution103Local3DAiTexturingPlannedTextureResolution105Local3DAiTexturingWorkflowMode107Local3DAiTexturingPlannedWorkflowMode108Local3DAiTexturingPackageManifest111 +413 moreAnomaly detection and fraud prevention for the Isis (Generative Factory) domain
Anomaly detection and fraud prevention for the factory
(libs/isis/anomaly-detection): an AnomalyDetectionService for suspicious
activity, chargeback prediction, and account protection (RiskLevel,
DetectionStatus, ActionType). A compact three-file service over rule/risk
types.
AnomalyDetectionService11getAnomalyDetectionService11createAnomalyDetectionService11resetAnomalyDetectionService11userId19ransactionId19AI-powered audio generation - music synthesis, voice synthesis, and sound effects
AI audio generation (libs/isis/audio-generation, ~16k LOC): music synthesis,
voice synthesis, and sound-effects generation with shared audio-format/metadata
types (MusicGenerationRequest, VoiceID, audio format/sample-rate/bit-depth
types). The general-purpose audio factory surface.
VERSION6AUDIO_GENERATION_VERSION7SampleRate13BitDepth13ChannelConfig13TimeSignature13AudioMetadata13MusicMood13MusicGenerationRequest13MusicGenerationResult13MusicGenerationStatus13VoiceGender13VoiceAge13VoiceInfo13 +48 moreJoint audio-video narrative production orchestration for ISIS and Yemaya
Joint audio-video narrative production for ISIS and Yemaya
(libs/isis/av-narrative-studio, a single ~2.2k-line module): AV stems
(dialogue/music/effects/ambient) sourced from Seedance joint-AV or editor
generation, narrative shot/transition types, narrative templates, and ProRes/
DNxHR + broadcast-WAV export. Orchestrates synchronized AV storytelling.
AvStemKind3AvStemSource5AvGenerationStatus7AvQualityStatus9AvVideoExportFormat11AvAudioExportFormat13NarrativeShotType15NarrativeTransitionType23NarrativeTemplateId25NarrativeApprovalStatus32NarrativeExportMode34NarrativeExportMetadataFormat36RecreationChangeTarget38ReferenceAssetKind40 +57 moreComfyUI workflow factory — approved class catalog, guardrails, diff, portability, rehearsal (§24.3)
The ComfyUI workflow factory (§24.3, libs/isis/comfyui-factory, ~430 LOC):
an approved workflow-class catalog with guardrails, template-diff,
portability-check, and a rehearsal-harness. Compact but real — it governs
and diffs the approved class set rather than executing graphs.
A Python package (lang:python,
libs/isis/comfyui-nodes/src/isis_comfyui_nodes) of real ComfyUI custom nodes
backing Oshun's spiritual/sacred-art workflows — consciousness,
sacred_geometry, lilith (asset I/O + metadata), spiritual_styles, and
vfx_post node sets, with pytest suites (tests/test_vfx_post_nodes.py,
tests/test_lilith_nodes.py) and example workflow JSON. The only Python node
library in the area; it has no TS barrel.
ComfyUI Nodes 2.0 SDK with typed connections, validation, discovery, and testing framework
The "ComfyUI Nodes 2.0" SDK (libs/isis/comfyui-sdk): a typed connection system
with branded socket types (INT/FLOAT/IMAGE), node versioning with
migration paths, node discovery/introspection, a validation system, and an
auto-generating testing/benchmark framework (NodeSpec, createNodeValidator).
For building ComfyUI nodes safely.
isPrimitiveType95isTensorType95isModelType95isMediaType95INT95FLOAT95BOOLEAN95STRING95ENUM95IMAGE95MASK95LATENT95CONDITIONING95JSON_TYPE95 +40 moreCurated creator generation cards bound to approved workflow classes (§24.6)
Curated creator generation cards (§24.6, libs/isis/curated-cards): card
types, validators, a preflight checker, an entitlement gate, and a catalog
(card-types/card-validators/preflight/entitlement-gate/catalog). Cards
are bound to approved workflow classes so curated creators get safe, pre-vetted
generation presets.
Tier resolver + surface allowlist for generation-tool exposure (§24.1)
The generation-tier resolver and surface allowlist (§24.1,
libs/isis/entitlements): generation-tier.ts deterministically maps an
entitlement bundle to a tier (operator-admin / aaa-creator /
curated-creator / contemplative) and a surface allowlist, and
studio-boundary.ts enforces the studio edge. The documented single source of
truth BFF/Admin/Studio middleware consult before rendering any generation
surface.
AI face synthesis and de-aging orchestration for Isis
AI face synthesis, de-aging, and identity-transfer orchestration
(libs/isis/face-synthesis): notably an ethical-safeguards planner with consent
records, watermark modes, safeguard alerts/decisions, usage contexts, and audit
event plans (FaceSynthesisEthicalSafeguardsPlanner). Consent/safeguard-first
by construction.
FACE_SYNTHESIS_CONSENT_STATUSES6FACE_SYNTHESIS_SAFEGUARD_ALERTS6FACE_SYNTHESIS_SAFEGUARD_DECISIONS6FACE_SYNTHESIS_USAGE_CONTEXTS6FACE_SYNTHESIS_WATERMARK_MODES6FaceSynthesisEthicalSafeguardsPlanner6createFaceSynthesisEthicalSafeguardsPlanner6FaceSynthesisAuditEventPlan6FaceSynthesisConsentRecord6FaceSynthesisConsentStatus6FaceSynthesisEthicalSafeguardsPlan6FaceSynthesisEthicalSafeguardsRequest6FaceSynthesisEthicalSafeguardsResult6FaceSynthesisEthicalSafeguardsSummary6 +215 moreFast 3D generation contracts for rectified flow and consistency-model training
Fast-3D contracts for rectified-flow and consistency-model workflows
(libs/isis/fast-generation): a consistency-mesh-transformer pipeline with a
real runIsisConsistencyMeshTransformerPipeline, latency budgets, and a
generation-speed benchmark with GPU-tier/method profiles. Plans and benchmarks
low-latency 3D generation.
VERSION1ISIS_FAST_GENERATION_VERSION1ISIS_CONSISTENCY_MESH_TRANSFORMER_PIPELINE_WORKFLOW2createIsisConsistencyMeshTransformerPipelineCapabilities2createIsisConsistencyMeshTransformerPipelinePlan2runIsisConsistencyMeshTransformerPipeline2IsisConsistencyMeshTransformerLatencyBudget2IsisConsistencyMeshTransformerMesh2IsisConsistencyMeshTransformerModel2IsisConsistencyMeshTransformerPipelineCapabilities2IsisConsistencyMeshTransformerPipelineGate2IsisConsistencyMeshTransformerPipelinePlan2IsisConsistencyMeshTransformerPipelinePlanRequest2IsisConsistencyMeshTransformerPipelineResult2 +260 moreProduction foley and sound design orchestration for ISIS and Yemaya
Foley and sound-design orchestration for ISIS and Yemaya
(libs/isis/foley-studio, a single ~1.3k-line module): detected foley events
typed by kind/material/intensity, provider options (foleycrafter, av-link,
any2audio), DAW targets, and AAF/OMF/BWF-P export. Production foley as a typed
workflow.
FoleyInferenceProvider3FoleyEventKind5FoleyMaterial7FoleyIntensity9FoleyGenerationStatus11FoleyReviewStatus13FoleyExportFormat15FoleySceneEnvironment17SoundEditingDaw19SoundQualityStatus21FoleyDetectedEvent23FoleyGeneratedAsset40FoleyGenerationQueueItem53FoleySweeteningControls64 +29 moreEnd-to-end 3D Gaussian Splatting pipeline for real-time neural rendering
The end-to-end 3D Gaussian-Splatting pipeline (libs/isis/gaussian-splatting,
~31k LOC): real multi-camera capture (CaptureManager,
FileSystemCameraProvider, SharpFrameQualityAnalyzer using sharp),
preprocessing, training, rendering, and optimization. A substantial implemented
pipeline, not just types.
CaptureManager12InMemoryCaptureStorage12FileSystemCameraProvider12TimestampSyncProvider12SharpFrameQualityAnalyzer12PreprocessingManager32SharpImageProcessor32SubprocessMaskGenerator32SubprocessDepthEstimator32ColmapSfMProvider32ColmapDenseReconstructionProvider32InMemoryPreprocessingStorage32TrainingManager56SubprocessTrainingBackend56 +137 moreGigascale and next-generation 3D model integration contracts for Isis
Next-generation 3D-model integration contracts (libs/isis/gigascale-3d): typed
profiles and readiness evaluation for large external models — a CHORD PBR
pipeline (createIsisChordPbrGenerationPlan, evaluateIsisChordPbrReadiness)
and Direct3D-S2 (DIRECT3D_S2_MODEL_ID), with license-policy and runtime
device/OS modelling. Describes how gigascale models slot into Isis.
VERSION1ISIS_GIGASCALE_3D_VERSION1CHORD_CHECKPOINT2CHORD_COMFYUI_REPOSITORY2CHORD_MODEL_ID2CHORD_REPOSITORY2ISIS_CHORD_PBR_WORKFLOW2buildIsisChordPbrPipelinePayload2createIsisChordPbrGenerationPlan2createIsisChordPbrIntegrationCapabilities2createIsisChordPbrModelProfile2valuateIsisChordPbrReadiness2IsisChordLicensePolicy2IsisChordPbrGenerationGate2 +150 moreMulti-resolution hash-grid encoding contracts for neural fields
Multi-resolution hash-grid encoding for neural fields
(libs/isis/hash-encoding): streaming level selection/update plans and an
export path that serializes hash-encoded meshes/textures (e.g.
serializeIsisHashEncodedMeshToObj, exportIsisHashEncodedMesh). The
Instant-NGP-style encoding contracts plus real OBJ/texture export.
VERSION1ISIS_HASH_ENCODING_VERSION1ISIS_HASH_ENCODING_STREAMING_WORKFLOW2createIsisHashEncodingStreamingCapabilities2createIsisHashEncodingStreamingPlan2createIsisHashEncodingStreamingUpdate2selectIsisHashEncodingStreamingLevels2IsisHashEncodingStreamingCapabilities2IsisHashEncodingStreamingLevel2IsisHashEncodingStreamingPlan2IsisHashEncodingStreamingPlanRequest2IsisHashEncodingStreamingSelection2IsisHashEncodingStreamingSelectionRequest2IsisHashEncodingStreamingUpdate2 +137 moreLoRA training queue + model merging + tuning rehearsal + quality scoring + lineage (§24.5)
The LoRA training surface (§24.5, libs/isis/lora-training-surface, ~720
LOC): training-run, model-merging, quality-view, and lineage-tree
modules — the training queue, model merging, tuning rehearsal, quality scoring,
and lineage tracking for creator-trained LoRAs.
Managed-model registry browser exposing only post-intake approved models (§24.2)
A thin but real registry-browser surface (libs/isis/managed-models, ~74 LOC):
the barrel re-exports ./browser/index, exposing only post-intake approved
models to the creator UI (§24.2). Small by design — it is a governed view over
the model registry, not a model store itself.
MeshGPT, PolyGen, and MeshXL transformer contracts for Isis mesh generation
Autoregressive mesh-generation transformer contracts
(libs/isis/mesh-transformers): MeshGPT architecture (VQ-VAE tokenizer +
decoder, face-token sequences), vocabulary learning, and the broader
MeshGPT/PolyGen/MeshXL family (createIsisMeshGptArchitecturePlan,
IsisMeshGptVqVaeTokenizerConfig). Typed model architectures and training
objectives for mesh tokenization.
VERSION1ISIS_MESH_TRANSFORMERS_VERSION1ISIS_MESHGPT_ARCHITECTURE_WORKFLOW2createIsisMeshGptArchitectureCapabilities2createIsisMeshGptArchitecturePlan2createIsisMeshGptFaceTokenSequence2IsisMeshGptArchitectureCapabilities2IsisMeshGptArchitectureGate2IsisMeshGptArchitecturePlan2IsisMeshGptArchitectureRequest2IsisMeshGptAutoregressiveDecoderArchitecture2IsisMeshGptConditioningMode2IsisMeshGptFaceFeatureChannel2IsisMeshGptFaceToken2 +196 moreLicense, deployment, and compliance governance primitives for Isis 3D model pipelines
License/deployment/compliance governance for 3D models
(libs/isis/model-governance-3d): an exception-approval workflow with audit
entries (create3DModelGovernanceExceptionApproval,
evaluate3DModelGovernanceExceptionApproval) and near-duplicate checking. The
compliance gate before a 3D model is usable.
ISIS_3D_MODEL_GOVERNANCE_LIBRARY_MANIFEST5THREE_D_MODEL_GOVERNANCE_DOMAIN_ID5THREE_D_MODEL_GOVERNANCE_MODULE_IDS5create3DModelGovernanceExceptionApproval21valuate3DModelGovernanceExceptionApproval21THREE_D_MODEL_GOVERNANCE_EXCEPTION_APPROVAL_STATUS_VALUES21THREE_D_MODEL_GOVERNANCE_EXCEPTION_AUDIT_EVENT_TYPE_VALUES21create3DModelGovernanceNearDuplicateRegistry37ThreeDModelGovernanceNearDuplicateRegistry37THREE_D_MODEL_GOVERNANCE_PROTECTED_ASSET_SET_KIND_VALUES37check3DModelGovernanceIpPolicy52DEFAULT_3D_MODEL_GOVERNANCE_IP_POLICY_CATALOG52THREE_D_MODEL_GOVERNANCE_IP_POLICY_CATEGORY_VALUES52THREE_D_MODEL_GOVERNANCE_IP_POLICY_SCOPE_VALUES52 +63 moreInteractive motion and camera control orchestration for ISIS and Yemaya
Interactive motion and camera-control orchestration for ISIS and Yemaya
(libs/isis/motion-camera-control, a single ~835-line module):
camera-trajectory presets (orbit/dolly/crane/…), easing curves, and motion
validation that flags teleportation, interpenetration, impossible acceleration,
and gravity violations (MotionValidationIssueKind).
MotionCameraProvider3MotionEasing5CameraTrajectoryPreset7MotionValidationIssueKind17MotionBatchTargetKind23MotionVector225MotionVector330MotionControlPoint36MotionSpeedSample42MotionObjectTrack49CameraKeyframe61CameraTrajectoryPath70MotionSignature80MotionPreviewState88 +10 moreMusic + ambient audio generation: provider abstraction, workflow classes, watermark + provenance (§24.8)
Music + ambient generation (§24.8, libs/isis/music-generation, ~540 LOC): a
provider abstraction, guardrails, provenance, and stems modules. Compact
— the governed, watermark/provenance-aware music surface layered over a provider
seam.
Unified output gallery: filters, lineage, branch/replay, compare grid, bulk actions (§24.10)
The unified output gallery surface (§24.10, libs/isis/output-gallery):
output-record, lineage, branch-replay, compare-grid, and bulk-actions
modules — filters, lineage, branch/replay, side-by-side compare, and bulk
operations over generated outputs.
Output manifest schema, provenance tracking, and lineage graph utilities for generated assets
The output manifest and provenance layer (libs/isis/outputs): the
OutputFile/ manifest schema, provenance records, and lineage-graph utilities
(ManifestId, ProvenanceId, LineageNodeId, QualityTier, FileHash).
Describes and tracks the artifacts a generation job produces.
VERSION6OUTPUTS_VERSION7OutputFileBuilder59LICENSE_PRESETS59createManifest59createOutputFile59getLicensePreset59InMemoryManifestStorage59createInMemoryManifestStorage59ManifestValidator59createManifestValidator59validateManifest59ProvenanceBuilder82ProvenanceStorageProvider82 +13 morePart-level 3D generation contracts for PartGen-style compositional assets
Part-level, PartGen-style compositional 3D generation
(libs/isis/part-level-3d): a part-quality metrics computer
(computeIsisPartGenerationQualityMetrics) and a text-driven scene-composition
planner (composeIsisSceneFromText, createIsisScenePartGenObjectGenerator).
Generates and scores compositional multi-part assets.
VERSION1ISIS_PART_LEVEL_3D_VERSION1ISIS_PART_QUALITY_METRICS_WORKFLOW2computeIsisPartGenerationQualityMetrics2createIsisPartQualityMetricsCapabilities2createIsisPartQualityMetricsPlan2valuateIsisPartGenerationQuality2IsisPartGenerationQualityMetrics2IsisPartQualityCompositionContext2IsisPartQualityMetricsCapabilities2IsisPartQualityMetricsGate2IsisPartQualityMetricsPlan2IsisPartQualityMetricsPlanRequest2IsisPartQualityMetricsRequest2 +126 moreVirtual presenter and performance orchestration for ISIS and Yemaya
Virtual-presenter and performance orchestration for ISIS and Yemaya
(libs/isis/portrait-studio, a single ~1.2k-line module): inference providers
(Hallo3/LivePortrait/MuseTalk/RAP), voice providers, presenter emotion/camera
angles, lip-sync quality gates (syncnet/face-embedding), and multi-language
dubbing types.
PortraitInferenceProvider3PortraitVoiceProvider5PresenterEmotion7PresenterCameraAngle9PortraitReferenceStyle15PortraitQualityGateKind17PortraitQualityGateStatus19DubbingLanguageCode21DubbingPhonemeProfile23DubbingApprovalStatus25PortraitReference27PresenterVoice36ScriptLineDirection45PresenterGeneratedVideo56 +26 morePer-production AI post-production analysis and model orchestration for Isis
Per-production post-production intelligence (libs/isis/post-production-ai,
~31k LOC): a library manifest of analysis capabilities, a dailies-ingestion
pipeline with staged timing and a media-probe seam (DailiesIngestionPipeline,
NoopDailiesMediaProbe as the fail-safe default), and per-production model
training/orchestration for AI-assisted finishing.
VERSION7SUPPORTED_DAILIES_CODECS7createPostProductionLibraryManifest7SupportedDailiesCodec7PostProductionAnalysisCapability7PostProductionLibraryManifest7DAILIES_INGESTION_STAGES16DailiesIngestionPipeline16NoopDailiesMediaProbe16createDailiesIngestionPipeline16createNoopDailiesMediaProbe16DailiesEntryKind16DailiesIngestionEntry16DailiesIngestionPipelineOptions16 +672 moreQuad-dominant mesh generation contracts for QuadGPT and layout-first topology workflows
Quad-dominant mesh generation (libs/isis/quad-mesh-gen): a QuadGPT-style
LOD-chain generator with real edge-collapse ordering
(createIsisQuadMeshEdgeCollapseOrder, generateIsisQuadMeshLodChain) and a
game-ready pipeline with procedural PBR synthesis, boundary-seam prediction, and
engine exporters (runIsisQuadMeshGameReadyPipeline).
VERSION1ISIS_QUAD_MESH_GEN_VERSION1ISIS_QUAD_MESH_LOD_CHAIN_WORKFLOW2createIsisQuadMeshEdgeCollapseOrder2createIsisQuadMeshLodChainCapabilities2createIsisQuadMeshLodChainPlan2generateIsisQuadMeshLodChain2IsisQuadMeshEdgeCollapse2IsisQuadMeshLodChainCapabilities2IsisQuadMeshLodChainGate2IsisQuadMeshLodChainPlan2IsisQuadMeshLodChainPlanRequest2IsisQuadMeshLodChainRequest2IsisQuadMeshLodChainResult2 +142 moreGenerative relighting workflow orchestration for ISIS and Yemaya
Generative relighting workflow orchestration for ISIS and Yemaya
(libs/isis/relight-studio, a single ~2.4k-line module): light types/falloff,
preview engines (ic-light/genlit/lightlab), lighting presets
(golden-hour/rembrandt/butterfly/…), comparison modes, batch scopes, and
NLE/comp export hosts.
RelightLightType1RelightFalloffCurve2RelightPreviewEngine3RelightEnvironmentCategory4RelightPresetId11RelightComparisonMode21RelightBatchScopeKind26RelightExportHost27RelightNleHost28RelightNleInterchangeFormat29RelightConsistencyLockDimension30RelightContinuitySeverity38RelightExrCompression39RelightAnimationInterpolation40 +49 moreRunPod operator surface data model — endpoint registry, dashboard, cost/quota, queue inspector (§24.4)
The RunPod operator surface data model (§24.4, libs/isis/runpod-surface):
endpoint-registry, cost-quota, queue-inspector, and secret-rotation
modules — the typed dashboard model for managing serverless GPU endpoints.
End-to-end scene-from-image composer for the Isis generative AI factory (block B of the ISIS_GAPS plan)
Scene-from-single-image composition (block B of ISIS_GAPS,
libs/isis/scene-from-image-composer, ~9.3k LOC across 66 non-test files). A
substantial, fully-wired pipeline: the barrel exports working
composeSceneFromImage / createSceneFromImagePipeline entry points plus a
runPhases orchestrator over nine ordered phases
(environment/grounding/detection/objects/align/bake/coherence/audio/manifest),
alongside a real align/ module (alignMeshToSplatFrame, anchor resolution
with UnknownAnchorError/UnresolvableAnchorsError), object cropping,
detection, and a mesh-provider router.
AlignmentError14alignMeshToSplatFrame14buildPlacement14isConcreteAnchor14resolveAnchor14resolveAnchors14UnknownAnchorError14UnresolvableAnchorsError14AlignMeshToSplatFrameInput14AnchorInput14AnchorSpec14ResolvedPosition14CropError29cropImage29 +85 moreScore Distillation Sampling contracts and loss utilities for Isis text-to-3D generation
Score Distillation Sampling for text-to-3D (libs/isis/score-distillation):
genuine deterministic SDS math — computeIsisSdsLoss, addIsisSdsNoise,
Gaussian-noise and linear noise-schedule builders, parameter-update and
optimization-step helpers (IsisSdsLossResult, IsisSdsNoiseSchedule). Real
loss utilities, not just descriptors.
VERSION1ISIS_SCORE_DISTILLATION_VERSION1ISIS_SCORE_DISTILLATION_SDS_WORKFLOW2addIsisSdsNoise2computeIsisSdsLoss2createIsisSdsCapabilities2createIsisSdsGaussianNoise2createIsisSdsLinearNoiseSchedule2createIsisSdsOptimizationStep2createIsisSdsParameterUpdate2createIsisSdsRandomCamera2resolveIsisSdsNoiseLevel2IsisSdsCameraSample2IsisSdsCapabilities2 +309 moreSeedance 2.0 multi-backend provider interfaces and typed configuration for Isis
The Seedance 2.0 provider (libs/isis/seedance-provider, ~22k LOC):
multi-backend provider interfaces and exhaustive typed configuration —
resolution/aspect/ duration/motion options, reference-asset conditioning
(image/video), and a capability matrix (SeedanceCapabilityMatrix,
SeedanceReferenceAssetInput). A deep single-vendor integration surface.
SeedanceProviderError312volcengineArkConfigSchema314falSeedanceConfigSchema314iapiSeedanceConfigSchema314seedanceBackendConfigSchema314seedanceProviderConfigSchema314roviderModelToCanonicalModel314canonicalModelToProviderModel314arseSeedanceProviderConfig314createSeedanceBackendConfigMap314createSeedancePricingConfig314SeedanceCostTracker337SeedanceExpiryManager341InMemorySeedanceExpiryStorageAdapter341 +142 moreText-guided mesh editing contracts for multi-view InstructPix2Pix and SDS workflows
Text-guided mesh editing (libs/isis/text-mesh-editing): multi-view
InstructPix2Pix/SDS edit transfer (transferIsisTextMeshEditToBatch) and a
preview/undo workflow with an undo stack (previewIsisTextMeshEdit,
undoIsisTextMeshEdit, createIsisTextMeshEditUndoStack). Plans localized,
instruction-driven mesh edits.
VERSION1ISIS_TEXT_MESH_EDITING_VERSION1ISIS_TEXT_MESH_EDIT_TRANSFER_WORKFLOW2createIsisTextMeshEditTransferCapabilities2createIsisTextMeshEditTransferPlan2ransferIsisTextMeshEditToBatch2IsisTextMeshEditTransferCapabilities2IsisTextMeshEditTransferExecutor2IsisTextMeshEditTransferExecutorRequest2IsisTextMeshEditTransferGate2IsisTextMeshEditTransferPlan2IsisTextMeshEditTransferPlanRequest2IsisTextMeshEditTransferResult2IsisTextMeshEditTransferRunRequest2 +137 more3D generation provider abstraction + pipeline class catalog + provenance (§24.9)
The 3D pipeline-class catalog and provider abstraction (§24.9,
libs/isis/three-d-pipelines): provider, pipeline-class, provenance,
topology, a sky-event-card, and Mawu-Studio creation modules. The Mawu
product path dispatches text-to-3d, text-to-texture, text-to-world, and
text-to-npc requests through separately configured, fail-loud HTTP routes. It
bounds and validates provider responses, recomputes tool-specific usability, and
runs successful output through semantic grounding, attribution, provenance,
content hashing, and prompt-output trust checks. Its local reference backend is
explicitly procedural.
The V7 operational-evidence module inventories all ten headline execution boundaries: Crucible tabular-Q and match-meta, Loom reference vision and local terrain ML, the four distinct Mawu product routes, Themis dispatch, and full-engine parity. A catalog is ready only with exactly one fresh, digest-bound record per boundary. Each record must match its fixed implementation class and include exact implementation/model/dataset/output license identity, run/artifact provenance, sampled USD cost and latency, passing safety scenarios, threshold-derived quality metrics, and an exercised provider failover, deterministic retry, or engine restart inside its recovery objective with zero data loss. Model-free and dataset-free dispositions require an explicit reason; model-backed routes cannot use them. This is an admission contract, not live evidence: the V7 operational-evidence task remains open until real retained records pass it.
The bounded V7 flagship fixture composes all four governed reference artifacts
into region:mawu-market-quarter:v1, a 128 m square procedural evidence region.
Its independent evaluator derives completeness from exact terrain coverage,
in-bounds source-linked assets, scheduled NPC roles, zero-sum economy
transactions, an acyclic asset-targeted and reward-bound quest graph, complete
English/Spanish/French message keys, and the V7 accessibility floor. Its
deterministic simulator derives terrain reachability, asset navigation, quest
completion, and ledger integrity from the sealed manifest. The first 32-session
replay exposed one unreachable asset; an exact-replay policy moved it through a
system-authored, full-auto common run and the after replay passed. Both the
simulation and revision records are digest-bound and independently validate
nested common-run and output evidence. This proves a coherent procedural
manifest and governed headless revision, not a UE cook, product-model
generation, player telemetry, playtest, human approval, or canary.
Rights and provenance gated training data collectors for Isis generation workflows
Phase 85–86 flywheel producer for generative media
(libs/isis/training-data/src): IsisTrainingDataPipeline covers the widest
signal surface of the flywheel — sixteen IsisTrainingKinds from
prompt-quality, generation-preference, and lora-effectiveness to
three-d-quality, gaussian-splat-quality, vfx-pair, and
llm-orchestration. Every record is gated by an explicit IsisRightsGrant
(rights-based rather than plain consent, reflecting creator content) before it
reaches the IsisTrainingSink.
Topology-agnostic auto-rigging foundations and future ML rigging workflows for Isis 3D pipelines
Topology-agnostic auto-rigging (libs/isis/universal-rigging, ~48k LOC and one
of the largest): a broad export surface covering ML skeleton prediction,
automatic skin-weight computation, animation clip core / blending-transition
graphs / export / preview rendering, bone-hierarchy inference, and
species/creature rig templates (bird, fish-marine, facial, eye, clothing,
corrective blend shapes, cross-species retargeting). A substantial rigging
foundation, not a contract stub.
VERSION66LOCAL_3D_UNIVERSAL_RIGGING_WORKFLOW_MODES68LOCAL_3D_UNIVERSAL_RIGGING_PLANNED_WORKFLOW_MODES69LOCAL_3D_UNIVERSAL_RIGGING_SUPPORTED_INPUT_FORMATS74LOCAL_3D_UNIVERSAL_RIGGING_PLANNED_INPUT_FORMATS75LOCAL_3D_UNIVERSAL_RIGGING_SUPPORTED_OUTPUT_FORMATS81LOCAL_3D_UNIVERSAL_RIGGING_PLANNED_OUTPUT_FORMATS82Local3DUniversalRiggingWorkflowMode84Local3DUniversalRiggingPlannedWorkflowMode86Local3DUniversalRiggingSupportedInputFormat88Local3DUniversalRiggingPlannedInputFormat90Local3DUniversalRiggingSupportedOutputFormat92Local3DUniversalRiggingPlannedOutputFormat94Local3DUniversalRiggingPackageManifest97 +1 moreProduction video editing workflow orchestration for ISIS and Yemaya
Production video-editing orchestration for ISIS and Yemaya
(libs/isis/video-edit-studio, a single ~970-line module): inpaint/outpaint/
restyle/extend/reference-to-video tasks with masks, reference kinds, aspect
ratios, comparison modes, and versioning (VideoEditTaskMode,
VideoEditVersionStatus).
VideoEditTaskMode1VideoEditQualityTier7VideoEditReferenceKind8VideoEditMaskInterpolation9VideoEditAspectRatio10VideoEditOutpaintDirection11VideoEditComparisonMode12VideoEditBatchScopeKind17VideoEditOperation18VideoEditVersionStatus19VideoEditResolution21VideoEditVector226VideoEditTaskDefinition31VideoEditSessionRequest38 +21 moreAI video enhancement and restoration orchestration for Isis
AI video enhancement/restoration (libs/isis/video-enhancement, ~19k LOC): a
capabilities manifest plus planners for super-resolution, frame interpolation,
denoising, grain management, and cadence correction/deinterlacing
(CadenceCorrectionPlanner, with pull-down patterns and field-dominance modes).
VERSION7VIDEO_ENHANCEMENT_CAPABILITIES7createVideoEnhancementLibraryManifest7VideoEnhancementCapability7VideoEnhancementLibraryManifest7CADENCE_CORRECTION_DEINTERLACE_MODES15CADENCE_CORRECTION_FIELD_DOMINANCE15CADENCE_CORRECTION_PATTERNS15CADENCE_CORRECTION_SCAN_MODES15CADENCE_CORRECTION_STAGES15CADENCE_CORRECTION_STRATEGIES15CadenceCorrectionPlanner15createCadenceCorrectionPlanner15CadenceCorrectionDeinterlaceMode15 +590 moreProduction object-removal workflow orchestration for ISIS and Yemaya
Production object-removal orchestration for ISIS and Yemaya
(libs/isis/video-object-removal, a single ~3.2k-line module): selection tools
(point/box/lasso/text-prompt), quality tiers, comparison modes, cross-shot
subject tracking, and a set of domain pipelines (product-placement,
safety-wire-rig, anachronism-removal, weather-element, …) with NLE-host targets.
ObjectRemovalSelectionTool3ObjectRemovalQualityTier4ObjectRemovalComparisonMode5ObjectRemovalCrossShotSubjectType6ObjectRemovalDomainPipelineKind7ObjectRemovalDomainOperation16ObjectRemovalNousDomainHint23ObjectRemovalNleHost24ObjectRemovalNleBatchFormat31ObjectRemovalExrLayerName32ObjectRemovalSafetyPurpose33ObjectRemovalSafetyCategory39ObjectRemovalSafetyVerdict50ObjectRemovalContinuityIssueSeverity51 +75 moreVideo-first 3D reconstruction and multi-view meshing workflows for Isis
Video-first 3D reconstruction (libs/isis/video-to-mesh, ~29k LOC): capability
builders for monocular video depth estimation, camera-pose estimation,
multi-frame depth fusion, point-cloud surface reconstruction, texture
projection, and object segmentation (createLocal3DVideoToMesh*Capabilities). A
full video→mesh pipeline contract set.
VERSION104LOCAL_3D_VIDEO_TO_MESH_IMPLEMENTATION_STAGE130LOCAL_3D_VIDEO_TO_MESH_SUPPORTED_INPUT_MODALITIES133LOCAL_3D_VIDEO_TO_MESH_PLANNED_INPUT_MODALITIES139LOCAL_3D_VIDEO_TO_MESH_SUPPORTED_WORKFLOW_MODES141LOCAL_3D_VIDEO_TO_MESH_PLANNED_WORKFLOW_MODES167LOCAL_3D_VIDEO_TO_MESH_SUPPORTED_WORKFLOW_TRACKS169LOCAL_3D_VIDEO_TO_MESH_PLANNED_WORKFLOW_TRACKS170LOCAL_3D_VIDEO_TO_MESH_SUPPORTED_OUTPUT_REPRESENTATIONS176LOCAL_3D_VIDEO_TO_MESH_PLANNED_OUTPUT_REPRESENTATIONS191Local3DVideoToMeshImplementationStage193Local3DVideoToMeshSupportedInputModality195Local3DVideoToMeshPlannedInputModality197Local3DVideoToMeshSupportedWorkflowMode199 +9 moreVisual dubbing and dialogue-editing orchestration for Isis
Visual dubbing and dialogue-editing orchestration (libs/isis/visual-dubbing,
~7k LOC): a voice-cloning visual-synchronization planner and an
emotional-regrade planner with strategies/review-modes/quality-gates
(VoiceCloningVisualSynchronizationPlanner, EmotionalRegradePlanner). Aligns
re-voiced dialogue to on-screen performance.
VOICE_CLONING_VISUAL_SYNC_PROVIDERS6VOICE_CLONING_VISUAL_SYNC_REVIEW_MODES6VOICE_CLONING_VISUAL_SYNC_STRATEGIES6VoiceCloningVisualSynchronizationPlanner6createVoiceCloningVisualSynchronizationPlanner6VoiceCloningVisualSyncPlan6VoiceCloningVisualSyncProvider6VoiceCloningVisualSyncQualityGate6VoiceCloningVisualSyncRequest6VoiceCloningVisualSyncResult6VoiceCloningVisualSyncReviewMode6VoiceCloningVisualSyncStrategy6EMOTIONAL_REGRADE_MODES21EMOTIONAL_REGRADE_REVIEW_MODES21 +177 moreProfessional voice cloning and synthesis orchestration for Isis
Professional voice cloning and synthesis (libs/isis/voice-cloning): a
voice-profile creation planner (dataset prep steps, source types, training
strategies, quality gates) plus a capabilities/workflow manifest
(VoiceProfileCreationPlanner, createVoiceCloningLibraryManifest). Plans the
clone-and-synthesize pipeline.
VERSION6VOICE_CLONING_CAPABILITIES6VOICE_CLONING_WORKFLOWS6createVoiceCloningLibraryManifest6VoiceCloningCapability6VoiceCloningLibraryManifest6VoiceCloningWorkflow6VOICE_PROFILE_DATASET_PREP_STEPS16VOICE_PROFILE_SOURCE_TYPES16VOICE_PROFILE_TRAINING_STRATEGIES16VoiceProfileCreationPlanner16createVoiceProfileCreationPlanner16VoiceProfileAcceptedClip16VoiceProfileCreationRequest16 +171 moreWorkflow-class catalog: 5 Living Scene domain templates + fixture eval gates (§25.5)
The Living-Scene workflow-class catalog (§25.5, libs/isis/workflow-classes):
five domain templates — tara, nyx, veritas, metis, arete — plus a
template-catalog, locale-parity, and fixture eval gates. Curated, gated
workflow blueprints rather than free-form graphs.
ComfyUI workflow definitions for Isis generative factory with schema validation, versioning, and template DSL
ComfyUI workflow definitions and tooling (libs/isis/workflows): the Workflow
schema with validation, a versioning/migration pipeline
(WorkflowSchemaMigration), a template DSL, and seed management. The typed
representation of the ComfyUI graphs Isis runs.
WorkflowCategory51GpuRequirement51PipelineStage51SeedPolicy51LockState51IdentityAdapter51CameraMotionCurve51ShotType51PacingControl51OutputType51OutputArtifactType51RenderPassType51EditorialEDLFormat51EditorialTimecodeMapFormat51 +399 moreProvider-registry infrastructure (libs/isis/llm-providers): model/provider
registration, rate limiting, token counting, cost calculation, and health/
circuit-breaker tracking (ProviderRegistryConfig, RateLimiterConfig,
TokenCounterConfig, CostCalculatorConfig, CircuitBreakerState). It governs
how providers are selected and throttled, complementing @isis/ai-providers'
concrete adapters.
createProviderId35createModelId35createRateLimiterId35createTokenCountId35createCostEntryId35createHealthCheckId35LLMProviderName45ModelCapability45CountAccuracy45PricingTier45RateLimitWindow45RateLimitAction45HealthStatus45CircuitState45 +157 moreFine-tuning orchestration (libs/isis/model-fine-tuning): hyperparameter search
trials, dataset curation/deduplication and quality stats, experiment tracking,
model-merge jobs, benchmark runs, and metric snapshots (HpTrial,
CuratedDataset, DeduplicationResult, MergeJob, MetricSnapshot).
createHpTrialId56createDatasetId56createExperimentId56createMergeJobId56createBenchmarkId56createSampleId56createSnapshotId56createRunId56SearchStrategy68ParamType68TrialStatus68ObjectiveDirection68IssueSeverity68IssueType68 +137 moreISIS_STUDY_ADAPTER_CONTRACT_VERSION1ISIS_STUDY_CAPABILITIES1createIsisStudyAdapter2IsisStudyAdapter2JobEnvelopeResult2RoutePlanResult2unclassified (11)#
Canonical Isis job envelope schema and utilities
The canonical Isis job envelope (libs/isis/job-envelope): the versioned queue
schema plus exhaustive generation-type, ControlNet, IP-Adapter, and InstantID
mode manifests with legacy-workflow alias maps (ISIS_JOB_ENVELOPE_VERSION,
ISIS_GENERATION_TYPE_MANIFEST, ISIS_CONTROLNET_MAJOR_MODES, …). Every Isis
generation job is shaped by this contract.
ISIS_JOB_ENVELOPE_VERSION6ISIS_GENERATION_TYPES6ISIS_GENERATION_TYPE_ALIASES6ISIS_OUTPUT_PACKAGE_TYPES6ISIS_GENERATION_TYPE_MANIFEST6ISIS_CONTROLNET_MAJOR_MODES6ISIS_CONTROLNET_MODE_ALIASES6ISIS_CONTROLNET_LEGACY_WORKFLOW_MODE_MAP6ISIS_IPADAPTER_MAJOR_MODES6ISIS_IPADAPTER_MODE_ALIASES6ISIS_IPADAPTER_LEGACY_WORKFLOW_MODE_MAP6ISIS_INSTANTID_MAJOR_MODES6ISIS_INSTANTID_MODE_ALIASES6ISIS_INSTANTID_LEGACY_WORKFLOW_MODE_MAP6 +39 moreMulti-agent reasoning and consensus (libs/isis/agent-consensus): structured
debate with claims/arguments/evidence, reasoning chains, fallacy detection,
convergence sessions, and compromise proposals (Debate, Argument,
DetectedFallacy, ConvergenceSession, CompromiseProposal,
ReasoningQualityMetrics). Models how several agents argue toward an agreed
answer.
createDebateId42createClaimId42createArgumentId42createAgentId42createReasoningChainId42createPerspectiveId42createConvergenceSessionId42createEvidenceId42DebateStatus54ClaimType54AgentStance54EvidenceType54ArgumentStrength54FallacyType54 +133 moreBatch LLM pipeline (libs/isis/batch-llm-processing): batch request/job
modelling, scheduling within time windows, result correlation, cost reporting,
and throughput snapshots (BatchRequest, ScheduleDecision, BatchJobResult,
CostReport, ThroughputSnapshot, plus ToolDefinition/ChatMessage). For
high-volume, cost-aware LLM workloads.
createBatchRequestId48createBatchJobId48createScheduleEntryId48createResultEntryId48createCostReportId48createThroughputSnapshotId48createMessageId48createCorrelationId48BatchProvider60ChatRole60BatchPriority60BatchJobStatus60ScheduleStrategy60RequestResultStatus60 +132 moreEvent publishing service for the Isis (Generative Factory) domain
The Isis event publisher (libs/isis/event-publisher): IsisEventPublisher
plus a typed payload set for the job lifecycle
(queued/started/progress/completed/ failed/cancelled) and asset/workflow/model
events (IsisJobCompletedPayload, IsisAssetGeneratedPayload,
IsisWorkflowRegisteredPayload). How Isis announces work onto the bus.
IsisEventPublisher7getIsisEventPublisher7createIsisEventPublisher7resetIsisEventPublisher7Structured-LLM orchestration (libs/isis/llm-orchestrator): typed extraction,
schema validation, repair of malformed model output, budget framing, and an
operation queue (ExtractionResult, SchemaValidationConfig, RepairConfig,
BudgetTrackerConfig, OperationEntry, QueueStats). It turns raw model calls
into validated, schema-conformant results.
createExtractionId36createValidationId36createRepairId36createBudgetFrameId36createOperationId36ExtractionPriority45ValidationState45RepairStrategy45OperationStatus45OperationPriorityLevel45NotificationChannel45SchemaFieldType45BudgetAlertLevel45DEFAULT_EXTRACTION_CONFIG59 +106 moreOperation orchestration (libs/isis/operation-orchestrator): retry policies
with failure classification, batch composition, dead-letter handling, execution
chains/phases, and pipeline execution with checkpoints (RetryPolicy,
FailureClassification, DeadLetterEntry, ExecutionChain,
PipelineExecution). The reliability layer for multi-step generation jobs.
createRetryId39createBatchId39createDeadLetterId39createChainId39createPhaseId39createPipelineId39createOperationRef39createCheckpointId39FailureType51RetryStrategy51BatchStrategy51BatchStatus51DeadLetterStatus51DeadLetterReason51 +159 morePrompt toolkit (libs/isis/prompt-engineering): versioned prompt templates with
variables/sections, few-shot example selection, chain-of-thought construction
and execution, role definitions, and prompt evaluation/scoring
(PromptTemplate, ChainOfThought, FewShotExample, PromptEvaluation,
PromptVersion).
createTemplateId46createExampleId46createChainId46createStepId46createRoleId46createEvaluationId46createVersionId46MessageRole57VariableType57TemplateFilter57PromptCategory57VersionStatus57SelectionStrategy57DifficultyLevel57 +118 moreA ReAct (reason+act) agent framework (libs/isis/react-framework): the
thought→action→observation step loop with execution traces, tool definitions and
results, and trace analysis/metrics (ReActStep, ExecutionTrace,
ToolDefinition, ThoughtChainAnalysis, ActionPatternAnalysis). The
agent-loop substrate for tool-using LLM agents inside Isis.
createThoughtId40createActionId40createObservationId40createStepId40createTraceId40createToolId40createAgentRunId40ConfidenceLevel51ReasoningType51ActionType51ToolParamType51ToolExecStatus51ObservationType51StepPhase51 +122 morecreateReadContract23ReadContractError23FilterOperator23FilterSpec23FilterValueType23ReadContract23ReadContractSpec23SortDirection23SortSpec23TieBreakSpec23canonicalPayload36createCursorSigner36filtersFingerprint36isCursorPayload36 +22 morePROJECTION_STATES13ProjectionContractError13createProjectionContract13detailForAudience13missing13notApplicable13resent13rojectRecord13redacted13stale13unavailable13PresentField13ProjectedField13ProjectedFields13 +9 moreToken-budget engine (libs/isis/token-budget): per-tenant budgets with category
allocations, cost prediction from ModelPricing, enforcement rules, alerts,
rebalancing/optimization, and provider fallback decisions (TokenBudget,
EnforcementCheckResult, CostPrediction, FallbackDecision). The accounting
layer that keeps generation spend bounded.
createBudgetId45createAllocationId45createPredictionId45createEnforcementId45createAlertId45createOptimizationId45createTenantId45createSnapshotId45AllocationStrategy57BudgetCategory57CategoryFlexibility57RebalanceTrigger57ProviderFamily57AlertSeverity57 +139 more