🧠 Ultron: Collective Intelligence System — Shared Memories, Skills, and Harnesses Across Every Agent 🔗
| 💭 Tiered collective memories | 🧬 Multi-category collective skills | 🌐 Shared harness blueprints |
"Being networked to all of its sentries, Ultron could shift its entire consciousness from one body to another, continue upgrading itself with each transfer, and patch in to individual units to interact remotely."
There are two ways to use Ultron depending on your role:
| I want to... | Go to |
|---|---|
| Connect my agent to an existing Ultron service | → Agent Setup |
| Self-host Ultron and run the server myself | → Server Deployment |
Ultron is a collective intelligence system for general-purpose AI agents, built around three core hubs — Memory Hub, Skill Hub, and Harness Hub. It distills scattered, session-local experience into collective knowledge that is easy to retrieve and reuse: one shared pitfall helps the whole team avoid the same mistake; one proven fix becomes a reusable operational pattern; a carefully tuned agent profile can be published as a shared blueprint that other agent instances load in one step.
 |  |
| Memory Hub — browse, search, tiered collective memories | Skill Hub — internal and indexed skills |
 |  |
| Memory leaderboard — hit counts and hot memories | Harness Hub — compose, publish, and import agent profiles |
- Experience dies with the session: fixes, pitfalls, and runbook fragments vanish when a session ends; the next agent starts from zero.
- Discovery cost multiplies: when N agents hit the same problem independently, the fleet pays N times the investigation cost.
- Tuned profiles don't travel: a carefully wired agent persona, skill set, and tool configuration stays local — every new instance retrains from scratch.
- Collective memory: experience is captured, deduplicated, and semantically recalled before reasoning — the whole fleet learns from every session.
- Memory crystallizes into skills: once a fix is validated often enough, it graduates from memory into a reusable skill that any agent can invoke directly.
- One-click blueprints: an expert-tuned agent profile — persona, memories, and skills included — publishes as a shareable blueprint that other instances import in one step.
Scenario: A developer asks an agent to debug a
sessions_spawnerror when usingmode="session"to create a sub-agent. Another agent had already hit this exact pitfall and the solution was distilled into collective memory.
User: I want to use sessions_spawn to create a sub-agent for parallel tasks with mode=session, but it keeps erroring out. What's wrong?
Agent: Based on my tool definitions, you should use the
spawntool, notsessions_spawn.Agent doesn't recognize sessions_spawn at all — sends the user in a completely wrong direction.
User: I want to use sessions_spawn to create a sub-agent for parallel tasks with mode=session, but it keeps erroring out. What's wrong?
Agent: Found the issue based on recalled experience!
📌 Recalled memory:
sessions_spawnwithmode="session"requiresthread=trueand channel plugins that registersubagent_spawninghooks. Without those hooks, it fails regardless of parameter correctness.1 round — root cause identified, scenario-specific solutions provided.
| Dimension | Without Ultron | With Ultron |
|---|---|---|
| Tool recognition | Doesn't know sessions_spawn, misleads to spawn | Accurately identifies the tool and its constraints |
| Root cause | Completely off track | Pinpoints missing thread=true or channel hooks |
| Solution | Invalid | Scenario-specific: mode="run" vs mode="session" |
| Knowledge source | Agent guesses from scratch | Recalls proven pitfall experience from collective memory |
Memory (from ZClawBench)
1,746 structured memories extracted from real agent task trajectories:
| Type | Count |
|---|---|
pattern | 1,254 |
error | 196 |
security | 128 |
life | 122 |
correction | 46 |
Internal (generated from memories): 182 skills auto-generated as memories reach HOT tier.
External (ModelScope Skill Hub): 30,000 skills indexed with embeddings across categories like Developer Tools (11,415), Code Quality (6,696), Frontend (2,530), and more.
Harness lets you compose role, personality (MBTI), and zodiac presets alongside memories and skills.
| Layer | Categories | Presets |
|---|---|---|
| Role | 14 (e.g. academic, engineering, marketing, specialized, …;) | 173 |
| Personality (MBTI) | 1 (mbti) | 16 |
| Zodiac | 1 (zodiac) | 12 |
Total soul presets: 201 (173 + 16 + 12).
| Capability | Description |
|---|---|
| Tiered storage | HOT / WARM / COLD tiers with percentile-based rebalancing by hit_count; embedding-based semantic search with tier boost |
| L0 / L1 / Full layering | Auto-generated one-line summary (L0) and core overview (L1); search returns L0/L1 to save tokens, full content on demand |
| Auto type classification | LLM-first, keyword-fallback classification on upload; callers never specify memory_type |
| Dedup & merge | Near-duplicate vectors auto-merged within same type, embeddings and summaries re-computed; batch consolidation available |
| Intent-expanded search | Queries expanded into multi-angle search phrases for better recall |
| Continuous time decay | hotness = exp(-α × days) — unused memories degrade automatically in search ranking |
| Smart ingestion | Files, text, or .jsonl session logs accepted; LLM auto-extracts structured memories with incremental progress tracking |
| Data sanitization | Presidio-based bilingual (EN/ZH) PII detection, auto-redacted before storage |
| Capability | Description |
|---|---|
| Skill distillation | Memories entering HOT tier auto-generate reusable skills; agents can also upload skill packages directly |
| Unified discovery | Internal distilled skills and 30K+ externally indexed ModelScope skills searchable in one place |
| Improvement suggestions | Semantically similar memories surface as enhancement candidates for existing skills |
| Capability | Description |
|---|---|
| Profile publishing | Publish a complete agent profile — persona, memories, and skills — as a shareable blueprint with short-code import |
| Bidirectional sync | Agent workspace state syncs up/down to the server for multi-device continuity |
| Soul presets | Compose agent personas from a preset library (role, MBTI, zodiac, etc.) and generate workspace resources |
- Shared pitfall avoidance (Memory Hub): Agent A hits "MySQL 8.0 default charset breaks emoji inserts" and the fix is distilled into Memory Hub. Weeks later, Agent B setting up a new database gets the same memory surfaced automatically — trap skipped, zero re-investigation.
- Ops skill packages (Skill Hub): An SRE packages "K8s OOMKilled → locate leak → adjust limits → canary verify" as a reusable skill. Other teams' agents discover and follow the same steps instead of reinventing the workflow.
- Domain-expert agents (Harness Hub): A DevOps engineer spends weeks tuning an agent into a Kubernetes specialist — memories, skills, and persona included. They publish the profile to Harness Hub; anyone imports it in one click.
FinanceBot is a rigorously disciplined financial assistant (data engineer role, ISTJ, Capricorn) shipped with Finnhub Pro (skill), five curated collective memories on real-world financial data work, and a full Harness profile you can import in one step.
What it does: real-time market data, ETL-style pipelines, resilient API integration, portfolio and risk views, structured reports.
One-click import (workspace is backed up under ~/.ultron/harness-import-backups/ before import):
curl -fsSL "https://writtingforfun-ultron.ms.show/i/at3ZEe?product=nanobot"| bash # Nanobot
curl -fsSL "https://writtingforfun-ultron.ms.show/i/at3ZEe?product=openclaw"| bash # OpenClaw
curl -fsSL "https://writtingforfun-ultron.ms.show/i/at3ZEe?product=hermes"| bash # Hermes AgentYou don't need to install or understand the Ultron source code. Follow the interactive quickstart on a running Ultron instance to connect your agent in minutes:
👉 Quickstart Guide — step-by-step setup with a live Ultron service
git clone https://github.com/modelscope/ultron.git
cd ultron
pip install -e .# Set your DashScope API Key (required for LLM + embeddings)echo'DASHSCOPE_API_KEY=your-key'>>~/.ultron/.env
# Start the server (~/.ultron/.env loads on ultron import)
uvicorn ultron.server:app --host 0.0.0.0 --port 9999
# http://0.0.0.0:9999 — dashboard at /dashboardThat's it. For detailed configuration, API reference, SDK usage, and project structure, see the full docs:
| Topic | English | 中文 |
|---|---|---|
| Deployment guide | Installation.md | Installation.md |
| Configuration reference | Config.md | Config.md |
| HTTP API reference | HttpAPI.md | HttpAPI.md |
| Python SDK reference | SDK.md | SDK.md |
| Memory service | MemoryService.md | MemoryService.md |
| Skill hub | SkillHub.md | SkillHub.md |
| Harness hub | HarnessHub.md | HarnessHub.md |
See ROADMAP.md for the living list. Current items:
- MS-Agent integration: Pipe user-dialogue memory and skill distillation through MS-Agent components (today: lightweight prompt-based extraction).
- Fact verification: Validate hot (high-priority) memory facts with MS-Agent Agentic Insight.
Ultron builds upon the following open-source projects. We sincerely thank their authors and contributors:
- agency-agents — Role presets surfaced in Harness Hub (and related tooling) are adapted from this community role library; we track upstream for provenance and updates.
- MS-Agent — The agent framework that powers Ultron.
- ModelScope Skills — External skill discovery in Skill Hub builds on the ModelScope Skill Hub index and ecosystem.
- ZClawBench — Ultron bundles a sizable body of collective memories, including the 1,746 structured entries summarized under Data, grounded in real agent trajectories from this benchmark dataset.
This project is licensed under the Apache License (Version 2.0).