Skip to content

feat(datasource): DatasourceConnectionService + declared auto-connect (ADR-0062 Phase 1) - #2198

Merged
xuyushun441-sys merged 2 commits into
mainfrom
feat/adr-0062-ds-connection-p1
Jun 22, 2026
Merged

feat(datasource): DatasourceConnectionService + declared auto-connect (ADR-0062 Phase 1)#2198
xuyushun441-sys merged 2 commits into
mainfrom
feat/adr-0062-ds-connection-p1

Conversation

@xuyushun441-sys

Copy link
Copy Markdown
Contributor

ADR-0062 Phase 1 — DatasourceConnectionService + declared-datasource auto-connect (D1/D2/D5)

First PR of epic #2163. Declare an external datasource → it auto-connects to a live ObjectQL driver and its federated objects are queryable with zero app code — no onEnable driver wiring.

What changed

D1 — one connect path. New DatasourceConnectionService (@objectstack/service-datasource) owns the single "definition → live driver" path: build via the injected driver factory → resolve external.credentialsRef via the SecretBinderconnect()engine.registerDriver under the datasource nameregisterDatasourceDef → DDL-free syncObjectSchema for each bound federated object. Both origins converge on it — the runtime-admin registerPool now delegates here, and AppPlugin auto-connects code-defined datasources. Exposed as the 'datasource-connection' kernel service.

D2 — opt-in-safe gate. A declared datasource auto-connects only when it is external, an object explicitly binds via object.datasource, or it sets the new autoConnect: true flag. A managed datasource that nothing explicitly binds — including one referenced only by a datasourceMapping rule, e.g. examples/app-crm's :memory: datasources — stays metadata-only. Existing apps are byte-for-byte unchanged.

⚠️Reviewer note — deliberate refinement of D2's literal wording. The ADR's gate (b) reads "an object/datasourceMapping actually routes to it." Implementing against app-crm showed that auto-connecting on a mapping rule alone would break it: crm_primary (:memory:, managed) is referenced by a mapping rule + is the default:true fallback but has no onEnable, so today its objects fall through to the default driver. Connecting it would divert them to a fresh empty :memory: driver. So mapping-only routing to a managed datasource is treated as decorative; gate (b) fires only on explicit object.datasource. Documented in the ADR D2/D5 implementation notes in this PR.

D5 — lifecycle, ordering & policy. Connect runs in AppPlugin.start() (before the kernel:ready validation gate; relies on the kernel's init-all→start-all ordering, so the connection service registered in the admin plugin's init() is available). Fail-fast for a declared external datasource with validation.onMismatch:'fail'; degrade-with-warning otherwise (and always for runtime-admin/rehydrate, so a UI action or replica blip never bricks the server). Adds a host-injectable DatasourceConnectPolicy (epic #2163 seam): open-core default allows (subject to the D2 gate); a multi-tenant host binds a stricter, fail-closed policy for egress isolation — one connect path, no cloud fork.

Tests

  • datasource-connection-service.test.ts — 15 unit tests: D2 gate (incl. app-crm cases), build/connect/name-stamp/register, credentialsRef resolution, idempotency vs. a pre-registered onEnable driver, policy deny + throw-as-deny, no-infra degrade, fail-fast vs. degrade per trigger, connectDeclared gating.
  • datasource-autoconnect.test.ts (runtime) — 5 integration tests with the real driver factory: auto-connects the declared external datasource, leaves a managed+unrouted one metadata-only, keeps both visible, federated object queryable end-to-end, deny-policy leaves it unconnected-but-visible.
  • Full suites green locally: service-datasource 80, runtime 409, spec 6604.

Scope / not in this PR

  • The riskiest default-driver bootstrap refactor onto the shared service is deferred to a final follow-up PR (per ADR risk guidance: land auto-connect first, refactor default last behind the dogfood gate).
  • The examples/app-showcaseonEnable bridge is kept here (idempotent vs. auto-connect) and removed in Phase 4 (D8).
  • Credentials at connect (D3) hardening is Phase 2; the credentialsRef resolve hook is already wired through the shared service.

Closes (partially) #2163 — Phase 1.

🤖 Generated with Claude Code

… (ADR-0062 Phase 1)
Declare an external datasource → it auto-connects to a live ObjectQL driver and
its federated objects are queryable with ZERO app code (no onEnable). Implements
ADR-0062 Phase 1 (D1/D2/D5) toward epic #2163.
D1 — one connect path: new DatasourceConnectionService owns the single
"definition → live driver" path (factory build → credentialsRef resolve →
connect → registerDriver under the datasource name → registerDatasourceDef →
DDL-free syncObjectSchema per bound object). The runtime-admin registerPool now
delegates to it; AppPlugin auto-connects code-defined datasources. Exposed as the
'datasource-connection' kernel service.
D2 — opt-in-safe gate: connect only when external, an object explicitly binds via
object.datasource, or autoConnect:true. Managed datasources referenced only by a
datasourceMapping rule (e.g. app-crm's :memory: datasources) stay metadata-only —
existing apps byte-for-byte unchanged. Adds datasource.autoConnect to the spec.
D5 — lifecycle/ordering/policy: connect in AppPlugin.start() before the
kernel:ready validation gate (init-all-then-start-all). Fail-fast for declared
external + onMismatch:'fail'; degrade otherwise (always for runtime-admin/
rehydrate). New host-injectable DatasourceConnectPolicy (open-core default allows;
multi-tenant host binds a stricter fail-closed policy) consulted before connect.
Tests: 15 connection-service unit tests + 5 runtime integration tests (auto-connect,
managed-unrouted stays metadata-only, queryable end-to-end, deny policy). onEnable +
ctx.drivers.register remains a supported, idempotent escape hatch.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@vercel

vercelBot commented Jun 22, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
specReadyReadyPreview, CommentJun 22, 2026 11:29am

Request Review

@github-actionsgithub-actionsBot added documentation Improvements or additions to documentation protocol:data tests tooling size/xl labels Jun 22, 2026
@github-actions

github-actionsBot commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

📓 Docs Drift Check

This PR changes 3 package(s): @objectstack/runtime, packages/services, @objectstack/spec.

98 hand-written doc(s) reference the affected code and may need an implementation-accuracy re-verification:

  • content/docs/concepts/architecture.mdx(via @objectstack/spec)
  • content/docs/concepts/cloud-artifact-api.mdx(via packages/runtime, packages/spec)
  • content/docs/concepts/cluster-semantics.mdx(via @objectstack/spec)
  • content/docs/concepts/design-principles.mdx(via packages/spec)
  • content/docs/concepts/implementation-status.mdx(via @objectstack/runtime, @objectstack/spec)
  • content/docs/concepts/index.mdx(via @objectstack/spec)
  • content/docs/concepts/metadata-driven.mdx(via @objectstack/spec)
  • content/docs/concepts/metadata-lifecycle.mdx(via packages/spec)
  • content/docs/concepts/north-star.mdx(via packages/runtime, packages/spec)
  • content/docs/concepts/packages.mdx(via @objectstack/runtime, @objectstack/spec)
  • content/docs/concepts/setup-app.mdx(via @objectstack/spec)
  • content/docs/concepts/skills.mdx(via @objectstack/spec)
  • content/docs/concepts/webhook-delivery.mdx(via @objectstack/spec)
  • content/docs/getting-started/architecture.mdx(via @objectstack/spec)
  • content/docs/getting-started/cli.mdx(via @objectstack/spec)
  • content/docs/getting-started/core-concepts.mdx(via @objectstack/spec)
  • content/docs/getting-started/examples.mdx(via @objectstack/spec)
  • content/docs/getting-started/quick-start.mdx(via @objectstack/spec)
  • content/docs/guides/adding-a-metadata-type.mdx(via @objectstack/spec)
  • content/docs/guides/ai-capabilities.mdx(via @objectstack/spec)
  • content/docs/guides/airtable-dashboard-analysis.mdx(via @objectstack/spec)
  • content/docs/guides/analytics-datasets.mdx(via @objectstack/spec)
  • content/docs/guides/api-reference.mdx(via @objectstack/runtime, @objectstack/spec)
  • content/docs/guides/authentication.mdx(via @objectstack/runtime)
  • content/docs/guides/business-logic.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/backward-compatibility.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/error-catalog.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/field-type-gallery.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/field-validation-rules.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/permissions-matrix.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/protocol-diagram.mdx(via packages/spec)
  • content/docs/guides/cheatsheets/query-cheat-sheet.mdx(via @objectstack/spec)
  • content/docs/guides/cheatsheets/quick-reference.mdx(via @objectstack/spec)
  • content/docs/guides/client-sdk.mdx(via @objectstack/spec)
  • content/docs/guides/cloud-deployment.mdx(via @objectstack/runtime)
  • content/docs/guides/common-patterns.mdx(via @objectstack/spec)
  • content/docs/guides/contracts/auth-service.mdx(via packages/spec)
  • content/docs/guides/contracts/cache-service.mdx(via packages/spec)
  • content/docs/guides/contracts/data-engine.mdx(via @objectstack/spec)
  • content/docs/guides/contracts/index.mdx(via @objectstack/spec)
  • content/docs/guides/contracts/metadata-service.mdx(via packages/spec)
  • content/docs/guides/contracts/storage-service.mdx(via packages/spec)
  • content/docs/guides/data-modeling.mdx(via @objectstack/spec)
  • content/docs/guides/deployment-vercel.mdx(via @objectstack/runtime, @objectstack/spec)
  • content/docs/guides/driver-configuration.mdx(via @objectstack/runtime, @objectstack/spec)
  • content/docs/guides/error-handling-client.mdx(via @objectstack/spec)
  • content/docs/guides/error-handling-server.mdx(via @objectstack/spec)
  • content/docs/guides/formula.mdx(via @objectstack/spec)
  • content/docs/guides/hook-bodies.mdx(via @objectstack/runtime, packages/spec)
  • content/docs/guides/kernel-services.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/dashboard.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/field.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/flow.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/index.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/object.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/validation.mdx(via @objectstack/spec)
  • content/docs/guides/metadata/workflow.mdx(via @objectstack/spec)
  • content/docs/guides/packages.mdx(via @objectstack/runtime, packages/services, @objectstack/spec)
  • content/docs/guides/plugin-chatbot-integration.mdx(via @objectstack/runtime)
  • content/docs/guides/plugin-development.mdx(via @objectstack/spec)
  • content/docs/guides/plugins.mdx(via @objectstack/spec)
  • content/docs/guides/production-readiness.mdx(via @objectstack/runtime)
  • content/docs/guides/project-scoping.mdx(via @objectstack/spec)
  • content/docs/guides/public-forms.mdx(via @objectstack/spec)
  • content/docs/guides/runtime-services/audit-service.mdx(via packages/services)
  • content/docs/guides/runtime-services/email-service.mdx(via packages/spec)
  • content/docs/guides/runtime-services/index.mdx(via packages/services, packages/spec)
  • content/docs/guides/runtime-services/queue-service.mdx(via packages/spec)
  • content/docs/guides/runtime-services/settings-service.mdx(via packages/services)
  • content/docs/guides/runtime-services/sharing-service.mdx(via packages/spec)
  • content/docs/guides/runtime-services/storage-service.mdx(via packages/spec)
  • content/docs/guides/security.mdx(via @objectstack/spec)
  • content/docs/guides/seed-data.mdx(via @objectstack/spec)
  • content/docs/guides/single-project-mode.mdx(via @objectstack/runtime)
  • content/docs/guides/skills.mdx(via @objectstack/spec)
  • content/docs/guides/standards.mdx(via @objectstack/spec)
  • content/docs/guides/troubleshooting.mdx(via @objectstack/spec)
  • content/docs/protocol/knowledge.mdx(via @objectstack/spec)
  • content/docs/protocol/objectos/config-resolution.mdx(via @objectstack/spec)
  • content/docs/protocol/objectos/http-protocol.mdx(via @objectstack/runtime)
  • content/docs/protocol/objectos/i18n-standard.mdx(via packages/services, @objectstack/spec)
  • content/docs/protocol/objectos/index.mdx(via @objectstack/runtime)
  • content/docs/protocol/objectos/lifecycle.mdx(via @objectstack/runtime, @objectstack/spec)
  • content/docs/protocol/objectos/plugin-spec.mdx(via @objectstack/spec)
  • content/docs/protocol/objectos/runtime-capabilities.mdx(via @objectstack/spec)
  • content/docs/protocol/objectql/index.mdx(via packages/spec)
  • content/docs/protocol/objectql/query-syntax.mdx(via @objectstack/spec)
  • content/docs/protocol/objectql/schema.mdx(via @objectstack/spec)
  • content/docs/protocol/objectql/security.mdx(via packages/spec)
  • content/docs/protocol/objectql/state-machine.mdx(via @objectstack/spec)
  • content/docs/protocol/objectui/actions.mdx(via @objectstack/spec)
  • content/docs/protocol/objectui/concept.mdx(via @objectstack/spec)
  • content/docs/protocol/objectui/index.mdx(via @objectstack/spec)
  • content/docs/protocol/objectui/layout-dsl.mdx(via packages/spec)
  • content/docs/protocol/objectui/record-alert.mdx(via @objectstack/spec)
  • content/docs/protocol/objectui/widget-contract.mdx(via @objectstack/spec)
  • content/docs/releases/index.mdx(via @objectstack/spec)
  • content/docs/releases/v9.mdx(via @objectstack/spec)

Advisory only. To re-verify, run the docs-accuracy-audit workflow scoped to these files:
node scripts/docs-audit/affected-docs.mjs origin/main → pass the list as args.docs.

…TS build)
The context logger interface types error(message, error?: Error) — passing a meta
object {appId, error} tripped the tsup DTS build (TS2353) even though tsc --noEmit
passed. Switch to a single interpolated message; the rethrow still surfaces the
real cause to the kernel.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentationImprovements or additions to documentationprotocol:datasize/xlteststooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@xuyushun441-sys@os-zhuang