A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

Description

@os-warren

Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

Measured

Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

After 7 invocations:

RUNS: 7
JOB CONTEXT KEYS: bundle, data, jobId
jobId -> string
data -> undefined
bundle -> object

That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

The call site is unambiguous:

  • service-jobrecord.handler({ jobId: record.name, data })
  • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

Why this is a gap and not a design

A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

  1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
  2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

What the failure looks like in practice

Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

Suggested direction

Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

Not the same as #14095

Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

Provenance

Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

Unassigned and untriaged, per the single-producer rule for domain:*.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

    , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
     blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
    }
    } catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
    })();
    (function(){
    try {
    var __m = "github.com";
    var __re = new RegExp('^' + "github\\.com" + '
    
    Skip to content

    A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

    Description

    @os-warren

    Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

    Measured

    Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

    defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

    After 7 invocations:

    RUNS: 7
    JOB CONTEXT KEYS: bundle, data, jobId
    jobId -> string
    data -> undefined
    bundle -> object
    

    That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

    The call site is unambiguous:

    • service-jobrecord.handler({ jobId: record.name, data })
    • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

    Why this is a gap and not a design

    A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

    The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

    The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

    For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

    The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

    1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
    2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

    What the failure looks like in practice

    Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

    Suggested direction

    Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

    async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

    A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

    Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

    Not the same as #14095

    Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

    Provenance

    Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

    Unassigned and untriaged, per the single-producer rule for domain:*.

    Metadata

    Metadata

    Assignees

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
      Skip to content

      A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

      Description

      @os-warren

      Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

      Measured

      Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

      defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

      After 7 invocations:

      RUNS: 7
      JOB CONTEXT KEYS: bundle, data, jobId
      jobId -> string
      data -> undefined
      bundle -> object
      

      That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

      The call site is unambiguous:

      • service-jobrecord.handler({ jobId: record.name, data })
      • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

      Why this is a gap and not a design

      A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

      The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

      The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

      For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

      The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

      1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
      2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

      What the failure looks like in practice

      Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

      Suggested direction

      Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

      async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

      A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

      Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

      Not the same as #14095

      Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

      Provenance

      Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

      Unassigned and untriaged, per the single-producer rule for domain:*.

      Metadata

      Metadata

      Assignees

      Labels

      Type

      No type

      Projects

      No projects

        Milestone

        No milestone

        Relationships

        None yet

        Development

        No branches or pull requests

        Issue actions

        , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
        Skip to content

        A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

        Description

        @os-warren

        Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

        Measured

        Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

        defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

        After 7 invocations:

        RUNS: 7
        JOB CONTEXT KEYS: bundle, data, jobId
        jobId -> string
        data -> undefined
        bundle -> object
        

        That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

        The call site is unambiguous:

        • service-jobrecord.handler({ jobId: record.name, data })
        • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

        Why this is a gap and not a design

        A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

        The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

        The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

        For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

        The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

        1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
        2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

        What the failure looks like in practice

        Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

        Suggested direction

        Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

        async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

        A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

        Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

        Not the same as #14095

        Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

        Provenance

        Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

        Unassigned and untriaged, per the single-producer rule for domain:*.

        Metadata

        Metadata

        Assignees

        Labels

        Type

        No type

        Projects

        No projects

          Milestone

          No milestone

          Relationships

          None yet

          Development

          No branches or pull requests

          Issue actions

          , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
          Skip to content

          A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

          Description

          @os-warren

          Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

          Measured

          Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

          defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

          After 7 invocations:

          RUNS: 7
          JOB CONTEXT KEYS: bundle, data, jobId
          jobId -> string
          data -> undefined
          bundle -> object
          

          That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

          The call site is unambiguous:

          • service-jobrecord.handler({ jobId: record.name, data })
          • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

          Why this is a gap and not a design

          A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

          The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

          The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

          For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

          The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

          1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
          2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

          What the failure looks like in practice

          Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

          Suggested direction

          Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

          async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

          A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

          Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

          Not the same as #14095

          Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

          Provenance

          Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

          Unassigned and untriaged, per the single-producer rule for domain:*.

          Metadata

          Metadata

          Assignees

          Labels

          Type

          No type

          Projects

          No projects

            Milestone

            No milestone

            Relationships

            None yet

            Development

            No branches or pull requests

            Issue actions

            , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
            Skip to content

            A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

            Description

            @os-warren

            Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

            Measured

            Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

            defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

            After 7 invocations:

            RUNS: 7
            JOB CONTEXT KEYS: bundle, data, jobId
            jobId -> string
            data -> undefined
            bundle -> object
            

            That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

            The call site is unambiguous:

            • service-jobrecord.handler({ jobId: record.name, data })
            • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

            Why this is a gap and not a design

            A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

            The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

            The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

            For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

            The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

            1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
            2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

            What the failure looks like in practice

            Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

            Suggested direction

            Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

            async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

            A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

            Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

            Not the same as #14095

            Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

            Provenance

            Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

            Unassigned and untriaged, per the single-producer rule for domain:*.

            Metadata

            Metadata

            Assignees

            Labels

            Type

            No type

            Projects

            No projects

              Milestone

              No milestone

              Relationships

              None yet

              Development

              No branches or pull requests

              Issue actions

              , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
              Skip to content

              A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

              Description

              @os-warren

              Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

              Measured

              Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

              defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

              After 7 invocations:

              RUNS: 7
              JOB CONTEXT KEYS: bundle, data, jobId
              jobId -> string
              data -> undefined
              bundle -> object
              

              That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

              The call site is unambiguous:

              • service-jobrecord.handler({ jobId: record.name, data })
              • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

              Why this is a gap and not a design

              A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

              The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

              The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

              For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

              The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

              1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
              2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

              What the failure looks like in practice

              Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

              Suggested direction

              Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

              async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

              A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

              Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

              Not the same as #14095

              Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

              Provenance

              Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

              Unassigned and untriaged, per the single-producer rule for domain:*.

              Metadata

              Metadata

              Assignees

              Labels

              Type

              No type

              Projects

              No projects

                Milestone

                No milestone

                Relationships

                None yet

                Development

                No branches or pull requests

                Issue actions

                , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
                Skip to content

                A defineJob handler is invoked with { jobId, data, bundle } and no data reach, so the platform's only scheduled-work metadata shape cannot read or write a record #14094

                Description

                @os-warren

                Found while building an ObjectStack application in objectstack-ai/duly against published @objectstack/* 17.2.0. Filed here because the fix lands in packages/runtime (and/or the IJobService contract in packages/spec).

                Measured

                Booted a real app (createStandaloneStack + ObjectKernel + AppPlugin + JobServicePlugin, memory driver) with one declared job whose handler records its own argument:

                defineJob({name: 'duly_probe_job',schedule: {type: 'interval',intervalMs: 100},handler: 'dulyProbeJob'})// functions: { dulyProbeJob: (ctx) => seen.push(ctx) }

                After 7 invocations:

                RUNS: 7
                JOB CONTEXT KEYS: bundle, data, jobId
                jobId -> string
                data -> undefined
                bundle -> object
                

                That is the whole context. No engine, no service registry, no getService, no logger, no session. bundle is the metadata bundle (AppPlugin passes this.bundle; nothing is ever attached to it — the only assignment in the file is this.bundle = bundle).

                The call site is unambiguous:

                • service-jobrecord.handler({ jobId: record.name, data })
                • runtime's AppPluginasync (jobCtx) => { await handler({ ...jobCtx, jobId: jobName, bundle: this.bundle }); }

                Why this is a gap and not a design

                A scheduled job is, overwhelmingly, a thing that writes records on a timer — a nightly sweep, a dispatcher, a reconciliation. The platform ships exactly one metadata shape for that (defineJob), resolves its handler out of defineStack({ functions }), and then hands the handler nothing to write with.

                The functions map's own contract says why this is not simply the pure-function rule applied consistently. From FlowFunctionEffectSchema's TSDoc:

                The runtime hands a function no data reach — FlowFunctionContext … carries input / variables / automation / logger and no engine handle — but a function is ordinary host code and can close over a client at module scope.

                For a flowscript node that is coherent: the function is pure because the flow graph does the I/O around it (get_record before, create_record after), and #4354's per-run metrics depend on exactly that. A job has no graph. There is no node before or after it. So the same emptiness that is a clean contract for a script node leaves a job with no supported way to do the one thing jobs exist to do.

                The documented escape — closing over a client at module scope — is available to a flow function and is not reliably available to a job, for two reasons measured in the same app:

                1. The only place an ObjectStack application is handed ctx.ql is defineStack({ onEnable }). So the escape is not "close over a client", it is "have the config assign a module-scope global that the job handler reads later" — action at a distance, in the one job whose failure is silent.
                2. It does not survive the artifact path at all. objectstack build emits functions into a bundled runtime module whose only exports are { functions, meta }; the artifact JSON carries no onEnable, and mergeRuntimeModule merges only functions. So on an artifact-served boot the binding is never made and the module-scope slot stays empty.

                What the failure looks like in practice

                Nothing. The job is registered, appears in the metadata registry and the admin UI, is scheduled by the job service, runs on time, and does nothing — or throws, if the application chose to make the absence loud. There is no author-time gate: objectstack validate passes, and AppPlugin's only related warning (job handler not found in bundle.functions — skipping) covers a missing handler, not a handler with no reach.

                Suggested direction

                Give the job handler context the reach its job implies, in the same shape the rest of the platform already uses. The narrowest version is one member on the context AppPlugin builds — it already has ql in scope at onEnable time in the same file:

                async(jobCtx)=>{awaithandler({ ...jobCtx,jobId: jobName,bundle: this.bundle, ql });}

                A wider version passes the kernel's getService, which also unblocks a job that needs automation, email or queue — all of which are equally unreachable today.

                Either is additive: JobHandler is declared (context: { jobId: string; data?: unknown }) => …, so existing handlers are unchanged byte for byte, exactly as #6617's JobRunOutcome widening was.

                Not the same as #14095

                Filed alongside #14095, which is about recognising a uniqueness violation once you can reach the store. This one is about reaching it at all; they are independent and either can land first.

                Provenance

                Reported by a developer agent implementing objectstack-ai/duly#2 (the dispatcher job — idempotent task generation). The application does not work around it silently: the dispatcher takes its engine as an explicit argument, exposes one named bindDispatchEngine seam, and its job handler refuses loudly with a message naming the wiring rather than reporting a clean run in which nothing was dispatched.

                Unassigned and untriaged, per the single-producer rule for domain:*.

                Metadata

                Metadata

                Assignees

                Labels

                Type

                No type

                Projects

                No projects

                  Milestone

                  No milestone

                  Relationships

                  None yet

                  Development

                  No branches or pull requests

                  Issue actions