Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0 - #496

Merged
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2
Sep 2, 2026
Merged

Migrate data handling from Serilog's LogEvent across to System.Text.Json.JsonObject, with the help of Seq.Syntax v2.0#496
KodrAus merged 15 commits into
datalust:devfrom
nblumhardt-ro:seq-syntax-v2

Conversation

@nblumhardt-ro

Copy link
Copy Markdown

This one's been in the pipeline for a long time!

seqcli originally piggy-backed on Serilog for event processing and formatting. This made sense when Seq's and Serilog's data models were aligned, but over time, Seq became completely general-purpose and dropped all Serilog-isms in its event model.

As Seq became general purpose only incrementally (first relaxing level name constraints, then adding OTel properties, then dropping existence requirements for things like messages, then adding tracing-specific and metrics-specific schema, ...), the mapping into and out of Serilog's LogEvent data model slowly became contorted and fragile.

This PR moves all event data handling to System.Text.Json.JsonObject, and leans on the v2 preview of Seq.Expressions to reimplement expression evaluation, formatting, and theming. I was able to lean on Claude for the mechanical bits, and I've run over a few more nice-to-have areas just to really strongly avoid any future temptation to mix up our data handling with Serilog.

Externally, the change shouldn't have any obvious behavioral impacts, modulo bugs I'm yet to spot. I did update the trace --json output to (correctly) preserve original, non-Serilog level names in this version (yet one more place where the Serilog model unnecessarily leaked in).

Nicholas Blumhardt added 7 commits September 1, 2026 15:20
…t.Json.JsonObject`, with the help of Seq.Syntax v2.0.
Assisted-by: Claude:claude-fable-5
…t want easy or obvious conversions into Serilog types, the set of scenarios that require this should be and stay vanishingly small
@@ -1,31 +1,41 @@
using System;
using System;

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that with this move and a few others, previously-general-purpose types have been scoped back to use only for app hosting interop, or sample data generation.

Comment threadsrc/SeqCli/Data/EventJsonDocument.cs Outdated

namespace SeqCli.Data;

static class EventJsonDocument

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to pull together more functionality for working with raw JSON events into this namespace; it's a bit bare right now.

@nblumhardt-ro
nblumhardt-ro marked this pull request as draft September 1, 2026 21:17
@nblumhardt-ro

Copy link
Copy Markdown
Author

Blocking on datalust/seq-syntax#7

@nblumhardt-ro
nblumhardt-ro marked this pull request as ready for review September 2, 2026 01:33
@nblumhardt-ro

Copy link
Copy Markdown
Author

All good to go!

public void Enrich(JsonObject eventJson)
{
logEvent.RemovePropertyIfPresent("@i");
eventJson["@l"] = level;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

throw new InvalidDataException($"The line is not a JSON object: `{json.Trim()}`.");

if (!eventJson.ContainsKey("@t"))
eventJson["@t"] = DateTime.UtcNow.ToString("O", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CreateScalar?

Comment threadsrc/SeqCli/Ingestion/LogShipper.cs Outdated
catch (Exception ex)
{
if (ex is JsonReaderException || ex is InvalidDataException)
if (ex is System.Text.Json.JsonException || ex is InvalidDataException)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Does this need to be fully qualified?

Comment threadsrc/SeqCli/Ingestion/ReadResult.cs Outdated
readonly struct ReadResult
{
public LogEvent? LogEvent { get; }
/// <summary>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: turf

using SeqCli.Data;
using SeqCli.Output;

namespace SeqCli.Mapping;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move into the Api namespace

Comment threadsrc/SeqCli/Output/TraceFormatter.cs Outdated

if (evt.Elapsed is { } elapsed)
properties.Add(new(ElapsedProperty, new ScalarValue(elapsed)));
eventJson[ElapsedProperty] = elapsed.ToString("c", CultureInfo.InvariantCulture);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CeateScalar

[Fact]
public void LiteralBracesAreEscapedInTemplateText()
{
var (message, _) = StructuredMessage.Read(new JArray("a {not-a-hole} b"));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually returning a template

try
{
var error = JsonConvert.DeserializeObject<dynamic>(resultJson)!;
var error = Newtonsoft.Json.JsonConvert.DeserializeObject<dynamic>(resultJson)!;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be Newtonsoft.Json?

@KodrAus
KodrAus merged commit 8730efe into datalust:devSep 2, 2026
2 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@nblumhardt-ro@KodrAus