Skip to content

fix(llms-txt): replace dead skills.sentry.dev entry points in llms.txt + SKILL.md - #19183

Open
wallidsaydi-creator wants to merge 2 commits into
getsentry:masterfrom
wallidsaydi-creator:fix/llms-txt-dead-skill-links
Open

fix(llms-txt): replace dead skills.sentry.dev entry points in llms.txt + SKILL.md#19183
wallidsaydi-creator wants to merge 2 commits into
getsentry:masterfrom
wallidsaydi-creator:fix/llms-txt-dead-skill-links

Conversation

@wallidsaydi-creator

@wallidsaydi-creatorwallidsaydi-creator commented Aug 29, 2026

Copy link
Copy Markdown

Summary

Fixes#19182.

docs.sentry.io/llms.txt (L183–186) and the repo-root SKILL.md (L22–24) direct AI agents to browse the Sentry skill library — but two of the four advertised entry points are dead:

Advertised URLStatus
https://skills.sentry.dev/200
https://skills.sentry.dev/instrument200
https://skills.sentry.dev/workflows404
https://skills.sentry.dev/features404

The served skill tree no longer contains workflows/features as top-level routes — the current skills are the flat sentry-* set. When a coding agent follows the published "Workflows" / "Features" entry points and hits a bare 404 from Vercel, it either dead-ends or improvises — the exact failure mode llms.txt exists to prevent.

This PR replaces both dead links (plus the /sdks/instrument redirect in SKILL.md) with canonical paths that exist today.

Changes

  • scripts/generate-llms-txt.mjsAGENT_SKILLS block: [Workflows]/[Features][Debug Issues] / [Create Alerts] / [OTel Setup], all pointing at real sentry-*/SKILL.md routes
  • SKILL.md — same three-line replacement, additionally fixing /sdks/instrument

Verification

  • 404s confirmed deterministic (3 passes, browser + curl UAs, x-vercel-cache: MISS from origin)
  • All replacement URLs verified 200 live at PR time:
    • https://skills.sentry.dev/
    • https://skills.sentry.dev/instrument
    • https://skills.sentry.dev/sentry-debug-issue/SKILL.md
    • https://skills.sentry.dev/sentry-create-alert/SKILL.md
    • https://skills.sentry.dev/sentry-otel-exporter-setup/SKILL.md
  • AGENT_SKILLS injection into both outputs (public/llms.txt + public/md-exports/index.md) verified in generator source (assembly at L251/L281)
  • Diff is identical to the one offered in llms.txt and SKILL.md direct AI agents to dead skills.sentry.dev entry points (/workflows, /features 404) #19182

Context

I audit AI-agent tooling and documentation drift. Recent related work: cloudflare/cloudflare-docs#32985 (merged: llms.txt hub link generation fix) and the Codex TOML fix in upstash/context7#3060 (shipped by the maintainer in #3075).

IS YOUR CHANGE URGENT?

  • Urgent deadline (GA date, etc.): YYYY-MM-DD
  • Other deadline: YYYY-MM-DD
  • No deadline: Not urgent, can wait up to 1 week+

…t + SKILL.md
skills.sentry.dev/workflows and /features return 404; the served skill
tree only ships flat sentry-* routes. Replaces both dead links (and the
/sdks redirect in SKILL.md) with canonical 200-verified paths, in both
AGENT_SKILLS (generate-llms-txt.mjs) and SKILL.md.
Fixesgetsentry#19182
@vercel

vercelBot commented Aug 29, 2026

Copy link
Copy Markdown

@wallidsaydi-creator is attempting to deploy a commit to the Sentry Team on Vercel.

A member of the Team first needs to authorize it.

@chatgpt-codex-connector

chatgpt-codex-connectorBot commented Aug 29, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

ReviewStatusCommitReview trigger
📝 Code ReviewCompleted2026-08-29T12:45:30.323354Z8b60fdbPR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@github-actionsgithub-actionsBot added the Priority: Needs Triage The PR description is missing valid priority information label Aug 29, 2026
@codeowner-assignment
codeowner-assignmentBot requested a review from a teamAugust 29, 2026 12:43
Comment threadSKILL.md Outdated

@chatgpt-codex-connectorchatgpt-codex-connectorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit:8b60fdbd6c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment threadSKILL.md Outdated
- **Feature setup** (AI monitoring, alerts, OTel): https://skills.sentry.dev/features
- **SDK setup** (detect platform and install): https://skills.sentry.dev/instrument
- **Debugging workflows** (fix issues, review code): https://skills.sentry.dev/sentry-debug-issue/SKILL.md
- **Feature setup** (AI monitoring, alerts, OTel): https://skills.sentry.dev/sentry-create-alert/SKILL.md

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Route each feature to its matching skill

When the plugin is unavailable and an agent selects this entry for AI monitoring or OpenTelemetry, it is sent to the alert-creation skill instead of instructions for the requested feature. The generator already treats OTel as a separate skill at scripts/generate-llms-txt.mjs:194; split this entry into feature-specific links (and provide the corresponding AI-monitoring route) so the repository's routing guide does not misdirect agents.

AGENTS.md reference: AGENTS.md:L100-L102

Useful? React with 👍 / 👎.

Address review feedback: SKILL.md now mirrors the generator's skill
list — OTel setup gets its own sentry-otel-exporter-setup entry
instead of being conflated with alert creation.
@wallidsaydi-creator

Copy link
Copy Markdown
Author

Both review findings addressed in 4d28165:

  • OTel Setup entry split out in SKILL.md — it now mirrors the generator's skill list (sentry-otel-exporter-setup/SKILL.md, verified 200 live) instead of routing OTel/AI-monitoring requests to the alert-creation skill.
  • PR urgency metadata filled (no deadline).

The SKILL.md and AGENT_SKILLS block are now 1:1 on skill coverage and URLs.

@github-actionsgithub-actionsBot added Priority: Normal Docs review has no urgent deadline and removed Priority: Needs Triage The PR description is missing valid priority information labels Aug 29, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Priority: NormalDocs review has no urgent deadline

Projects

None yet

Development

Successfully merging this pull request may close these issues.

llms.txt and SKILL.md direct AI agents to dead skills.sentry.dev entry points (/workflows, /features 404)

1 participant

@wallidsaydi-creator