Skip to content

Bug: DbtModelDocumentationAssessor false-negative on descriptions containing 'description' #353

Description

@kami619

Summary

The DbtModelDocumentationAssessor in src/agentready/assessors/dbt.py has a placeholder detection bug that causes legitimate model descriptions to be incorrectly flagged as placeholders.

Root Cause

dbt.py:372-388 — the word "description" is included in the placeholder_texts set:

placeholder_texts = {"todo", "tbd", "fixme", "placeholder", "description"}

The check uses substring matching:

if description and not any(
    placeholder in description for placeholder in placeholder_texts
):
    documented_models.add(model_name)

A model with description: "Customer description field" is rejected because "description" in "customer description field" is True.

Impact

  • Models with the word "description" anywhere in their description text are counted as undocumented
  • This deflates documentation coverage scores, potentially causing false fail results

Suggested Fix

Remove "description" from placeholder_texts, or switch to exact match:

# Option A: Remove "description"
placeholder_texts = {"todo", "tbd", "fixme", "placeholder"}

# Option B: Exact match
if description and description not in placeholder_texts:

Found in

PR #334 — Feature/add dbt support

🤖 Generated with Claude Code

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions