[Feature] Guideline Reinforcement Engine – Enforce Prompt Rules in Markdown, YAML, SudoLang

[christso]

Problem

bbeval opt must generate structured, compliant prompts in Markdown, YAML, or SudoLang, while enforcing company guidelines (attached via --guidelines) Invalid prompts (missing {{examples}}, banned phrases, wrong format) must be rejected during optimization.

Proposed Solution

Add a multi-format Guideline Reinforcement Engine to bbeval opt that:

• Validates every candidate before scoring
• Supports Markdown, YAML, and SudoLang output
• Enforces format-specific rules via --guidelines (YAML)

---

CLI Usage

bbeval opt tests.yaml base.prompt.md \
 --mode direct-llm \
 --guidelines constraints.yaml \
 --format markdown \
 --output optimized.prompt.md

---

constraints.yaml (Format-Agnostic + Format-Specific)

# Global
required_placeholders:
 - "{{task}}"
 - "{{guidelines}}"
banned_phrases:
 - "never"
 - "always avoid"
max_tokens: 500

# Format: Markdown
markdown:
 required_headers:
 - "# Task"
 - "## Output"
 required_tools_in_frontmatter: true
 no_universal_concepts: true # Ban SOLID, PascalCase, etc.

# Format: YAML
yaml:
 required_keys:
 - persona
 - workflow
 - output
 no_inheritance: true # Ban `extends`, `class`

# Format: SudoLang
sudolang:
 no_class_keywords: true
 prefer_natural_language: true
 required_constraints_block: true
 lint_rules: true # Auto-run SudoLang linter

---

Supported Output Formats

Format	When to Use	Validation
Markdown (default)	Single workflow, clear steps	Headers, frontmatter, placeholders
YAML	Multi-workflow, context-aware	Keys, no class, composition
SudoLang	Loops, branching, state	No new, constraints, lint

Auto-selection: bbeval opt picks simplest format that fits logic (Markdown > YAML > SudoLang).

---

Enforcement Flow

def validate_candidate(prompt_str: str, format: str) -> (bool, str):
 # 1. Parse (Markdown → AST, YAML → dict, SudoLang → lint)
 # 2. Check global rules (tokens, phrases)
 # 3. Check format-specific rules

# In optimizer:
if not validate_candidate(candidate, format):
 score = 0.0 # Reject early

---

Example: Optimized Markdown Output

---
description: 'SQL schema review'
mode: 'ask'
tools: ['runInTerminal', 'getTerminalOutput']
---

# SQL Schema Reviewer

You are a senior DBA with 15 years in fintech.

## Task
Review `${selection}` for compliance with internal SQL standards.

{{guidelines}}

## Instructions
1. Run `EXPLAIN` via terminal
2. Check for missing indexes
3. Suggest fixes only if critical

## Output
```diff
- Old
+ New

---

SudoLang Linter Integration

# constraints.yaml
sudolang:
 lint: true

→ Auto-runs:

Lint { style constraints { * obey style guide; prohibit (class) } }