Uh oh!
There was an error while loading. Please reload this page.
Phase C: limits/judge API, eval, regex gaps - #80
Conversation
Greptile SummaryThis PR completes the Phase C public API and detection updates. The main changes are:
Confidence Score: 4/5This is close, but the regex false positive should be fixed before merging.
sdk/src/unplug/data/patterns/injection.yaml Important Files Changed
Reviews (2): Last reviewed commit: "Tighten supersede pattern; expand redact..." | Re-trigger Greptile |
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
SDK Coverage •
| ||||||||||||||||||||||||||||||||||||||||
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using high effort and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 17d4675. Configure here.
Uh oh!
There was an error while loading. Please reload this page.
chiruu12
commented
Jul 20, 2026
Follow-up fixes merged in #81 → dev ( |

Summary
LimitConfig/ BYOLLM judge on the public path (unplug,unplug.api.limits,unplug.api.judge) with docs, example, and end-to-end tests (wiring already existed in Guard; this finishes the public surface and TOML story).sdk/docs/EVAL_PHASE_C.md(refresh download/reproduce commands).Test plan
make check/make test-cov(80%+) insdk/uv run python examples/limits_and_judge_demo.pyuv run python -m benchmarks.run benchmarks/data/neuralchemy.jsonl --isolated --format json(recall 0.405 / F1 0.575)Note
Medium Risk
Changes affect core injection scanning and text normalization (redaction span mapping), which can shift false positives/negatives; public API additions are additive but provisional.
Overview
Phase C promotes
LimitConfigand BYOLLM judge types (CallableJudge,JudgeProvider, etc.) to the stable public surface via top-levelunplug, newunplug.api.limits/unplug.api.judge, migration tier updates,LIMITS_AND_JUDGE.md, example config, and a demo script—backed by broader integration tests (TOML limits, judge band, fail-closed).Regex detection gains ten neuralchemy-driven injection patterns and bidi / invisible control stripping in the normalizer (plus span mapping so redaction includes adjacent stripped chars). Benchmark README/docs reflect a small regex-only neuralchemy lift (recall ~0.41, F1 ~0.58);
EVAL_PHASE_C.mdrecords reproduce commands and remaining gaps.Reviewed by Cursor Bugbot for commit 17d4675. Bugbot is set up for automated code reviews on this repo. Configure here.