feat(evaluators): add Cisco AI Defense evaluator and examples - #60

Merged
abhinav-galileo merged 6 commits into
mainfrom
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged

feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom
feature/cisco-ai-defense-integration

Conversation

@rucpande

@rucpanderucpande commented Mar 5, 2026•
edited
Loading

Copy link
Copy Markdown
Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore

Summary

  • What changed and why.

Scope

  • User-facing/API changes:
  • Internal changes:
  • Out of scope:

Risk and Rollout

  • Risk level: low / medium / high
  • Rollback plan:

Testing

  • Added or updated automated tests
  • Ran make check (or explained why not)
  • Manually verified behavior

Checklist

  • Linked issue/spec (if applicable)
  • Updated docs/examples for user-facing changes
  • Included any required follow-up tasks

@codecov

codecovBot commented Mar 5, 2026

Copy link
Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.
Please activate this user on Codecov to display this PR comment.
Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.
Please don't hesitate to email us at support@codecov.io with any questions.

@rucpanderucpande changed the title feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande changed the title feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17 reviewed Mar 5, 2026
View reviewed changes
Comment threadMakefile Outdated
abhinav-galileo
abhinav-galileo reviewed Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py Outdated
Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py Outdated
Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py Outdated
Comment threadexamples/ai_defense/chat_guarded.py Outdated
Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py Outdated
Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py Outdated
Comment threadexamples/cisco_ai_defense/seed_policy.py Outdated
abhinav-galileo
abhinav-galileo reviewed Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande

rucpande commented Mar 5, 2026

Copy link
Copy Markdown
CollaboratorAuthor

Thanks for the quick and thorough review! Will address the last comment tomorrow.

@rucpande

rucpande commented Mar 9, 2026

Copy link
Copy Markdown
CollaboratorAuthor

@abhinav-galileo please let me know if anything else is required.

abhinav-galileo
abhinav-galileo requested changes Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py Outdated
Comment threadexamples/cisco_ai_defense/seed_policy.py Outdated
Comment threadexamples/cisco_ai_defense/register_agent.py Outdated
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py Outdated
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py Outdated
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py Outdated
abhinav-galileo
abhinav-galileo reviewed Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py Outdated
@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed the feature/cisco-ai-defense-integration branch from f455de5 to 7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo merged commit 52e2416 into mainMar 11, 2026
5 checks passed
@abhinav-galileo
abhinav-galileo deleted the feature/cisco-ai-defense-integration branch March 11, 2026 15:51
galileo-automation pushed a commit that referenced this pull request Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation

galileo-automation commented Mar 18, 2026

Copy link
Copy Markdown
Collaborator

🎉 This PR is included in version 2.0.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees

No one assigned

Labels

released

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all 
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix");
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms");
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links");
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default");
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers");
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode");
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();

Skip to content
feat(evaluators): add Cisco AI Defense evaluator and examples - #60
Merged
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Mar 11, 2026
Merged
feat(evaluators): add Cisco AI Defense evaluator and examples#60
abhinav-galileo merged 6 commits into
mainfrom 
feature/cisco-ai-defense-integration
Conversation
@rucpande
@rucpanderucpande
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Collaborator
  • Add contrib package at evaluators/contrib/ai_defense
  • Add examples under examples/ai_defense
  • Update Makefile with AI Defense targets
  • Update evaluators/builtin/pyproject.toml for discovery
  • Update .gitignore
Summary
  • What changed and why.
Scope
  • User-facing/API changes:
  • Internal changes:
  • Out of scope:
Risk and Rollout
  • Risk level: low / medium / high
  • Rollback plan:
Testing
  •  Added or updated automated tests
  •  Ran make check (or explained why not)
  •  Manually verified behavior
Checklist
  •  Linked issue/spec (if applicable)
  •  Updated docs/examples for user-facing changes
  •  Included any required follow-up tasks
@codecov
codecovBot
commented
Mar 5, 2026

Copy link


Copy Markdown

The author of this PR, rucpande, is not an activated member of this organization on Codecov.

Please activate this user on Codecov to display this PR comment.

Coverage data is still being uploaded to Codecov.io for purposes of overall coverage calculations.

Please don't hesitate to email us at support@codecov.io with any questions.
@rucpanderucpande
changed the title
feat(contrib): add Cisco AI Defense evaluator and examplesfeat: add Cisco AI Defense evaluator and examplesMar 5, 2026
@rucpanderucpande
changed the title
feat: add Cisco AI Defense evaluator and examplesfeat(evaluators): add Cisco AI Defense evaluator and examplesMar 5, 2026
lan17
lan17
reviewed
Mar 5, 2026
View reviewed changes
Comment threadMakefile
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadexamples/ai_defense/examples/ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/evaluator.py
Outdated

Comment threadexamples/ai_defense/chat_guarded.py
Outdated

Comment threadevaluators/contrib/ai_defense/tests/test_chat_inspect_evaluator.py
Outdated

Comment threadevaluators/contrib/ai_defense/src/agent_control_evaluator_ai_defense/chat_inspect/client.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 5, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/pyproject.toml
@rucpande
rucpande
commented
Mar 5, 2026

Copy link


Copy Markdown

CollaboratorAuthor
Thanks for the quick and thorough review! Will address the last comment tomorrow.
@rucpande
rucpande
commented
Mar 9, 2026

Copy link


Copy Markdown

CollaboratorAuthor
@abhinav-galileo please let me know if anything else is required.
abhinav-galileo
abhinav-galileo
requested changes
Mar 10, 2026
View reviewed changes
Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/seed_policy.py
Outdated

Comment threadexamples/cisco_ai_defense/register_agent.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/client.py
Outdated

Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/config.py
Outdated

abhinav-galileo
abhinav-galileo
reviewed
Mar 10, 2026
View reviewed changes
Comment threadevaluators/contrib/cisco/src/agent_control_evaluator_cisco/ai_defense/evaluator.py
Outdated

@rucpande@abhinav-galileo
feat(contrib): add Cisco AI Defense evaluator and examples
c2aabd2
- Add contrib package at evaluators/contrib/ai_defense
- Add examples under examples/ai_defense
- Update Makefile with AI Defense targets
- Update evaluators/builtin/pyproject.toml for discovery
- Update .gitignore
@rucpande@abhinav-galileo
fix(ai-defense): address PR 60 review comments
0efe174
- Honor on_error on missing API key and add metadata
- Add tests: missing key deny/allow, api_url override, safe/unsafe mapping, client reuse
- Recreate client on key/endpoint/timeout change; assert non-null client
- Narrow client import exception to ImportError
- Fix examples to use server_url kwarg
- Remove duplicate nested register_agent.py
- Remove AI Defense targets from root Makefile (keep contrib out)
@rucpande@abhinav-galileo
follow contrib template. rename from ai_defense to cisco/ai_defense
5bc10fe
@rucpande@abhinav-galileo
missed file in renaming
a6bad21
@rucpande@abhinav-galileo
cleanup examples
894d019
@rucpande@abhinav-galileo
evaluator fixes, refactor examples and control setup
7018215
@abhinav-galileo
abhinav-galileoforce-pushed
the
feature/cisco-ai-defense-integration
branch
from
f455de5 to
7018215CompareMarch 11, 2026 15:48
@abhinav-galileo
abhinav-galileo
merged commit 52e2416
into
mainMar 11, 2026

5 checks passed

@abhinav-galileo
abhinav-galileo
deleted the

feature/cisco-ai-defense-integration

branch
March 11, 2026 15:51
galileo-automation pushed a commit
that referenced
this pull request
Mar 18, 2026
@semantic-release-bot
chore(release): ts sdk v2.0.0 [skip ci]
8b6e3f5
## [2.0.0](ts-sdk-v1.1.0...ts-sdk-v2.0.0) (2026-03-18)
### ⚠ BREAKING CHANGES
* **server:** implement recursive control condition trees (#115)
### Features
* **docs:** simplify main README quick start v2 ([#100](#100)) ([7701c65](7701c65))
* **docs:** Update README.md to accurately mention Strands Agents SDK ([#105](#105)) ([84dfa57](84dfa57))
* **evaluators:** add Cisco AI Defense evaluator and examples ([#60](#60)) ([52e2416](52e2416))
* **sdk:** add Google ADK framework integration ([#83](#83)) ([f2b53ee](f2b53ee))
* **server:** implement recursive control condition trees ([#115](#115)) ([2ff4c12](2ff4c12))
### Bug Fixes
* **docs:** clarify README quickstart flow ([#119](#119)) ([317c626](317c626))
* **docs:** cleanup readme ([#66](#66)) ([eca0d6b](eca0d6b))
* **docs:** promote Google ADK plugin in README ([#99](#99)) ([f038aa4](f038aa4))
* **evaluators:** address Cisco AI Defense review issues ([#103](#103)) ([81da81b](81da81b))
* **examples:** shut down SDK in short-lived demos ([#85](#85)) ([df43264](df43264))
* **sdk:** fail closed on post-hook evaluation errors ([#114](#114)) ([67f8fc1](67f8fc1)), closes [#112](#112)
* **sdk:** skip evaluation when no controls apply ([#124](#124)) ([d2cd9f9](d2cd9f9))
* **server:** escape ILIKE pattern in evaluator-configs list endpoint ([#108](#108)) ([cb6e89f](cb6e89f))
* **server:** reject empty string list evaluator values ([#121](#121)) ([2c55d27](2c55d27))
* **server:** revert unwanted changes in server config ([#117](#117)) ([d92e168](d92e168))
* **ui:** create flow - name trimming issue ([#93](#93)) ([1a9759d](1a9759d))
@galileo-automation
galileo-automation
commented
Mar 18, 2026

Copy link


Copy Markdown

Collaborator
🎉 This PR is included in version 2.0.0 🎉
The release is available on:
Your semantic-release bot 📦🚀
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@abhinav-galileoabhinav-galileoabhinav-galileo approved these changes
@yashsheth46yashsheth46Awaiting requested review from yashsheth46
@namrataghadi-galileonamrataghadi-galileoAwaiting requested review from namrataghadi-galileo
@lan17lan17Awaiting requested review from lan17

Assignees


No one assigned


Labels

released

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@rucpande@galileo-automation@lan17@abhinav-galileo