Skip to content

Add AWS EKS API autoscaling (Prometheus + adapter) - #94

Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom
erikdw/api-autoscaling-aws-prom
Draft

Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom
erikdw/api-autoscaling-aws-prom

Conversation

@erikdw

@erikdwErik Weathers (erikdw) commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.

Test plan

  • ./test.sh (unit + render + lint) locally
  • Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  • Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  • Rebase/retarget onto main after the GKE PR merges

Made with Cursor

@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed the erikdw/api-autoscaling-aws-prom branch from 7a39de8 to c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw) mentioned this pull request Aug 3, 2026
Draft
4 tasks
@erikdw

Erik Weathers (erikdw) commented Aug 10, 2026

Copy link
Copy Markdown
ContributorAuthor

Sync / retest (2026-08-10)

  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.

@erikdw
Erik Weathers (erikdw)force-pushed the erikdw/api-autoscaling-aws-prom branch from c943428 to aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed the erikdw/api-autoscaling-aws-prom branch from aa9106b to c0f2ea0CompareAugust 17, 2026 22:37
Base automatically changed from brianvans/support-autoscaling-api-on-gke to mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all 
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Force GitHub README to respect dark mode
(function() {
var style = document.createElement('style');
style.textContent = '
.markdown-body {
color-scheme: dark light;
}
.markdown-body pre { background: #161b22 !important; }
.markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }
.markdown-body table th, .markdown-body table td { border-color: #30363d !important; }
.markdown-body img { background: #0d1117; }
.markdown-body blockquote { border-left-color: #8b949e; }
.markdown-body hr { border-color: #30363d; }
';
document.head.appendChild(style);
})();
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Highlight search terms from Google/DuckDuckGo/Bing referrer
(function() {
var ref = document.referrer;
var terms = [];
if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {
var url = new URL(ref);
var q = url.searchParams.get('q') || url.searchParams.get('p');
if (q) {
terms = q.split(/\s+/).filter(function(t) { return t.length > 2; });
}
}
if (terms.length === 0) return;
var style = document.createElement('style');
style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';
document.head.appendChild(style);
function highlight(node) {
if (node.nodeType === 3) { // text node
var text = node.textContent;
var found = false;
terms.forEach(function(term) {
var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi');
if (regex.test(text)) {
found = true;
var frag = document.createDocumentFragment();
var parts = text.split(regex);
parts.forEach(function(part, i) {
if (i % 2 === 0) {
frag.appendChild(document.createTextNode(part));
} else {
var span = document.createElement('span');
span.className = 'userscript-highlight';
span.textContent = part;
frag.appendChild(span);
}
});
node.parentNode.replaceChild(frag, node);
}
});
} else if (node.nodeType === 1 && node.childNodes) { // element
var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];
if (!skipTags.includes(node.tagName)) {
Array.from(node.childNodes).forEach(highlight);
}
}
}
highlight(document.body);
// Re-highlight on dynamic content
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1 || node.nodeType === 3) highlight(node);
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Strip utm_, fbclid, gclid, etc. from all links on page
(function() {
var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',
'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',
'ref', 'ref_src', 'source', 'medium', 'campaign'];
function cleanUrl(url) {
try {
var u = new URL(url, window.location.origin);
var changed = false;
trackingParams.forEach(function(p) {
if (u.searchParams.has(p)) {
u.searchParams.delete(p);
changed = true;
}
});
return changed ? u.toString() : url;
} catch (e) {
return url;
}
}
function cleanLinks() {
document.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
cleanLinks();
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1) {
if (node.tagName === 'A') cleanLinks();
node.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Auto-enable theater mode on YouTube
(function() {
function tryTheater() {
var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]');
if (btn && !btn.classList.contains('activated')) {
btn.click();
}
}
// Try immediately
tryTheater();
// Try after navigation (SPA)
var lastUrl = location.href;
setInterval(function() {
if (location.href !== lastUrl) {
lastUrl = location.href;
setTimeout(tryTheater, 500);
}
}, 1000);
// Also try on player load
var observer = new MutationObserver(tryTheater);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Remove or un-stick sticky/fixed headers that block content
(function() {
function unstick() {
document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) {
if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {
el.style.position = 'static';
el.style.top = 'auto';
el.style.zIndex = 'auto';
}
});
}
unstick();
var observer = new MutationObserver(unstick);
observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });
})();
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Universal Dark Mode - works on any site
(function() {
var enabled = true;
function applyDarkMode() {
if (!enabled) return;
// Create style element if it doesn't exist
var style = document.getElementById('universal-dark-mode-style');
if (!style) {
style = document.createElement('style');
style.id = 'universal-dark-mode-style';
document.head.appendChild(style);
}
// Dark mode CSS - inverts colors but preserves images/video
style.textContent = '
/* Invert everything except media */
html {
filter: invert(1) hue-rotate(180deg) !important;
background: #1a1a2e !important;
}
/* Restore images, videos, iframes, canvas */
img, video, iframe, canvas, svg, picture, [style*="background-image"] {
filter: invert(1) hue-rotate(180deg) !important;
}
/* Preserve specific elements that should not be inverted */
.no-dark-mode, .no-dark-mode *,
[data-theme="light"], [data-theme="light"],
.ace_editor, .ace_editor *,
.CodeMirror, .CodeMirror *,
.monaco-editor, .monaco-editor *,
.markdown-body pre, .markdown-body pre *,
.highlight, .highlight *,
pre code, pre code * {
filter: none !important;
}
/* Fix common UI elements */
.modal, .popup, .dropdown-menu, .tooltip, .popover {
filter: invert(1) hue-rotate(180deg) !important;
background: #2d2d44 !important;
border-color: #444 !important;
}
/* Scrollbars */
::-webkit-scrollbar { background: #1a1a2e !important; }
::-webkit-scrollbar-thumb { background: #444 !important; }
::-webkit-scrollbar-thumb:hover { background: #555 !important; }
/* Selection */
::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
';
}
function removeDarkMode() {
var style = document.getElementById('universal-dark-mode-style');
if (style) style.remove();
}
// Toggle with Alt+Shift+D
document.addEventListener('keydown', function(e) {
if (e.altKey && e.shiftKey && e.key === 'D') {
e.preventDefault();
enabled = !enabled;
if (enabled) {
applyDarkMode();
console.log('[Universal Dark Mode] Enabled');
} else {
removeDarkMode();
console.log('[Universal Dark Mode] Disabled');
}
}
});
// Apply on load
applyDarkMode();
// Re-apply on dynamic content
var observer = new MutationObserver(function(mutations) {
if (enabled && !document.getElementById('universal-dark-mode-style')) {
applyDarkMode();
}
});
observer.observe(document.head, { childList: true });
console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');
})();
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();
Add AWS EKS API autoscaling (Prometheus + adapter) by erikdw · Pull Request #94 · braintrustdata/helm · GitHub
Skip to content
Add AWS EKS API autoscaling (Prometheus + adapter) - #94
Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Draft
Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom 
erikdw/api-autoscaling-aws-prom
Conversation
@erikdw
@erikdwErik Weathers (erikdw)
commented
Jul 27, 2026

Copy link


Copy Markdown

Contributor
Summary
  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.
Test plan
  • ./test.sh (unit + render + lint) locally
  •  Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  •  Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  •  Rebase/retarget onto main after the GKE PR merges
Made with Cursor
@brianvans
Support autoscaling the API on GKE
d8ded2e
Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.
See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@brianvans
Merge remote-tracking branch 'origin/main' into brianvans/support-aut…
a31c39b
…oscaling-api-on-gke
@brianvans
Inline docs for /metrics being added in v2.9.0
f592b56
@brianvans
Add gke autoscaling docs to README
4458285
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
7a39de8 to
c943428CompareAugust 3, 2026 20:49
@erikdwErik Weathers (erikdw)
mentioned this pull request
Aug 3, 2026
 Draft

4 tasks
@erikdw
Erik Weathers (erikdw)
commented
Aug 10, 2026

Copy link


Copy Markdown

ContributorAuthor
Sync / retest (2026-08-10)
  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
c943428 to
aa9106bCompareAugust 14, 2026 00:11
@brianvans
formatting
8405cde
@brianvans
Expand tests and stop using brittle document indexes
d45fb9b
@brianvans
Narrow cpu scaling to just api container w/ ContainerResource
6148261
Better document hard requirement on v2.9.0 for /metrics endpoint
@erikdw@cursoragent
Add AWS EKS autoscaling via Prometheus and prometheus-adapter.
c0f2ea0
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.
Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw)force-pushed
the
erikdw/api-autoscaling-aws-prom
branch
from
aa9106b to
c0f2ea0CompareAugust 17, 2026 22:37

Base automatically changed from
brianvans/support-autoscaling-api-on-gke to
mainAugust 18, 2026 00:35
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

2 participants

@erikdw@brianvans