Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation - #60933

Merged
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache
Jan 23, 2026
Merged

Support PR: Add TTL-enabled LRU cache for StatsD metrics aggregation#60933
jscheffl merged 39 commits into
apache:mainfrom
boschglobal:issue-50645-statsd-ttl-lru-cache

Conversation

@AutomationDev85

@AutomationDev85AutomationDev85 commented Jan 22, 2026

Copy link
Copy Markdown
Contributor

Overview

We are eagerly looking forward to seeing this PR merged #51792 from @shubham36deshpande. We would like to help bring this PR over the finish line, as we are currently facing this exact issue in our deployment and need to use it. As we do not have access to his repo we opened a new PR.

We noticed @jscheffl comment in the PR regarding the missing TTL parameter and found this parameter in the defaults section of the config mapping. In response, we have added a commit to the branch that includes the parameter in the config mapping of the StatsD deployment.

Thanks @shubham36deshpande for finding this topic.

@boring-cyborgboring-cyborgBot added the area:helm-chart Airflow Helm Chart label Jan 22, 2026
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 00a45b7 to 657381dCompareJanuary 22, 2026 12:29
@jscheffl

Copy link
Copy Markdown
Contributor

Thanks @AutomationDev85 for moving this forward. Yes the PR is pending since a while. But you also seem to be un-lucky... can you fix the tests?

@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 657381d to 846ca6eCompareJanuary 23, 2026 07:59
@AutomationDev85
AutomationDev85force-pushed the issue-50645-statsd-ttl-lru-cache branch from 846ca6e to 18e55b6CompareJanuary 23, 2026 08:19
@AutomationDev85

Copy link
Copy Markdown
ContributorAuthor

@jscheffl Thanks for the response. I fixed this issue. Now it looks good.

@jscheffljscheffl added this to the Airflow Helm Chart 1.19.0 milestone Jan 23, 2026

@jscheffljscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing, then we can put this into 1.19.0 and close this improvement pending since a long time! Cool!

@jscheffl
jscheffl merged commit ee45813 into apache:mainJan 23, 2026
164 of 165 checks passed
suii2210 pushed a commit to suii2210/airflow that referenced this pull request Jan 26, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Miretpl added a commit to Miretpl/airflow that referenced this pull request Jan 26, 2026
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
shreyas-dev pushed a commit to shreyas-dev/airflow that referenced this pull request Jan 29, 2026
shashbha14 pushed a commit to shashbha14/airflow that referenced this pull request Feb 2, 2026
jason810496 pushed a commit to abhijeets25012-tech/airflow that referenced this pull request Feb 3, 2026
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
jhgoebbert pushed a commit to jhgoebbert/airflow_Owen-CH-Leung that referenced this pull request Feb 8, 2026
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
…pache#60933)
* Making statsd-exporter TTL & cache-size/type configurable in Airflow Helm chart
* Added statsd configs in values.schema.json
* Fixing test errors
* updated the default values for statsd in schema.json
* Added default argumentd as cache sieze cache type and ttl, accomodated user defined args as well
* Removed EOF error from statsd deployment and improved description in values.schema.json
* Added default values in deployment.yaml, removed spelling errors formated schema.json properly
* added newlines and changed 'lru' to `lru`
* edited as per test output
* Making changes in deployment file
* Added newsfragments for statsd changes
* removed 0s from deployment.yaml
* resolving errors in newsfragment, and tests
* Patch errrors related to test cases
* removed errors from test_statsd and test_apiserver
* removed default args for statsd
* added configs in default and removed overridden confugs
* removed defaults for statsd
* removed default args to resolve the test
* removed syntax error
* Added values in render_chart
* removed unnecessary issues
* helm unit test
* Moved args into else block
* Revusuted statsd args and made changes
* solved resources error
* Changed JSON for values schema
* resolved error in the statsd tests
* updated the deployment and values.yaml
* resolving ci formatting issues
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* Update chart/newsfragments/51792.significant.rst
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
* restructured cache options in statsd
* fixing indentation in deployment.yaml
* fix: updated newsfragment file and fixed CI static check
* updated the indentations in values and statsd deployment
* reverted the apiserver changes
* changed the formatting
* Remove TTL parameter from command line and add into the defaults part of config map
---------
Co-authored-by: shubham36deshpande <shubham36deshpande@gmail.com>
Co-authored-by: shubham36deshpande <116251650+shubham36deshpande@users.noreply.github.com>
Co-authored-by: Przemysław Mirowski <miretpl@gmail.com>
Co-authored-by: AutomationDev85 <AutomationDev85>
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chartAirflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@AutomationDev85@jscheffl@shubham36deshpande