Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 - #3

Merged
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber
Dec 10, 2025
Merged

Feature tonumber : issue #4514 tonumber function as part of roadmap #4287 #3
asifabashar merged 103 commits into
feature_tonumber_2from
feature_tonumber

Conversation

@asifabashar

Copy link
Copy Markdown
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

asifabasharand others added 30 commits October 19, 2025 06:14
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
… default duration is in seconds which will be used for duration format , added cast call for tostring with 1 argument
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Co-authored-by: ritvibhatt <53196324+ritvibhatt@users.noreply.github.com>
Signed-off-by: Asif Bashar <abashar@apple.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
xinyualand others added 29 commits December 9, 2025 21:34
* fix anoymizer for search command
Signed-off-by: xinyual <xinyual@amazon.com>
* pushdown match when only one equal in search command
Signed-off-by: xinyual <xinyual@amazon.com>
* fix regex case
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT
Signed-off-by: xinyual <xinyual@amazon.com>
* revert match change
Signed-off-by: xinyual <xinyual@amazon.com>
* fix UT by ignore the expression
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* remove useless change and resolve comment
Signed-off-by: xinyual <xinyual@amazon.com>
* add test cases for metadata and timestamp identifier
Signed-off-by: xinyual <xinyual@amazon.com>
* change name
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…pensearch-project#4843)
* Remove redundant push-down-filters derived for bucket-non-null aggregation
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Address comment
Signed-off-by: Heng Qian <qianheng@amazon.com>
* Fix name typo
Signed-off-by: Heng Qian <qianheng@amazon.com>
---------
Signed-off-by: Heng Qian <qianheng@amazon.com>
… are different (opensearch-project#4850)
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Support eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Updates
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* update javadoc
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to use ARRAY_DISTINCT
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
…oject#4837)
* Change like function to case-sensitive and add ilike for case-insensitive
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change plan in clickbench
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix UT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Update syntax: like(string, PATTERN[, case_sensitive])
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert import merging
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* support like(string, PATTERN, bool) in v2
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* dedup ut
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
…project#4831)
* add bucket_nullable for streamstats
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* little change
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix IT, UT and doc
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* change bucketNullable getOrDefault to get
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
* fix error
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
---------
Signed-off-by: Xinyu Hao <haoxinyu@amazon.com>
…arch-project#4784)
* Support param timefield to specify span field in timechart
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update doc to introduce timefield parameter
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Update ASTBuilderTest for chart: default args are handled in rel node visitor
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix ast expression builder test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Fix anomanyzer test
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Support using specified timefield in per functions
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Omit by-timestamp clause in timechart command
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Mask timefield argument in anonymizer
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
* Anonymize argument span
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
---------
Signed-off-by: Yuanchun Shen <yuanchu@amazon.com>
…4844)
* Enable dedup pushdown
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix doctest
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Disable dedup expr
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix yaml test
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* add more comments in code
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix conflicts
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Address comments
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* change q43
Signed-off-by: xinyual <xinyual@amazon.com>
* change plan after merging latest code
Signed-off-by: xinyual <xinyual@amazon.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
…roject#4877)
* Remove unnecessary filter for DataHistogram aggregation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes of interval selection in DataHistogram
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert one it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add review instructions for CodeRabbit
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
* Disable auto review
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
---------
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
…PL (opensearch-project#4841)
* [BugFix] Fix Regex OOM when there are 10+ regex clauses
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix unit tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix tests
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests and corresponding commands
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix explain tests for testFilterPushDownExplain
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* peng - isolate the fix logic to its own visitor class
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* Directly apply Calcite CoreRules.FILTER_MERGE before VolcanoPlanner plan
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the UTs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix the ITs after rebase
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* fix clickbench IT and more ITs
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* address comments from peng
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
* add yaml test
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
---------
Signed-off-by: Jialiang Liang <jiallian@amazon.com>
Co-authored-by: Peng Huo <penghuo@gmail.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
)
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Support composite aggregation paginating in HAVING clause
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* typo
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix doctest and IT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* secruity it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* revert changes in OpenSearchIndexScan
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix compile error
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Fix v2 paginationIT
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* optimize request total size in compoisite agg
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* fix it
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Refactor
Signed-off-by: Lantao Jin <ltjin@amazon.com>
---------
Signed-off-by: Lantao Jin <ltjin@amazon.com>
* Add basic transpiler impl
Signed-off-by: Chen Dai <daichen@amazon.com>
* Add builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Use lombok builder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Modify unified query planner UT to extend new test base class
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc with API design caveat
Signed-off-by: Chen Dai <daichen@amazon.com>
* Move opensearch spark sql dialect out of test folder
Signed-off-by: Chen Dai <daichen@amazon.com>
* Update doc and test assertion message
Signed-off-by: Chen Dai <daichen@amazon.com>
* Fix line separator and license header
Signed-off-by: Chen Dai <daichen@amazon.com>
---------
Signed-off-by: Chen Dai <daichen@amazon.com>
* Support split eval function
Signed-off-by: Kai Huang <ahkcs@amazon.com>
# Conflicts:
#	core/src/main/java/org/opensearch/sql/expression/function/BuiltinFunctionName.java
#	integ-test/src/test/java/org/opensearch/sql/calcite/remote/CalciteArrayFunctionIT.java
#	ppl/src/main/antlr/OpenSearchPPLLexer.g4
#	ppl/src/main/antlr/OpenSearchPPLParser.g4
#	ppl/src/test/java/org/opensearch/sql/ppl/calcite/CalcitePPLArrayFunctionTest.java
#	ppl/src/test/java/org/opensearch/sql/ppl/utils/PPLQueryDataAnonymizerTest.java
* doctest
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update test cases
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Update to not use UDF
Signed-off-by: Kai Huang <ahkcs@amazon.com>
---------
Signed-off-by: Kai Huang <ahkcs@amazon.com>
* Add workflow for SQL CLI integration tests
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Switch SQL checkout path for CLI
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Tweak paths and mkdir for remote
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Fix filename
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Remove redundant verification
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
* Don't pull after clone
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
---------
Signed-off-by: Simeon Widdis <sawiddis@amazon.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
Signed-off-by: Asif Bashar <asif.bashar@gmail.com>
@asifabashar
asifabashar merged commit ecb63ea into feature_tonumber_2Dec 10, 2025
31 of 32 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

15 participants

@asifabashar@LantaoJin@yuancu@aalva500-prog@RyanL1997@ykmr1224@ahkcs@xinyual@ishaoxy@songkant-aws@Swiddis@qianheng-aws@ritvibhatt@dai-chen@kylehounslow