Skip to content

minor: Remove deprecated methods - #9627

Merged
comphead merged 4 commits into
apache:mainfrom
comphead:dev0
Mar 18, 2024
Merged

minor: Remove deprecated methods#9627
comphead merged 4 commits into
apache:mainfrom
comphead:dev0

Conversation

@comphead

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Closes #.

Rationale for this change

Some code can be removed from DF codebase as its deprecated long time ago

What changes are included in this PR?

Remove deprecated code up to DF 30.0.0 and fixed tests

Are these changes tested?

Yes

Are there any user-facing changes?

@github-actionsgithub-actionsBot added logical-expr Logical plan and expressions core Core DataFusion crate labels Mar 15, 2024

#[test]
#[allow(deprecated)]
#[ignore = "investigate if this test is needed"]

@compheadcompheadMar 15, 2024

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The method which supposed to replace deprecated one is failing this test, investigating if this test makes sense any more

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked at this test and I think it should just be removed (as it is testing a behavior that was removed). The new behavior is covered by

#[test]fn normalize_cols(){

Right above it

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I pushed a commit to remove the test to your branch

@alambalamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @comphead -- this has been needed for a long time


#[test]
#[allow(deprecated)]
#[ignore = "investigate if this test is needed"]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked at this test and I think it should just be removed (as it is testing a behavior that was removed). The new behavior is covered by

#[test]fn normalize_cols(){

Right above it


#[test]
#[allow(deprecated)]
#[ignore = "investigate if this test is needed"]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I pushed a commit to remove the test to your branch

@alambalamb changed the title minor: Remove deprecated codeminor: Remove deprecated methodsMar 16, 2024
@comphead
comphead merged commit 4687a2f into apache:mainMar 18, 2024
Michael-J-Ward added a commit to Michael-J-Ward/datafusion-python that referenced this pull request May 1, 2024
The suggested replacement `Session::catalog` is already included.
Ref: apache/datafusion#9627
Michael-J-Ward added a commit to Michael-J-Ward/datafusion-python that referenced this pull request May 8, 2024
The method was removed upstream but is used in many tests for `datafusion-python`.
Ref: apache/datafusion#9627
andygrove pushed a commit to apache/datafusion-python that referenced this pull request May 8, 2024
* deps: upgrade datafusion to 37.1.0
* feat: re-implement SessionContext::tables
The method was removed upstream but is used in many tests for `datafusion-python`.
Ref: apache/datafusion#9627
* feat: upgrade dataframe write_parquet and write_json
The options to write_parquet changed.
write_json has a new argument that I defaulted to None. We can expose that config later.
Ref: apache/datafusion#9382
* feat: impl new ExecutionPlanProperties for DatasetExec
Ref: apache/datafusion#9346
* feat: add upstream variant and method params
- `WindowFunction` and `AggregateFunction` have `null_treatment` options.
- `ScalarValue` and `DataType` have new variants
- `SchemaProvider::table` now returns a `Result`
* lint: allow(deprecated) for make_scalar_function
* feat: migrate functions.rs
`datafusion` completed an Epic that ported many of the `BuiltInFunctions` enum to `SclarUDF`.
I created new macros to simplify the port, and used these macros to refactor a few existing functions.
Ref: apache/datafusion#9285
* fixme: commented out last failing test
This is a bug upstream in datafusion
FAILED datafusion/tests/test_functions.py::test_array_functions - pyo3_runtime.PanicException: range end index 9 out of range for slice of length 8
* chore: update Cargo.toml package info
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

coreCore DataFusion cratelogical-exprLogical plan and expressions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@comphead@alamb