Skip to content

Downgrade aws-smithy-runtime, update rust_decimal, ignore RUSTSEC-2026-0001 to get clean CI - #19657

Merged
alamb merged 6 commits into
apache:mainfrom
alamb:alamb/downgrade_aws-smithy
Jan 6, 2026
Merged

Downgrade aws-smithy-runtime, update rust_decimal, ignore RUSTSEC-2026-0001 to get clean CI#19657
alamb merged 6 commits into
apache:mainfrom
alamb:alamb/downgrade_aws-smithy

Conversation

@alamb

@alambalamb commented Jan 5, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

CI is failing I think because aws-smithy-runtime was yanked

What changes are included in this PR?

ran cargo update for this crate and then checked in the results:

andrewlamb@Andrews-MacBook-Pro-3:~/Software/datafusion$ cargo update -p aws-smithy-runtime
Updating crates.io index
Locking 1 package to latest compatible version
Downgrading aws-smithy-runtime v1.9.6 -> v1.9.5
note: pass `--verbose` to see 149 unchanged dependencies behind latest

Are these changes tested?

I tested locally

cargo audit

Are there any user-facing changes?

No this is a developmnt process only

@alambalamb changed the title Downgrade aws-smithy-runtime to avoid rustsecDowngrade aws-smithy-runtime, update rust_decimal to avoid rustsec errorsJan 5, 2026
@alamb

alamb commented Jan 5, 2026

Copy link
Copy Markdown
ContributorAuthor

Looks like there is something wrong with rkyv as well

@alamb

alamb commented Jan 5, 2026

Copy link
Copy Markdown
ContributorAuthor

I am going to be lazy and wait to see if someone upstream hits the same issue and hopefully we get a fix out

@Omega359

Omega359 commented Jan 5, 2026

Copy link
Copy Markdown
Contributor

fwiw the rust_decimal team seems to be waiting on a backport of the fix for rkyv - paupino/rust-decimal#767 (comment)

@Jefffrey

Jefffrey commented Jan 6, 2026

Copy link
Copy Markdown
Contributor

Looks like rkyv released a backport 0.7.46 with the fix (I assume? I can't find changelog notes)

Though the advisory db still requires >= 0.8.13 so might need to wait on that

@github-actionsgithub-actionsBot added the sqllogictest SQL Logic Tests (.slt) label Jan 6, 2026
@alamb

alamb commented Jan 6, 2026

Copy link
Copy Markdown
ContributorAuthor

Looks like there is progress being made on the upstream issue

In the interim, I'll add a ignore to the file to get CI passing cleanly again and I have an AI trying to remove the rust_decimal dependency

@github-actionsgithub-actionsBot added the development-process Related to development process of DataFusion label Jan 6, 2026
@alamb
alamb marked this pull request as ready for review January 6, 2026 12:29
@alambalamb changed the title Downgrade aws-smithy-runtime, update rust_decimal to avoid rustsec errorsDowngrade aws-smithy-runtime, update rust_decimal, ignore RUSTSEC-2026-0001 to get clean CIJan 6, 2026
@alamb

alamb commented Jan 6, 2026

Copy link
Copy Markdown
ContributorAuthor

Merging this to get the CI clean

@alamb
alamb added this pull request to the merge queueJan 6, 2026
Merged via the queue into apache:main with commit c3e1c36Jan 6, 2026
32 checks passed
@alamb

alamb commented Jan 6, 2026

Copy link
Copy Markdown
ContributorAuthor

Here is my proposal to remove the dependnecy (and the --ignore)

github-merge-queueBot pushed a commit that referenced this pull request Jan 7, 2026
…001` (#19666)
## Which issue does this PR close?
- Part of #19656
## Rationale for this change
rust_decimal is a one person crate and is released somewhat infrequently
* https://github.com/paupino/rust-decimal
* https://crates.io/crates/rust_decimal
It also uses a non trivial number of dependencies, including
https://crates.io/crates/rkyv, some sort of zero copy deserialization
framework that was recently subject to a RUSTSEC security advisory, see
#19656 /
#19657
Since `rust_decimal` is only used for sqllogictests to parse the results
from postgres, we can pretty easily remove the dependency on
`rust_decimal` and inline the very small amount functionality we need
for sqllogictests
This will both decrease the build time and our dependency trail.
## What changes are included in this PR?
Removes the `rust_decimal` dependency from DataFusion
and inlines the smallest required subset of decimal functionality we
need for
sqllogictests (which turns out to be pretty small)
## Are these changes tested?
Yes by CI
## Are there any user-facing changes?
No, this is all internal testing infrastructure
alamb added a commit to alamb/datafusion that referenced this pull request Jan 7, 2026
…001` (apache#19666)
- Part of apache#19656
rust_decimal is a one person crate and is released somewhat infrequently
* https://github.com/paupino/rust-decimal
* https://crates.io/crates/rust_decimal
It also uses a non trivial number of dependencies, including
https://crates.io/crates/rkyv, some sort of zero copy deserialization
framework that was recently subject to a RUSTSEC security advisory, see
apache#19656 /
apache#19657
Since `rust_decimal` is only used for sqllogictests to parse the results
from postgres, we can pretty easily remove the dependency on
`rust_decimal` and inline the very small amount functionality we need
for sqllogictests
This will both decrease the build time and our dependency trail.
Removes the `rust_decimal` dependency from DataFusion
and inlines the smallest required subset of decimal functionality we
need for
sqllogictests (which turns out to be pretty small)
Yes by CI
No, this is all internal testing infrastructure
de-bgunter pushed a commit to de-bgunter/datafusion that referenced this pull request Mar 24, 2026
…001` (apache#19666)
## Which issue does this PR close?
- Part of apache#19656
## Rationale for this change
rust_decimal is a one person crate and is released somewhat infrequently
* https://github.com/paupino/rust-decimal
* https://crates.io/crates/rust_decimal
It also uses a non trivial number of dependencies, including
https://crates.io/crates/rkyv, some sort of zero copy deserialization
framework that was recently subject to a RUSTSEC security advisory, see
apache#19656 /
apache#19657
Since `rust_decimal` is only used for sqllogictests to parse the results
from postgres, we can pretty easily remove the dependency on
`rust_decimal` and inline the very small amount functionality we need
for sqllogictests
This will both decrease the build time and our dependency trail.
## What changes are included in this PR?
Removes the `rust_decimal` dependency from DataFusion
and inlines the smallest required subset of decimal functionality we
need for
sqllogictests (which turns out to be pretty small)
## Are these changes tested?
Yes by CI
## Are there any user-facing changes?
No, this is all internal testing infrastructure
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-processRelated to development process of DataFusionsqllogictestSQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

cargo audit failing on DataFusion main

3 participants

@alamb@Omega359@Jefffrey