Skip to content

Pull requests: apache/spark

New pull requestNew
409 Open 56,936 Closed
409 Open 56,936 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Assigned to nobodyLoading
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

[SPARK-58586][DOCS] Use a supported Python version in the RDD guide PYSPARK_PYTHON example
#57787 opened Aug 5, 2026 by uros-bMemberLoading…
[SPARK-58585][SQL] Extract a helper for INVALID_EXTERNAL_VALUE errors in CatalystTypeConverters
#57786 opened Aug 5, 2026 by uros-bMemberLoading…
[SPARK-58582][PS] Use native Spark function for NumPy fmod
#57784 opened Aug 5, 2026 by zhengruifengContributorLoading…
[SPARK-58581][PS] Use native Spark function for NumPy floor_divide
#57783 opened Aug 5, 2026 by zhengruifengContributorLoading…
[SPARK-58583][ML] Construct squared Euclidean silhouette stats on executors
#57782 opened Aug 5, 2026 by zhengruifengContributorLoading…
[WIP][PYTHON] Optimize PySpark broadcast serialization with Arrow
#57781 opened Aug 5, 2026 by zhengruifengContributor • Draft
fix: upgrade com.squareup.okhttp3:okhttp to 4.9.2 (CVE-2021-0341)
#57779 opened Aug 5, 2026 by anupammeLoading…
3
[SPARK-57785][SQL][CONNECT] harden: spark connect client's reattachment mechanism a... in...
#57778 opened Aug 5, 2026 by anupammeLoading…
3
[SPARK-58576][PYTHON][TESTS] Add tests for pa.Array.to_pandas with integer_object_nulls
#57774 opened Aug 4, 2026 by SpenserrrrContributorLoading…
4
[SPARK-58545][PYTHON][TEST] Add tests for pa.Array.to_pandas with types_mapper
#57771 opened Aug 4, 2026 by SpenserrrrContributorLoading…
1
[SPARK-58573][INFRA][BUILD] Replace defunct Jenkins test grouping with modern GitHub Actions grouping
#57770 opened Aug 4, 2026 by nchammasContributorLoading…
1
[SPARK-58518][SQL] Do not duplicate input paths when globbing is disabled
#57769 opened Aug 4, 2026 by JoorgemLoading…
1
[SPARK-57370][SQL][FOLLOWUP] Route codegen referencing an unnameable class to Janino when narrowing is unsound
#57768 opened Aug 4, 2026 by LuciferYangContributorLoading…
1
[SPARK-58562][SQL][DOCS] Document subplan merging in the SQL performance tuning guide
#57765 opened Aug 4, 2026 by peter-tothContributorLoading…
4
[SPARK-58561][INFRA] Support backporting a PR merged into a non-default branch
#57764 opened Aug 4, 2026 by uros-bMemberLoading…
20
[SPARK-58559][PYTHON] Package all of sbin in PySpark classic distribution
#57763 opened Aug 4, 2026 by nchammasContributorLoading…
3
[SPARK-58558][SQL] Make requireAllClusterKeysForCoPartition check key coverage instead of exact match for SPJ
#57762 opened Aug 4, 2026 by pan3793MemberLoading…
20
[WIP][ML] Avoid duplicate StringIndexer skip lookups
#57761 opened Aug 4, 2026 by zhengruifengContributor • Draft
[SPARK-58207][SQL][FOLLOWUP] Skip runtime filter pushdown for nondeterministic filters
#57760 opened Aug 4, 2026 by peter-tothContributorLoading…
2
[SPARK-49828][SQL] Make Column(expression) usable outside of the org.apache.spark package
#57759 opened Aug 4, 2026 by peter-tothContributorLoading…
8
[WIP][MLLIB] Rewrite CountVectorizer fitting with DataFrame APIs
#57755 opened Aug 4, 2026 by zhengruifengContributor • Draft
[SPARK-58556][CONNECT][UI] Show ML cache status in Spark Connect UI
#57754 opened Aug 4, 2026 by zhengruifengContributor • Draft
2
[SPARK-58549][SQL] Preserve key-grouped partitioning and ordering across a DSv2 scan merge
#57753 opened Aug 4, 2026 by peter-tothContributorLoading…
10
[SPARK-58551][PYTHON] Python Data Sources Limit Pushdown API
#57752 opened Aug 4, 2026 by ganeshashreeContributorLoading…
4
[SPARK-58552][SQL][UI] Add total task time column to the SQL / DataFrame tab
#57751 opened Aug 4, 2026 by ulysses-youContributorLoading…
5
ProTip! Mix and match filters to narrow down what you’re looking for.