Skip to content

[SPARK-13015][MLlib][DOC] Replace example code in mllib-data-types.md using include_example - #14006

Closed
yinxusen wants to merge 12 commits into
apache:masterfrom
yinxusen:SPARK-13015-consolidate
Closed

[SPARK-13015][MLlib][DOC] Replace example code in mllib-data-types.md using include_example#14006
yinxusen wants to merge 12 commits into
apache:masterfrom
yinxusen:SPARK-13015-consolidate

Conversation

@yinxusen

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

  1. Add more specific error prompt for include_example.rb
  2. Replace example code in mllib-data-types.md using include_example

For Scala/Python code, I add imports inside each function, which is easy to control those codes. Java import doesn't support that, so I leave them with duplications.

BTW The tallSkinnyQR in both Scala and Java failed when I ran the code. I'll look into them soon.

How was this patch tested?

Tested manually by running new example code, and generating docs with jekyll build.

@SparkQA

Copy link
Copy Markdown

Test build #61580 has finished for PR 14006 at commit 51018c9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yinxusen

Copy link
Copy Markdown
ContributorAuthor

@liancheng@mengxr

Comment threaddocs/_plugins/include_example.rb Outdated
.map { |l, i| i }

raise "Start indices amount is not equal to end indices amount, see #{@file}." \
raise "Start indices amount is not equal to end indices amount, see #{@file}, #{@snippet_label}." \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd prefer

... see #{@file} [labeled=#{@snippet_label}].

Otherwise the label itself might be mistaken for a file path.

@SparkQA

Copy link
Copy Markdown

Test build #61601 has finished for PR 14006 at commit 176a240.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA

Copy link
Copy Markdown

Test build #61703 has finished for PR 14006 at commit 47c7b16.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA

Copy link
Copy Markdown

Test build #61994 has finished for PR 14006 at commit c28fdb8.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yinxusen

Copy link
Copy Markdown
ContributorAuthor

@mengxr

@holdenk

Copy link
Copy Markdown
Contributor

Hi @yinxusen thanks for working on this - can you update it against the latest master? I'm all for switching our examples to be more include based and the improved error messages during doc builds for invalid includes seems helpful for developers :)

@yinxusen

Copy link
Copy Markdown
ContributorAuthor

@holdenk I'll update a version ASAP

@SparkQA

Copy link
Copy Markdown

Test build #66533 has finished for PR 14006 at commit 265a62f.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@maropumaropu mentioned this pull request Apr 23, 2017
peter-toth pushed a commit to peter-toth/spark that referenced this pull request Oct 6, 2018
This pr proposed to close stale PRs. Currently, we have 400+ open PRs and there are some stale PRs whose JIRA tickets have been already closed and whose JIRA tickets does not exist (also, they seem not to be minor issues).
// Open PRs whose JIRA tickets have been already closed
Closesapache#11785Closesapache#13027Closesapache#13614Closesapache#13761Closesapache#15197Closesapache#14006Closesapache#12576Closesapache#15447Closesapache#13259Closesapache#15616Closesapache#14473Closesapache#16638Closesapache#16146Closesapache#17269Closesapache#17313Closesapache#17418Closesapache#17485Closesapache#17551Closesapache#17463Closesapache#17625
// Open PRs whose JIRA tickets does not exist and they are not minor issues
Closesapache#10739Closesapache#15193Closesapache#15344Closesapache#14804Closesapache#16993Closesapache#17040Closesapache#15180Closesapache#17238
N/A
Author: Takeshi Yamamuro <yamamuro@apache.org>
Closesapache#17734 from maropu/resolved_pr.
Change-Id: Id2e590aa7283fe5ac01424d30a40df06da6098b5
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
## What changes were proposed in this pull request?
This pr proposed to close stale PRs. Currently, we have 400+ open PRs and there are some stale PRs whose JIRA tickets have been already closed and whose JIRA tickets does not exist (also, they seem not to be minor issues).
// Open PRs whose JIRA tickets have been already closed
Closesapache#11785Closesapache#13027Closesapache#13614Closesapache#13761Closesapache#15197Closesapache#14006Closesapache#12576Closesapache#15447Closesapache#13259Closesapache#15616Closesapache#14473Closesapache#16638Closesapache#16146Closesapache#17269Closesapache#17313Closesapache#17418Closesapache#17485Closesapache#17551Closesapache#17463Closesapache#17625
// Open PRs whose JIRA tickets does not exist and they are not minor issues
Closesapache#10739Closesapache#15193Closesapache#15344Closesapache#14804Closesapache#16993Closesapache#17040Closesapache#15180Closesapache#17238
## How was this patch tested?
N/A
Author: Takeshi Yamamuro <yamamuro@apache.org>
Closesapache#17734 from maropu/resolved_pr.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@yinxusen@SparkQA@holdenk@liancheng