Uh oh!
There was an error while loading. Please reload this page.
[SPARK-16028][SPARKR] spark.lapply can work with active context - #13752
Closed
felixcheung wants to merge 3 commits into
Closed
[SPARK-16028][SPARKR] spark.lapply can work with active context#13752felixcheung wants to merge 3 commits into
felixcheung wants to merge 3 commits into
Conversation
felixcheung
commented
Jun 18, 2016
MemberAuthor
example update in the other PR. |
SparkQA
commented
Jun 18, 2016
Test build #60755 has finished for PR 13752 at commit
|
SparkQA
commented
Jun 18, 2016
Test build #60763 has finished for PR 13752 at commit
|
| #' @examples | ||
| #'\dontrun{ | ||
| #' sc <- sparkR.init() | ||
| #' doubled <- spark.lapply(sc, 1:10, function(x){2 * x}) |
Contributor
There was a problem hiding this comment.
can we put in sparkR.session() here to show that we need to do some initialization ?
shivaram
commented
Jun 20, 2016
Contributor
LGTM. Minor comment about docs |
felixcheung
commented
Jun 20, 2016
MemberAuthor
Updated. thx |
shivaram
commented
Jun 20, 2016
Contributor
Thanks - merging this to master and branch-2.0 after jenkins passes |
vectorijk added a commit
to vectorijk/spark
that referenced
this pull request
Jun 20, 2016
SparkQA
commented
Jun 20, 2016
Test build #60858 has finished for PR 13752 at commit
|
asfgit pushed a commit
that referenced
this pull request
Jun 20, 2016
## What changes were proposed in this pull request? spark.lapply and setLogLevel ## How was this patch tested? unit test shivaram thunterdb Author: Felix Cheung <felixcheung_m@hotmail.com> Closes#13752 from felixcheung/rlapply. (cherry picked from commit 46d98e0) Signed-off-by: Shivaram Venkataraman <shivaram@cs.berkeley.edu>
sun-rui
commented
Jun 21, 2016
Contributor
I think spark.lapply() is a case that demonstrates the need for supporting Dataset in SparkR. Removing the explicit sc parameter is quite helpful to moving to Dataset internally in the future if Dataset is to be supported |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
spark.lapply and setLogLevel
How was this patch tested?
unit test
@shivaram@thunterdb