Uh oh!
There was an error while loading. Please reload this page.
[SPARK-6227][MLLIB][PYSPARK] Implement PySpark wrappers for SVD and PCA (v2) - #17621
[SPARK-6227][MLLIB][PYSPARK] Implement PySpark wrappers for SVD and PCA (v2)#17621MLnick wants to merge 14 commits into
Conversation
MLnick
commented
Apr 12, 2017
Based on @MechCoder's work in #7963. |
SparkQA
commented
Apr 12, 2017
Test build #75741 has finished for PR 17621 at commit
|
SparkQA
commented
Apr 12, 2017
Test build #75742 has finished for PR 17621 at commit
|
SparkQA
commented
Apr 12, 2017
Test build #75743 has finished for PR 17621 at commit
|
SparkQA
commented
Apr 12, 2017
Test build #75744 has finished for PR 17621 at commit
|
holdenk
commented
Apr 12, 2017
Thanks for reviving this @MLnick :) |
dusenberrymw
left a comment
There was a problem hiding this comment.
Yeah, great to see this being finished up, @MLnick. LGTM.
MechCoder
commented
Apr 14, 2017
Thanks @MLnick ! |
SparkQA
commented
Apr 24, 2017
Test build #76101 has finished for PR 17621 at commit
|
SparkQA
commented
Apr 24, 2017
Test build #76102 has finished for PR 17621 at commit
|
MLnick
commented
Apr 24, 2017
If no further comments I'll merge this into branch-2.2 within a few days. |
MLnick
commented
May 2, 2017
Jenkins retest this please |
SparkQA
commented
May 2, 2017
Test build #76377 has finished for PR 17621 at commit
|
holdenk
commented
May 2, 2017
LGTM |
…CA (v2) Add PCA and SVD to PySpark's wrappers for `RowMatrix` and `IndexedRowMatrix` (SVD only). Based on #7963, updated. ## How was this patch tested? New doc tests and unit tests. Ran all examples locally. Author: MechCoder <manojkumarsivaraj334@gmail.com> Author: Nick Pentreath <nickp@za.ibm.com> Closes#17621 from MLnick/SPARK-6227-pyspark-svd-pca. (cherry picked from commit db2fb84) Signed-off-by: Nick Pentreath <nickp@za.ibm.com>
MLnick
commented
May 3, 2017
Merged to master/branch-2.2. Thanks again for the original work @MechCoder! |
SixAlien3
commented
Jun 22, 2017
@MLnick Hi, I'm interesting in this PySpark wrapper for SVD. How many columns can this support? Cuz I see in the old document it can only support columns <1000. How about this wrapper? |
Add PCA and SVD to PySpark's wrappers for
RowMatrixandIndexedRowMatrix(SVD only).Based on #7963, updated.
How was this patch tested?
New doc tests and unit tests. Ran all examples locally.