Skip to content

Move ZeppelinContext code to Scala - #139

Closed
doanduyhai wants to merge 13 commits into
apache:masterfrom
doanduyhai:Scala_ZeppelinContext
Closed

Move ZeppelinContext code to Scala#139
doanduyhai wants to merge 13 commits into
apache:masterfrom
doanduyhai:Scala_ZeppelinContext

Conversation

@doanduyhai

Copy link
Copy Markdown
Contributor

This is the follow up of #80

Warning: this PR should be merged before https://issues.apache.org/jira/browse/ZEPPELIN-148

The source code of ZeppelinContext has been converted to Scala to make the integration easier.

Now it is possible to do:

z.show(rdd)
z.display(rdd,"Header1","Header2",...)
z.display(rdd, limit, "Header1","Header2",...)
z.html(...)
z.img(...)
z.img64(...)

Of course, all the implicits developed in the previous pull request are also back-ported

I also added unit tests to have a decent code coverage

Example of z.display() with limit manually set to 2:

image

Example of z.display() using default limit (zeppelin.spark.maxResult = 100):

image

Example of calling display() directly on RDD with limit set to 3:

image

Example of calling display() directly on a Scala traversable:

image

Example of calling html():

image

We can also call z.html() on the ZeppelinContext instance itself:

image

Example of calling img(url):

image

Of course, calling z.img(url) is also possible. The same remarks also apply to img64(...) and z.img64(...)

Last but not least, z.show(...) has been refactored to display SchemaRDD/DataFrame

image

@doanduyhai
doanduyhaiforce-pushed the Scala_ZeppelinContext branch 2 times, most recently from 137b198 to f6e5e7bCompareJuly 3, 2015 22:11
@doanduyhai
doanduyhaiforce-pushed the Scala_ZeppelinContext branch 2 times, most recently from 5bd3c52 to fb97233CompareAugust 4, 2015 18:08
Comment threadspark/pom.xml Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please fix this incorrect indentation.

@doanduyhai
doanduyhaiforce-pushed the Scala_ZeppelinContext branch from dc840ac to 91cd286CompareAugust 5, 2015 14:03
@doanduyhai
doanduyhaiforce-pushed the Scala_ZeppelinContext branch 5 times, most recently from 9325125 to 06a50baCompareAugust 6, 2015 14:20
@corneadoug

Copy link
Copy Markdown
Contributor

@doanduyhai
I'm going around old PRs,
What should we do about that one?

@asfgitasfgit closed this in c38a0a0May 9, 2018
asfgit pushed a commit that referenced this pull request May 9, 2018
close#83close#86close#125close#133close#139close#146close#193close#203close#246close#262close#264close#273close#291close#299close#320close#347close#389close#413close#423close#543close#560close#658close#670close#728close#765close#777close#782close#783close#812close#822close#841close#843close#878close#884close#918close#989close#1076close#1135close#1187close#1231close#1304close#1316close#1361close#1385close#1390close#1414close#1422close#1425close#1447close#1458close#1466close#1485close#1492close#1495close#1497close#1536close#1545close#1561close#1577close#1600close#1603close#1678close#1695close#1739close#1748close#1765close#1767close#1776close#1783close#1799
ajgoade pushed a commit to ajgoade/zeppelin that referenced this pull request Jun 10, 2021
MZEP-182 Install git package in DSR images
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@doanduyhai@corneadoug@jongyoul