Skip to content

[ZEPPELIN-1015] Cron job fails to run a paragraph when multiple type of interpreter is being used - #1019

Closed
Leemoonsoo wants to merge 2 commits into
apache:masterfrom
Leemoonsoo:ZEPPELIN-1015
Closed

[ZEPPELIN-1015] Cron job fails to run a paragraph when multiple type of interpreter is being used#1019
Leemoonsoo wants to merge 2 commits into
apache:masterfrom
Leemoonsoo:ZEPPELIN-1015

Conversation

@Leemoonsoo

Copy link
Copy Markdown
Member

What is this PR for?

Cron job can fail when notebook uses multiple types of paragraphs.
Problem reported here http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Cron-job-fails-to-run-a-paragraph-that-runs-correctly-manually-tt2265.html

What type of PR is it?

Bug Fix

Todos

  • - Fix
  • - Unittest

What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-1015

How should this be tested?

Create two paragraphs in the notebook
First takes longer than second (last) paragraph.
First paragraph and second paragraph should use different interpreter.

If cron schedule the notebook with 'auto-restart interpreter on cron execution' checked.
Then interpreters will be restarted when second paragraph finished, but first paragraph is still running.
That may cause abort of first paragraph run.

Questions:

  • Does the licenses files need update? no
  • Is there breaking changes for older versions? no
  • Does this needs documentation? no

@felixcheung

Copy link
Copy Markdown
Member

LGTM

1 similar comment
@cloverhearts

Copy link
Copy Markdown
Member

LGTM

@Leemoonsoo

Copy link
Copy Markdown
MemberAuthor

Rebased to resolve conflicts to master.
Thanks @felixcheung and @cloverhearts for review.
Merge if there're no more discussions.

@jmrr

jmrr commented Jun 17, 2016

Copy link
Copy Markdown

LGTM too, thanks @Leemoonsoo I've also tried with same interpreter and also works

@Leemoonsoo

Copy link
Copy Markdown
MemberAuthor

@jmrr Thanks for verifying!

asfgit pushed a commit that referenced this pull request Jun 18, 2016
…of interpreter is being used
### What is this PR for?
Cron job can fail when notebook uses multiple types of paragraphs.
Problem reported here http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Cron-job-fails-to-run-a-paragraph-that-runs-correctly-manually-tt2265.html
### What type of PR is it?
Bug Fix
### Todos
* [x] - Fix
* [x] - Unittest
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1015
### How should this be tested?
Create two paragraphs in the notebook
First takes longer than second (last) paragraph.
First paragraph and second paragraph should use different interpreter.
If cron schedule the notebook with 'auto-restart interpreter on cron execution' checked.
Then interpreters will be restarted when second paragraph finished, but first paragraph is still running.
That may cause abort of first paragraph run.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Lee moon soo <moon@apache.org>
Closes#1019 from Leemoonsoo/ZEPPELIN-1015 and squashes the following commits:
ccee60a [Lee moon soo] update unittest
9ad4cbb [Lee moon soo] Fix problem by waiting all paragraphs in note be finished
(cherry picked from commit c934b3a)
Signed-off-by: Lee moon soo <moon@apache.org>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@Leemoonsoo@felixcheung@cloverhearts@jmrr