Skip to content

adding test to check all notebooks. - #196

Draft
seanebum wants to merge 18 commits into
developfrom
auto-nb-runner
Draft

adding test to check all notebooks. #196
seanebum wants to merge 18 commits into
developfrom
auto-nb-runner

Conversation

@seanebum

Copy link
Copy Markdown
Contributor

test is currently implemented in same testing instance as test_model and test_solver, however it takes a very long time to run. A timeout is given to each cell of 10 minutes, and cells that exceed this timeout report erroneous and will cause the test to fail. This is a naive implementation which will execute all notebooks contained in the examples directory, and may need to be modified to operate on or be able to select a minimal set of notebooks which meet a stricter runtime criteria. Additionally, it may be worth separating these tests to be executed by a different action to prevent unwanted failures from notebooks causing the main testing routine to fail. This PR closes#181

…d in same testing instance as test_model and test_solver, however it takes a very long time to run. A timeout is given to each cell of 10 minutes, and cells that exceed this timeout report erroneous and will cause the test to fail. This is a naive implementation which will execute all notebooks contained in the examples directory, and may need to be modified to operate on or be able to select a minimal set of notebooks which meet a stricter runtime criteria. Additionally, it may be worth separating these tests to be executed by a different action to prevent unwanted failures from notebooks causing the main testing routine to fail.
@seanebumseanebum added the enhancement New feature or request label Oct 26, 2021
@seanebumseanebum added this to the 1.0 Release milestone Oct 26, 2021
@seanebum
seanebum marked this pull request as draft October 26, 2021 19:06
@seanebumseanebum changed the title adding unit test to check all notebooks. adding test to check all notebooks. Mar 9, 2022
@seanebum
seanebum marked this pull request as ready for review March 9, 2022 16:41
@briandrawertbriandrawert removed this from the 1.1 Release milestone Mar 14, 2022
@briandrawertbriandrawert added this to the 1.0.2 Release milestone Mar 14, 2022
@briandrawertbriandrawert linked an issue Mar 14, 2022 that may be closed by this pull request
@briandrawert
briandrawert marked this pull request as draft July 13, 2022 16:39
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancementNew feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Run Example notebooks as a unit test

3 participants

@seanebum@briandrawert@BryanRumsey