Skip to content

Update train-cloud-microphysics demo app for merged ICAR files - #287

Merged
rouson merged 18 commits into
mainfrom
train-on-new-file-format
Feb 3, 2026
Merged

Update train-cloud-microphysics demo app for merged ICAR files#287
rouson merged 18 commits into
mainfrom
train-on-new-file-format

Conversation

@rouson

@rousonrouson commented Feb 3, 2026

Copy link
Copy Markdown
Contributor

With this PR, putting the latest ICAR NetCDF training data files in a subdirectory demo/fiats-training-data and running something like

cd demo
./setup.sh
ln -s `find build -name train-cloud-microphysics`
./train.sh

should launch a run that does successively refined training of a cloud microphysics model by conditionally sampling the training data to flatten the output-tensor histograms.

This PR

  1. Adjusts the demonstration application in demo/app/traini-cloud-microphysics.F90 and related files to process the ICAR training-data files that resulted from merging image-specific files into one regional file per 50 time steps;
  2. Updates demo/train.sh to improve robustness by
    • Adding a check for the executable file and exiting if it's not found,
    • Adding default values for command-line arguments,
    • Removing unused command-line arguments, and
    • Updating to Julienne 3.6.1 to fix a crash that occurs when the network file already exists;
  3. Adds file types to .gitignore;
  4. Renames an example's supporting module to leverage default preprocessing;
  5. Makes training output more verbose, including
    • more descriptions of intermediate steps and
    • printing epoch and cost function values.
  6. Aggregates tensors across files for training.

This commit adds several file types to ignore:
* archives & compressed files: *.gz, *.tar, etc.
* gnuplot & graphics: *.plt, *.png
* macos: .DS_Store
Remove variables that are no longer used.
With this commit, the demo/train.sh training script
1. Exits if any simple command returns a non-zero exit code,
2. Uses default values for the starting and ending number of bins,
3. Makes the executable path/name a variable with a default, and
4. Removes unused arguments form the training proggram launch line.
This update fixes an issue with demo/app/train-cloud-microphysics
that occured when an attempt is made to open an already open file.
@rouson
rouson merged commit c25a52b into mainFeb 3, 2026
4 checks passed
@rouson
rouson deleted the train-on-new-file-format branch February 3, 2026 05:57
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@rouson