Stage-I ESMF Validation Work

  1. Information on CCSM subversion repository
  2. Information on the bld-cases.csh script for bluesky
  3. Information on standard cam test suite
  4. Timing results
  5. Work on phoenix
    1.) Information on the CCSM subversion repository
    To view code go to
    https://svn-ccsm-models.cgd.ucar.edu/
    To check it out use the URL 
    svn co https://svn-ccsm-models.cgd.ucar.edu/cam1/branch_tags/esmfStageI02_cam3_3_38
    Subversion help page on BB:
    http://bb.cgd.ucar.edu/forumdisplay.php?f=27
    To ask for access go to
    http://www.ccsm.ucar.edu/working_groups/Software/secp/repo_access_form.shtml
    2.) Information on the bld-cases.csh script for bluesky:
    Run the following script on bluesky...
    cd models/atm/cam/bld
    run...
    bld-cases.csh
    (edit it first to make sure you understand what it's doing – you also may want to change the path of where ESMF_2_2_2r is located – I'm using my own copy of it). You can look at it online at....
    https://svn-ccsm-models.cgd.ucar.edu/cam1/branch_tags/esmfStageI02_cam3_3_38/models/atm/cam/bld/bld-cases.csh
    Personally I just run it interactively – but it does have some batch directives that you could set to something reasonable to get it to run in batch.
    This will create cases in
    /ptmp/$LOGNAME/ESMF_StageITests
    there will be several directories there for the two resolutions, MCT and ESMF coupling, and whether hybrid (MPI and OpenMP mode) or pure-MPI mode is used. In each directory are also one or more run scripts that will run in a directory identified as
    \$TASKSx\$THREADS
    (for example 16x8 for the hybrid case with 16 MPI tasks and 8 Open-MP threads)
    In that directory will be the output files, the log file, the ESMF logfiles, timing files for each task of the last simulation as well as a file called timing_results.log which records for each simulation the total time spent in the time-loop for each MPI task. I suggest we use the maximum value for each MPI task for each simulation and take the median of that over all 10 samples. You could also take the average of the 10 samples. And it would be good to get an idea of the spread, so either get the standard deviation, or the 25%-75% percentile range.
    You'll probably want to create another script that will submit all the cases. And another one that will analyze the results – or do it by hand.
    You'll need to checkout the above branch on phoenix and port the script there. I think you need to compile on robin, some of the work for phoenix is already setup in the script. But, you will also need to modify the mkrun-cases.csh script which is currently only setup for bluesky.
    https://svn-ccsm-models.cgd.ucar.edu/cam1/branch_tags/esmfStageI02_cam3_3_38/models/atm/cam/bld/mkrun-cases.csh
    3.) Information on CAM standard test suite...
    Another thing you need to be familiar with is the CAM test suite. By standard practice before code can be checked into the trunk – you need to run it on bluesky, tempest and bangkok. The test suite is called test_driver.sh and is in the directory
    models/atm/cam/test/system
    You submit it by simply running it on one of the machines it's setup for and it will submit a batch script. Results are in the file
    td.$jobname.status (and longer info in td.$jobname.log). You should familiarize yourself with using test_driver.sh and figure out how to work with it and see the results.
    Users Guide
    http://www.cgd.ucar.edu/~cam/test_driver/tdguide.html
  • No labels