Data Analysis Services Group - September 2013
News and Accomplishments
Our submission to the SC13 Visualization Showcase, entitled "Clustering of inertial cloud droplets in isotropic turbulence" was accepted. This animation showcases work done in support of CISL's ASD program.
VAPOR Project
Project information is available at: http://www.vapor.ucar.edu
KISTI Award:
John prepared a talk and a tutorial for the upcoming Korean Supercomputing Conference in Seoul.
John also completed the 4th of the five KISTI Year Three deliverables: support for direct import of MOM4, POP, and ROMS data.
Jin-Hee completed her two-month visit and returned to NCAR. In September Jin-Hee spent much of her time visualizing model outputs from Korea's Global/Regional Integrated Modeling System (GRIMs) and NCAR's MPAS-A. Both of these efforts were particularly challenging as the GRIMs code outputs data in the GRIB format, which is not currently supported by VAPOR. Even more challenging, the MPAS code uses and adaptive, unstructured mesh that had to be regridded. Jin-Hee had to modify an existing Fortran re-gridding code to support 3D variables.
Scott continued work on the fcwizard data translation GUI:
- The fcwizard code base ported to Windows 7 and Windows 8 under Visual Studio 2010. Scott notes that the Windows 7 port was performed on his Mac using a virtualized copy of Windows 7. Such virtualization could be a powerful tool for future regression testing. Virgin copies of different operating systems could be re-used for each test or release. This would reduce hardware costs, as well as eliminate any leftover environment settings that are done by an install/uninstall/reinstall sequence.
- Support for error handling has been added: errors generated by the translation library are now captured and displayed in a popup.
- Scott demonstrated the code to Jin-Hee and received her feedback on some minor improvements.
- Numerous code fixes:* Added WRF functionality to 2vdf.cpp, vdfcreate.cpp, as well as all other relevant wizard files. I will test these features starting tomorrow.
- The variable tables on the Create-VDF and Populate-Data pages now resize appropriately on Darwin/Windows/Linux (no white space).
- Corrected Windows/Linux font size issue.
- Implemented XPM files for accessing icons.
- Corrected a bug in Windows that would obstruct the Wizard’s content until the window was resized.
Scott began experimenting with the widely used ESMF re-gridding package. The aim of this work is to evaluate the ESMF code in terms of it's computational performance, functionality, and the quality of the re-gridding. Our hope is to replace our own re-gridding software with a more capable utility.
3.x Development:
- Alan has been developing prototype code for Vapor 3.0, based on the functionality we have been discussing in our 3.0 design meetings. The initial prototype will only support the most basic functionality, such as rendering barbs. Alan has implemented simplified Params and Render libraries to support this functionality, removing all Qt dependence. A fair amount of work is still needed to get to a working prototype.
- John completed the VDC 3.0 metadata prototype. Implementation of the production code will begin after the team has reviewed the prototype.
2.x Development:
- John implemented a DCReaderWRF class and re-factored and tested the wrf2vdf and wrfvdfcreate command line utilities to use it. Thus all of the model-specific NetCFD data translators now share a common code base for reading data and metadata from NetCDF files. The new DCReaderWRF class will greatly facilitate supporting WRF data conversion from the new GUI, fcwizard.
Administrative:
- John authored co-authored several sections for the 2013 CISLAR and POPPR.
- John researched more NSF proposal solicitations. To date, NSF 13-525 looks best aligned with the VAPOR effort. However, NCAR is ineligible to lead due to its FFRDC status. A suitable partner would need to be found.
- John was a reviewer for the SC13 Visualization Showcase.
Education and Outreach:
- Ilan Levy installed new graphics cards on the PC’s in the CTTC and Alan verified that the latest version of Vapor works well on these systems.
Software Research Projects
Feature Tracking:
Climate data compression:
Production Visualization Services & Consulting
- Alan has performed several experiments trying to create easy-to-view stereo movies of hurricane Sandy, with help from Tim Scheitlin. Some of the movies are difficult to view and we are trying to understand the problem.
ASD Support
- John gave Peter Ireland a remote (via VNC) tutorial on VAPOR's particle data handling capabilities.
- Our submission to the SC13 Visualization Showcase, entitled "Clustering of inertial cloud droplets in isotropic turbulence" was accepted. This animation showcases work done in support of CISL's ASD program.
Publications, Papers & Presentations
Systems Projects
Data Services
Accounting & Statistics
Security & Administration
System Monitoring
System Support
ML - Data Analysis & Visualization Clusters
GLADE Storage Cluster
Data Transfer Cluster
Experimental Clusters
Test Clusters
Storage Usage Statistics
dasg:NWSC+GLADE+Usage+Report
Other