Data Analysis Services Group - June 2016

News and Accomplishments

VAPOR Project

Project information is available at:http://www.vapor.ucar.edu

WASP Award:

KISTI Award:


John prototyped embedded Python matplotlib on Mac and Linux to assess whether this would be a viable approach for supporting KISTI's line plotting requirements.

3.x Development:


A working prototype of VAPOR 3.0 was released (version 3.0.0.alpha0). This is a limited functionality release whose aim is to provide feedback on the redesigned GUI. Much work was done leading up to the release:

  • The entire team performed an abbreviated test-and-fix cycle
  • John created a MapperFunction container class MapperFunction CF to manage multiple MapperFunction (transfer function) instances (one per variable). The new class allows lazy instantiation for improved performance. The isoline, 2DData and, Barb renderers were all refactored to use the new class.
  • John added support for log scaling to the SliderTextCombo class.
  • John had to rework the installation system on Mac and Linux platforms to allow two version of VAPOR to simultaneously co-exist. Ditto for Scott and Windows platforms. Scott configured the Windows installer for Vapor 3.0, and improved on it by using “Property Sheets”, which allow common settings to be applied to multiple Visual Studio projects simultaneously. Previously, each project had around 30 settings to be hand­configured each time a new one was created. After configuring the Windows installer, Scott helped test and release Vapor 3.0.
  • John did some cleanup on the RenderParams class, which has a lot of cut-n-paste code replication.


Scott created a class called SliderEditCombo to handle the case in Vapor’s GUI where we have conjoined QTextEdit and QSlider objects. Users can now configure the implementation of these objects with one line of code in the EventRouter classes. He updated the current renderers to use this new class which reduced Vapor 3.0’s code footprint. He completed the implementation of the TwoD and Image event routers, their GUI’s and their associated transfer functions.

  • He additionally completed the following tasks for Vapor 3.0
  • Fixed a bug where Vapor’s 2D renderer was displaying 3D (not 2D) variables in its variable selector. Added support for divergent colormap selection for all currently implemented renderers.
  • Added “Tool Tip” and “Explain This” settings to all widgets in vaporgui.
  • Completed documentation for all code updates. 
  • Worked on a refactoring of the TextObject class.

Stas implemented a python utility called vdccp.py that allows users to copy partial or entire VDC databases. This utility provides options to copy specific compression levels and time-frames. It can also output general information about a database or a specific variable.

Stas created a build system for the Vapor test datasets. It is a modular recursive makefile that allows for convenient configuration of build parameters. This system allows members of the Vapor team to quickly and easily test conversion scripts as well as generate new test data for multiple versions of Vapor. Stas also created a git repository that keeps backups of log files and changes to the build system.

Stas updated wrfvdccreate and the VDC library to support the copying of database attributes when converting a WRF database to a VDC.

Stas has been implementing a c++ utility called vdcdump which is meant to replicate the functionality of ncdump. This utility allows users to view detailed information about a VDC database.

Stas has been working on migrating the Vapor project from Visual Studio 2010 to Visual Studio 2015. This is still a work in progress.

2.x Development:


Administrative:

Education and Outreach:

Stas assisted to Scott Pearse in the execution of the Vapor tutorial. Provided general support when needed and helped answer questions

 

Scott also coordinated and prepared for the annual WRF Tutorial demonstration of Vapor, which would be presented on July 1.


Software Research Projects

John submitted a paper with colleagues from U. of Calgary to the International Symposium on Vision, Modeling and Visualization (VMV 2016). The paper describes the application of wavelets to hexagonal cells such as those employed by MPAS and ICON.


CESM workshop 2016 poster: Customizing Compression for CESM Data, Haiying, Baker, Hammerling, Li, Clyne

Stas has been exploring the possibility of integrating Intel OSPray into Vapor and is currently attempting to get a running demo on the Intel Phi system in the Futures lab.

 

 


Feature Tracking:

Climate data compression:

Production Visualization Services & Consulting

Scott assisted with a long­ running series of issues incurred by Romain Watteaux. Some of the problems he had turned out to be differences his between VDC1 and VDC2 conversions. He also had a problem with his graphics card which was alleviated by increasing the texture memory size.

Scott troubleshot an ICON users’ error that was being reported on Windows. After filing a bug that described Windows’ inability to display ICON data, Scott also found that some ICON files do not have sufficient grid descriptions for data ingestion.

 

ASD Support

  • xxx

Publications, Papers & Presentations

Scott Submitted a 4k resolution snapshot of Joanie Kleypas’ simulation to the CASC 2016 competition. He also created several GUI mockups for an application called SeedMe, which will be integrated into Vapor 2.6. Scott also corresponded with Amit Chourasia on a collaboration for SeedMe’s implementation into Vapor.

 

Systems Projects

Data Services

  • xxx

Accounting & Statistics

  • xxx

Security & Administration

  • xxx

System Monitoring

  • xxx

System Support

ML - Data Analysis & Visualization Clusters

  • xxx

GLADE Storage Cluster

  • xxx

Data Transfer Cluster

  • xxx

Experimental Clusters

  • xxx

Test Clusters

Storage Usage Statistics

NWSC+GLADE+Usage+Report

Other

  • xxx
  • No labels