We have started some teardown at the ISS site.RASS is being taken down. Note almost 50% of nuts and bolts on rass surrounds were cross threaded and had to be cut off. Electric fence is down. Will finish up new AC cover today.
There have be several short storm fronts move through with rain and light snow with 10 meter per second winds. Afternoon it cleared up .
Profiler power .158 mW.
Yesterday profiler went down.
This morning forun that power amp was down. Cycled power on it and rebooted 449 computer . appears to be working now.
Restarted Dashboard before rebooting systems. and received an error message about pentak card not at address.
Power .146 mW.
Today is overcast windy and cool. Yesterday was also very windy.
All sky camera and ceilometer at the PAM Base have been shutdown and packed. ISS Display Manager and Ceilometer computers have also been removed.
The radar wind profiler is down for unknown reasons. Initially a problem was suspected in the processing chain, however after some investigation it now appears that the system is not transmitting indicating either a problem with the final amplifier or with the RIM synthesizer box. The profiler processes were stopped remotely as a precaution. Lou will visit the site tomorrow morning to investigate further.
Tis a wonderful day by the big hole in the ground in Arizona. The sun is shining and the sky is clear.Breeze is picking up possible strong winds being forecast.18: All platforms appear to be running fine. Just finished with IOP #7. Very likely to be the last of the project. Chances for light rain in the next couple of days make that the opinon currently.
449 power is at .144 mW.
Did not time but Rass at 18:10z did not run for 5 minutes.18:25z ran the full 5 minutes. It was also the on the half hour yesterday that went the full time. 18:40 also went for 5 mins
At approx 1845 restart rass full time. Ran for about 5 minutes and stopped. Did not restart until I did a "restart all" in the dashboard.Stopped again after approx 4 minutes. Left for 2 minutes then it restarted right on the hour mark [19:00] ran for 45 seconds and shut off again.Restarted by its self after 5 minutes. Off after 4 minutes.On after 1 minute.Off again after 10 minutes at approx 19:23.started up at 19:25. off 19:27.Started 19:30. Ran for 15 minutes before I shut it down.
I stopped it at 19:45 and did a "stop all" and restarted system in "RIM_only" mode.
Today IOP 7 will take place.
449 Site. All platforms working fine. Cleaned filters etc.
Filled generator.
Started on new AC cover as original one was destroyed on trip to Metcrax.
Ground off old tower mounts on front of trailer.
Sodar /Rass and ceilometer seem to be working fine.
449 power .204 mW.
Profiler Rass. At 21:10 ran for 2.5 minutes, 21:25 ran for 5 minutes, 21:40 ran for 1 minute and at 21:55 ran for about 1 minute and 20 seconds. Time is GMT. Will continue to monitor when at site profiler site. Going to Pam Base site to prepare for this evenings IOP.
Daily Update :10-25-13
This morning visited Sodar/Rass everything looked good. Solar was at approx 82%. Also went to PAM Base , ceilometer and all sky camera were working.
At the ISS site 449 and surface met are working . Power on 449 is .126 mW. Will be turning profiler RASS back on this afternoon.
Light breeze. Mostly clear skies. Some clouds to west..
Replaced Voyager back up drive.
Drove out the demons.
Checked fuel reserve tank , should be enough to run till end of project. Will check it each time generator is refilled. Generators should not need to be served again during the project
Clayton is checking on the lidar.
RASS mode restarted at 21:45 gmt.
Bill created a new 449 mode file to sample RIM winds without RASS interrupting. We switched to this mode at 20:15UT and will have it run at least overnight.
This must be changed back well before the next IOP to capture the evolution of boundary-layer temperature.
Created data backup DVD's
ISS: 24-Oct-2013: data-backup-20131024.iso created at 15:35 UT
GAUS site: 24-Oct-2013: data-backup-20131024.iso created at 16:31 UT
ALSO: Bill filled the Voyager 1TB disk. I will carry it back to Boulder. Lou will bring a replacement, which should last through the end of METCRAX-II
Daily report for Thursday October 24
Weather: Overcast much of the night. Not much cooling from 4Z onward. Low ~5C.
Cloud base visible on CL-view (ceilometer), 10K-12K feet this morning. (The plots from MLH analysis don't go high enough to capture this)
Profiler power: 0.130mW (at 15:48Z). Good profiler returns overnight.
Soundings: IOP last night followed usual sequence: (LT) 4pm, 7pm, 10pm, 1am, 4am, 7am, 10am.
Problems and interesting events:
Nagios all green at ISFS Base
Nagios all green (ISS site) except:
- NTP time CRITICAL this morning (15:45): "CRIT - sys.peer - stratum 10, offset 0.00 ms, jitter 0.00 ms, last reached 37 secs ago, stratum is too high (max allowed is 4) (synchronized on 127.127.1.0)"
- Disk space CRITICAL: fs_/scr says "CRIT - 96.9% used (2664.98 of 2750.7 GB), (levels at 80.0/90.0%), trend: +44.84GB / 24 hours" (as of 15:50Z)
- Also the two lidar errors appeared again because of no dbs or los scans during the IOP.
449-RASS: Working well overnight (to larger heights). (Did not check for issue of sound ending before the 5-min dwell ends)
WILL need to clear disk space within 1 day.
SODAR site: solar trailer battery at 86% (9am LT); . Sodar chirping. [Battery at 90% (2pm LT) after a mostly cloudy morning]
All sensors appear to be operating well, however:
CEILOMETER CL-View screen still shows a warning: (Status: Blower failure; Status: Heater fault; (both blower and heater show "OFF").)
Backup to DVD: backed up both ISS and GAUS site data-managers this morning.
Voyager disk: Bill filled it and I will return it to Boulder. Lou will bring a replacement good through the project end.
449-RIM-without-RASS: Bill created this new mode for continuous RIM winds, not interrupted by RASS. We started this mode at 20:15UT. Will let it run at least overnight. [WIll need to change back well before next IOP]
LOU arrives this evening to join Clayton. Steve departs tomorrow. Good luck LOU!
Generator filled today. Next refill should be 26 Oct 13.
Radiosondes- 43 before IOP#6
Balloons - 37 before IOP#6
Helium - 6 full and 2 partials before IOP#6
Daily report for Wednesday October 23
Weather: Warm and sunny today. Topped 70F. Light winds (easterly in the afternoon). Ceilometer saw a layer of smoke this morning, which mixed nicely as the BL grew through the day. Nehanth was seeing very good lidar echoes. IOP 6 to begin this evening.
Profiler power: 0.124mW (at 22:16Z)
Soundings: Will follow usual IOP sequence: 4pm, 7pm, 10pm, 1am, 4am, 7am, 10am.
Problems and interesting events:
Nagios all green at ISFS Base
Nagios all green (ISS site) except:
- Disk space CRITICAL: fs_/scr says "CRIT - 97.7% used (2686.41 of 2750.7 GB), (levels at 80.0/90.0%), trend: +74.48GB / 24 hours"
- Also the two lidar errors appeared again because of no dbs or los scans during the IOP.
449-RASS: Working well (to larger heights). (Did not check for issue of sound ending before the 5-min dwell ends)
WILL need to clear disk space within 1 day.
SODAR site: solar trailer battery at 100% (2pm LT); . Sodar chirping.
All sensors appear to be operating well, however:
CEILOMETER CL-View screen still shows a warning: (Status: Blower failure; Status: Heater fault; (both blower and heater show "OFF").)
The modular profiler RIM processing on the DM has been updated:
1) From 20 UTC (Oct 23), RIM is using a fixed phase offset calibration file that Phil generated from analysis of precip echoes last week. Previously the phase offset for each tms file was determined from statistics of the data in that file, however the new calibration should be a little more stable.
2) Correlation files are now being generated from Gary's reprod program.
3) RIM winds are now being calculated from the reprod correlation files.
Data prior to now is gradually being processed so that the RIM correlations and winds will be available for the entire project. (Note however that the fixed phase offset is not yet being applied to earlier data as that would require too much processing).
CEILOMETER CL-View screen shows a warning: Status: Blower failure; Status: Heater fault; (both blower and heater show "OFF").
1. Sunstate serviced the ISS-site generator (approx 12:30pm to 12:45 LT (20:30 to 20:45 Z), AND
2. Sunstate swapped the ISFS-site generator approx 1:05pm to 1:30pm LT (21:05 to 21:30 Z).
A lesson-learned is that swapping at the ISFS-site is a bit trickier than anticipated. Two issues:
- In addition to the ISFS and APG instruments, this generator powers the WindCube lidar and Halo Streamline lidar, so expertise is needed to shut off and restart these
- There is also some direct-wiring to support a 240V line for the K.I.T. tethersonde's winch.
Note: Sunstate delivers the generator with a full tank and expects it to be returned with a full tank. They will fill the returned ISFS-site generator for us and charge the going rate.
See today's daily report (22 Oct) for data outage times
Daily report for Tuesday October 22
(early morning, updated throughout the day)
Weather: Just touched below freezing overnight. Light winds from SSW towards morning. IOP 5 underway. Soundings good through 4am launch so far. A few cirrus this morning (was "not-a-cloud-in-the-sky" in recent days). LATER: Warmed to about 17C. 1/10 stratiform clouds at times. No fair weather Cu. Some smoke aloft from the controlled burn to the south.
Profiler power: 0.144mW (at 16:20Z)
Soundings: Usual IOP sequence last night. (LT) 4pm, 7pm, 10pm, 1am, 4am, 7am, 10am. All successful.
Problems and interesting events:
Nagios all green at ISFS Base
Nagios all green (ISS site) except:
- Disk space CRITICAL: fs_/scr says "CRIT - 94.5% used (2599.99 of 2750.7 GB), (levels at 80.0/90.0%), trend: +115.64GB / 24 hours"
- metcraxii/profiler_anyfail_profiler "CRIT - CRITICAL - 1 checks failed out of 9."
- Also the two lidar errors appeared again because of no dbs or los scans during the IOP.
Note: At 14:30 (after the IOP) NAGIOS shows all green except the disk space issue.
449-RASS: Still noting less than 5-min of sound, although radar is operating in RASS mode for full 5 minutes.
WILL need to clear disk space within 1 day (Bill is on it).
SODAR site: solar trailer battery at 85% (6am LT); . Sodar chirping. Checked Solar Trailer at 6 am, which is a few minutes before sunrise. Still at 85% after a full night of (sunless) operation.
Interesting event: Waste management serviced both sites this morning.
All sensors appear to be operating well, however:
CEILOMETER CL-View screen shows a warning: Status: Blower failure; Status: Heater fault; (both blower and heater show "OFF").
GENERATOR SERVICE times and data impacts
- ISS-site: Sunstate serviced the generator (quite rapidly). I paused the 449 from 12:30 to 12:45 LT. The only data loss should be wind profiler and RASS.
- ISFS-site: Sunstate swapped the generator. Power was down from approximately 1:05 to 1:30 LT (20:05 to 20:30 Z). However, there are larger date gaps because of issues restarting all equipment.
- All-sky camera: Missing data from 20:07 to 22:25 Z
- Ceilometer reflectivity: Missing data from 20:07 to 20:35Z
- Ceilometer MLH (mixed-layer-height): missing a couple of plots, but with overlapping data on these plots it's all there.
- Surface station data at ISFS-site: Two minor data gaps between 20 and 21 Z.