We're lost, but we're making good time! (Yogi Berra, 1972)
NEW: Integrated Terminal Weather System (ITWS) Notes on Data Assimilation Software
Introduction
Background
Goals
Existing Networks
Rooftop
Canyon
Remote Sensing
Data Assimilation
Operations Schedule
30 July 2003
Mesoscale meteorology is the science of local and regional atmospheric phenomena. These phenomena include individual storms, fronts, convective clouds and boundary-layer circulations, including topographical effects. Mesoscale systems interact strongly with microscale processes at scales of order a kilometre or less and with the large-scale global circulation. Microscale meteorology is the study of air motions on scales less than 1 km. This includes turbulence, wakes, and, in urban situations, street-level canyon circulations. Atmospheric Transport and Dispersion (ATD) covers scales from tens of meters to several kilometers or more and thus it spans from the microscale, through the mesoscale, and into large-scale weather.
Real progress in our ability to predict the evolution of a gaseous plume, be it accidental or deliberate, depends on (a) model improvement and (b) observations of the plume and of the atmospheric field. (NRC 2003). Field studies and wind tunnel experiments show that in urban canyons a change in wind direction of 10 degrees can lead to a completely different pattern of transport and dispersion at street level. When the winds above the buildings are known, canyon models will be required to define street-level conditions. Lethal dose statistics, crucial for first responders, are highly dependent on accurate estimates of turbulence on all scales.
By “high-resolution” we mean a spatial scale of ~100 m in the horizontal and ~25 m in the vertical, i.e. on the scale of individual blocks. By “real time” we mean the fields must be available to modelers and first responders <1 minute of measurement. (Note: modeling virtually as they are occurring or even with a small--1 hour--prediction capability. These goals are ambitious but, with technology available today, are achievable in a reasonable time frame.
This paper provides our current plan of how we can move from the current situation, a few unreliable stations, to the goal stated above.
The data set that is required to support an emergency hazmat situation is much different than the normal data required to support the usual National Weather Service weather forecasting. Normal forecasting over regions of 4 to 400 km use observations that are widely spaced and sampled at hourly or more rates. Hazmat operations on the other hand need information on the scale of a few hundred meters and with updates in the 1-5 minute time scale. The transport and dispersion processes differ as we descend from above the rooftops down into the canyons, thus real information is needed on the vertical distribution of the flow and turbulence.
This requirement makes most existing meteorological networks of minimal use. The existing networks, described below, can certainly fill in and support an ATD network, but they must be used very carefully.
The NYC mesonet will be an assimilation of existing meteorological stations supplemented by UAO stations to provide a real-time high resolution coverage in support of the scientific and real-time requirements of the UAO New York City is the perfect, and most obvious place to develop this tool: It is a primary terrorist target, (Population of the city > 8 million, including Northern NJ and Long Island > 22 million) and thus there is an immediate need to have the best emergency tools here. Major public events (e.g. the Republican Convention in the summer of 2004) are held in NYC throughout the year. The five-borough area has minimal topography (compared to West Coast cities) so remote sensors will have the widest possible coverage.
NYCnet will utilize all available meteorological stations operating in the entire city and in surrounding areas. There are many collections of meteorological stations (listed below) but it is felt that before these can truly be included in a quality meteorological grid that they must be evaluated.
Automated Surface Observing System (ASOS)
Road Weather Information System (RWIS)
AWS Convergence Technologies, Inc. (AWS)
Citizen Weather Observing Program (CWOP) ♦
Presently the CWOP program brings in data from about 900 surface weather stations (many located in urban areas), places these data in the NOAA mesonet database, and makes these and other weather data available to NWS forecasters and other users. In the upper right of this page “CWOP info” gives more information on CWOP and gives an extensive list of software and other pertinent information on what a citizen would need to get a station up and working. The author of this link is Dave Helms, who works at National Weather Service Headquarters in Silver Spring, MD and is our liaison to the NWS. Dave designed our logo, and is one of our data contributors, CW0351.
The original purpose of the CWOP network was to acquire surface weather data and our data providers take various meteorological measurements and send digital data. However, with suitable transducers, the equipment could also take chemical, biological, radiological (CBR) measurements and send the digital data over the same communication system. The CWOP system architecture and computer programs could serve as a model for what ever system is developed for CBR monitoring. It has the advantage of a fairly large real-time system that is widely deployed, scalable to any size with commodity computers, and uses standard software. This means the system need not be expensive. In addition, it uses both radio and internet transmission so that the measuring stations can be mobile or fixed and still report data to emergency managers and other users in near real-time.
“APRS-IS info” gives many details on the Automatic Packet Reporting System - Internet Service, which is how our weather data packets (and many other types of data) get transferred around the country and the world. The author is Pete Loveall, who lives in Melissa, TX, and has written and maintains a Java program that is used at many different servers that handle our data. Pete is one of our data contributors, AE5PL.
“findu.com” gets about 3 million hits per month. The author of the findu.com server is Steve Dimse, who also was the original developer of the APRS-IS. In his spare time, Steve is an emergency room physician at a large Miami Hospital. The findu.com server is the public database for CWOP and thousands of amateur radio operators around the world who send information packets to APRS-IS. Steve is one of our data contributors, K4HG.
The NOAA Meteorological Assimilation Data Ingest System (MADIS) is a program in the NOAA Forecast Systems Lab that acquires a wide variety of data sets and puts the data into a common data format (netCDF). The data are then made available to federal agencies, educational institutions, commercial companies and private meteorologists. This is how our CWOP data get to NWS field forecasters in a form compatible with their work stations. All of the MADIS data can be seen on the “NOAA mesonet display”. The manager of the MADIS program is Patty Miller, who is employed by NOAA here in Boulder.
The Queens college
♦ Notes by Russ Chadwick, NOAA FSL.
The NOAA-made rooftop turbulence system will play a major role in the NYCmesonet. The rooftop stations are used in DCnet where over 18 systems have been deployed.
Sound Detection and Ranging (SODAR)
![]() |
![]() |
![]() |
This example is from a wind tunnel evaluation of an offshore structure so the structure sees horizontally homogenious flow. A rooftop tower that is 3-5 m high is shown by the black vertical line. Wind velocities vary from 15% overspeeding to 26% underspeeding in this example. Turbulence levels and direction will be similiarly distorted. The Sound Detection and Ranging (SODAR) transmits pulses of high-frequency sound (4000 Hz approx.) in three different directions. The sound waves are scattered by atmospheric turbulence and the SODAR receives the echo. The slight change in the frequency in the returned sound is measured and used to estimate the wind speed and direction for different altitudes above the instrument.
Coherent Lidar
![]() |
![]() |
| Figure 13. Coverage for the Coherent Lidar. | Figure 14. The Lidar in its container. |
The Infrared Doppler Radar detects and tracks aerosol levels above normal conditions. For high concentrations, detection range is in excess of 15 km and detection sensitivity of a few hundred to a few thousand particles per liter is achievable. Wind data is simultaneously and directly monitored using Doppler techniques and early detection of wind shifts results in improved downwind prediction. Integration with plume dispersion models provides accurate forecasting of the plume track. Early threat warning and exposure assessment reduces contamination of critical resources. Update time is five minutes. (Courtesy of Coherent Technologies Inc.)
All observations can be combined into a software assimilation program that will derive the best, most physically reasonable, data set for the desired locations. These software tools generally run in a minute or so. Of importance is the ability to operate on very small scales, say 50 m, and to predict ahead a short time, say 1 hour.
Local Analysis and Prediction System (LAPS)
The LAPS integrates data from virtually every meteorological observation system into a very high-resolution gridded framework centered on a forecast office's domain of responsibility. Thus, the data from local mesonetworks of surface observing systems, Doppler radars, satellites, wind and temperature (RASS) profilers (404 and boundary-layer 915 MHz), as well as aircraft are incorporated every hour into a three-dimensional grid covering a 1040km by 1240km area. LAPS has analysis and prediction components. The prediction component is being configured using the RAMS, MM5, WRF, and ETA models. Any or all of these models, usually being initialized with LAPS analyses, are run to provide short-term forecasts. NOAA produces ensemble forecasts using multiple models and initialization methods, with verification.
Variational Lidar Assimilation System (VLAS)
Lidars have long been used as research tools in atmospheric science. However, recently developed model-based data-assimilation technology now allows lidar data to be used operationally to define high-resolution wind fields for use in transport and dispersion models. The modeling system, called the Variational Lidar Assimilation System (VLAS), synthesizes all available data, including lidar data, to produce three-dimensional gridded analyses and short forecasts of all meteorological variables in the boundary layer. These fields, defined on a regular grid with a spacing of 60-70 m, are then used as input to urban plume models of which there are many. Because the VLAS model has simple physics, it can produce meteorological analyses and half-hour forecasts in a couple of minutes on an inexpensive dual-processor PC. Most standard dispersion models can provide usable results in about a minute, and a major effort is underway to provide urban models, that incorporate real urban geometries, in a comparable time. Thus, the combination of lidar data, VLAS, and the urban dispersion model constitutes a valuable operational tool for forecasting the transport and dispersion of hazardous material on the urban scale. Because of the speed of the system, the meteorological variables and plume tracking capability would be made available in real-time to scientists using the Urban Atmospheric Observatory and to NYC emergency managers.
Integrated Terminal Weather System (ITWS)
Note: scheduled times are approximate.
| W. Village | 7/15 | EML | Install SODAR on EML rooftop, Houston & Varick. |
| Midtown | 7/20 | Lehman | Install rooftop station, 7th Ave & 50th St. |
| Brooklyn | 8/1 | CUNY | Ingest M. Evars CC NASA met station. |
| Downtown | 7/15 | NYMEX | Site survey planned. |
| Brooklyn | 8/1 | B Bridge | Brooklyn Bridge, Brooklyn side. |
| N. Harlem | 8/1 | CCNY | GPS network, Met station. |
| W. Village | 8/1 | EML | 5th floor canyon station. |
| W. Village | 8/1 | EML | streetlevel canyon station. |