Michael W. Liemohn

and 2 more

We apply idealized scatter-plot distributions to the sliding threshold of observation for numeric evaluation (STONE) curve, a new model assessment metric, to examine the relationship between the STONE curve and the underlying point-spread distribution. The STONE curve is based on the relative operating characteristic (ROC) curve but is developed to work with a continuous-valued set of observations, sweeping both the observed and modeled event identification threshold simultaneously. This is particularly useful for model predictions of time series data, as is the case for much of terrestrial weather and space weather. The identical sweep of both the model and observational thresholds results in changes to both the modeled and observed event states as the quadrant boundaries shift. The changes in a data-model pair’s event status result in nonmonotonic features to appear in the STONE curve when compared to a ROC curve for the same observational and model data sets. Such features reveal characteristics in the underlying distributions of the data and model values. Many idealized datasets were created with known distributions, connecting certain scatter-plot features to distinct STONE curve signatures. A comprehensive suite of feature-signature combinations is presented, including their relationship to several other metrics. It is shown that nonmonotonic features appear if a local spread is more than 0.2 of the full domain, or if a local bias is more than half of the local spread. The example of real-time plasma sheet electron modeling is used to show the usefulness of this technique, especially in combination with other metrics.

Laura E. Simms

and 4 more

We investigate the drivers of 40-150 keV hourly electron flux at geostationary orbit (GOES 13) using ARMAX (autoregressive moving average transfer function) models which remove the confounding effect of diurnal cyclicity and allow assessment of each parameter independently of others. By taking logs of flux and predictor variables, we create nonlinear models. While many factors show high correlation with flux (substorms, ULF waves, solar wind velocity (V), pressure (P), number density (N) and electric field (Ey), IMF Bz, Kp, and SymH), the ARMAX model identifies substorms as the dominant influence at 40-75 keV and over 20-12 MLT, with little difference seen between disturbed and quiet periods. Also over 40-75 keV, Ey has a modest effect: positive over 20-12 MLT but negative over 13-19 MLT. Pressure shows some negative influence at 150 keV. Hourly ULF waves, Kp, and SymH show little influence when other variables are included. Using path analysis, we calculate the total sum of influence, both directly and indirectly through the driving of intermediate parameters. Pressure shows a summed direct and indirect influence nearly half that of the direct substorm effect, peaking at 40 keV. N, V, and Bz, as indirect drivers, are equally influential. Neither simple correlation nor neural networks can effectively identify drivers. Instead, consideration of actual physical influences, removing cycles that artificially inflate correlations, and controlling the effects of other parameters using multiple regression (specifically, ARMAX) gives a clearer picture of which parameters are most influential in this system.

Michael Liemohn

and 9 more

The question of how many satellites it would take to accurately map the spatial distribution of ionospheric outflow is addressed in this study. Given an outflow spatial map, this image is then reconstructed from a limited number virtual satellite pass extractions from the original values. An assessment is conducted of the goodness of fit as a function of number of satellites in the reconstruction, placement of the satellite trajectories relative to the polar cap and auroral oval, season and universal time (i.e., dipole tilt relative to the Sun), geomagnetic activity level, and interpolation technique. It is found that the accuracy of the reconstructions increases sharply from one to a few satellites, but then improves only marginally with additional spacecraft beyond ~4. Increased dwell time of the satellite trajectories in the auroral zone improves the reconstruction, therefore a high-but-not-exactly-polar orbit is most effective for this task. Local time coverage is also an important factor, shifting the auroral zone to different locations relative to the virtual satellite orbit paths. The expansion and contraction of the polar cap and auroral zone with geomagnetic activity influences the coverage of the key outflow regions, with different optimal orbit configurations for each level of activity. Finally, it is found that reconstructing each magnetic latitude band individually produces a better fit to the original image than 2-D image reconstruction method (e.g., triangulation). A high-latitude, high-altitude constellation mission concept is presented that achieves acceptably accurate outflow reconstructions.