Skip to main content

Main menu

  • Home
  • Current Issue
  • Archive
  • About Us
    • About NAVIGATION
    • Editorial Board
    • Peer Review Statement
    • Open Access
  • More
    • Email Alerts
    • Info for Authors
    • Info for Subscribers
  • Other Publications
    • ion

User menu

  • My alerts

Search

  • Advanced search
NAVIGATION: Journal of the Institute of Navigation
  • Other Publications
    • ion
  • My alerts
NAVIGATION: Journal of the Institute of Navigation

Advanced Search

  • Home
  • Current Issue
  • Archive
  • About Us
    • About NAVIGATION
    • Editorial Board
    • Peer Review Statement
    • Open Access
  • More
    • Email Alerts
    • Info for Authors
    • Info for Subscribers
  • Follow ion on Twitter
  • Visit ion on Facebook
  • Follow ion on Instagram
  • Visit ion on YouTube
Research ArticleOriginal Article
Open Access

Spatiotemporal Deep Learning Network for High-Latitude Ionospheric Phase Scintillation Forecasting

Yunxiang Liu, Zhe Yang, Y. Jade Morton, and Ruoyu Li
NAVIGATION: Journal of the Institute of Navigation December 2023, 70 (4) navi.615; DOI: https://doi.org/10.33012/navi.615
Yunxiang Liu
1Department of Aerospace Engineering Sciences, University of Colorado Boulder, Colorado, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: [email protected]
Zhe Yang
1Department of Aerospace Engineering Sciences, University of Colorado Boulder, Colorado, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Y. Jade Morton,
1Department of Aerospace Engineering Sciences, University of Colorado Boulder, Colorado, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ruoyu Li
2Department of Computer Science and Engineering, University of Texas at Arlington, Texas, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

In this paper, we present a spatiotemporal deep learning (STDL) network to conduct binary phase scintillation forecasting at a high-latitude global navigation satellite systems (GNSS) station. Historical measurements from the target and surrounding GNSS stations are utilized. In addition, external features such as solar wind parameters and geomagnetic activity indices are also included. The results show that the STDL network can adaptively incorporate spatiotemporal and external information to achieve the best performance by outperforming a naive method, three conventional machine learning algorithms (logistic regression, gradient boosting decision tree, and fully connected neural network) and a machine learning algorithm known as long short-term memory that incorporates temporal information.

Keywords
  • forecast
  • ionospheric phase scintillation
  • machine learning

1 INTRODUCTION

Our modern society has become increasingly reliant on the services provided by global navigation satellite systems (GNSSs). In addition to traditional functions, such as navigation and positioning, other high-impact applications, such as power grids, financial services, communications, and network systems, also rely on the precise timing service provided by GNSSs. However, GNSS receivers are vulnerable to disturbances because of the weak GNSS signal power. Ionospheric scintillation is one type of such disturbance that refers to rapid amplitude and/or phase fluctuations of the GNSS signals propagating through ionospheric irregularities (Breitsch et al., 2020; Jiao & Morton, 2015; Jiao et al., 2013; Liu et al., 2018). The occurrence of scintillation may impair the receiver signal tracking loop, resulting in position, navigation, and timing service degradation, discontinuities, and/or even outages (Kintner et al., 2007; R. Yang et al., 2019). Therefore, it is important to forecast the occurrence of scintillation in advance so that appropriate measures can be taken to alleviate potential impacts.

Ionospheric scintillation is difficult to forecast because of the complex physics governing the generation of ionospheric irregularities, which are driven by coupling among solar wind, the magnetosphere, and the ionosphere (Prikryl et al., 2012; Wernik et al., 2003; Z. Yang et al., 2020). Extensive study has been devoted to investigating the connections between scintillation and coupling effects at both equatorial (Carter et al., 2014; Costa et al., 2011; de Lima et al., 2015; Rezende et al., 2010; Secan et al., 1995; Taabu et al., 2016; Z. Yang & Liu, 2016, 2018; Z. Yang & Morton, 2020) and high-latitude regions (Jin et al., 2015; Prikryl et al., 2012, 2014, 2013; Secan et al., 1997). In this work, we focus on phase scintillation forecasting at high-latitude regions, where space weather has a more direct impact on the occurrence of scintillation (Cowley, 2000; McGranaghan et al., 2018). At high-latitude regions, phase scintillation is primarily caused by steep ionospheric charged particle density gradients and irregularities associated with auroral and cusp precipitation and polar cap patches, where solar wind disturbances have been closely linked to the occurrence of phase scintillation (Prikryl et al., 2014). Both diffractive scintillation due to signal scattering and refractive effects due to rapid horizontal drift of irregularities across GNSS signal paths may lead to phase scintillation (McCaffrey & Jayachandran, 2019; Morton et al., 2021). Because of these complexities, it is very difficult to forecast scintillation based on a physical model of the ionospheric structure.

Recently, data-driven machine learning methods have emerged as an alternative approach for phase scintillation forecasting (Lamb et al., 2019; McGranaghan et al., 2018). In McGranaghan et al. (2018), the author applied a machine learning algorithm known as a support vector machine (SVM) to high-latitude phase scintillation forecasting. Measurements from the GNSS receiver, geomagnetic activity, particle precipitation data, and solar wind parameters are used as features. The results in that work showed that the SVM-based forecasting model outperformed the persistence method. The authors in Lamb et al. (2019) used a deep learning model to forecast the magnitude of phase scintillation. A novel convolutional architecture and loss function were designed to tackle the problem in which features consist of solar wind parameters, geomagnetic activity indices, etc.

The above work focused on forecasting scintillation using historical measurements from a GNSS monitoring station and measurements related to potential drivers of scintillation (solar wind parameters, geomagnetic activity indices, etc). These methods did not incorporate spatial information. Moreover, the models in previous methods are not ideal choices for time-series forecasting tasks when they fail to capture temporal information. In this study, we incorporate both spatial and temporal information to forecast scintillation. GNSS measurements at both target and surrounding GNSS stations and external features, such as solar wind parameters, are utilized. A spatiotemporal deep learning (STDL) network is implemented to employ spatial fusion and temporal fusion modules to adaptively incorporate information for achieving optimal performance. To the best of our knowledge, this is the first work to incorporate both spatial and temporal information in a deep learning network for the task of scintillation forecasting.

The remainder of this paper is organized as follows: Section 2 discusses the methodology, including the features and model structure. Section 3 describes the data set, followed by a performance evaluation in Section 4. Finally, concluding remarks and future work are discussed in Section 5.

2 METHODOLOGY

We formulate the high-latitude scintillation prediction as a time-series forecasting problem. Let us suppose that we have a sequence of evenly spaced time steps {tn–k, tn–k+1,⋯, tn,⋯, tn+m}, where tn is the current time, tn–k represents a time that is k steps in the past, and tn+m is a time that is m steps in the future. The objective is to apply features collected at time steps {tn–k, tn–k+1,⋯, tn} to a machine learning algorithm to forecast scintillation at the time step tn+m. In this work, the forecasting label is binary, indicating either the presence of scintillation or no disturbance. An illustration of the machine-learning-based forecasting procedure is shown in Figure 1. In the following subsections, we will discuss the target label, feature engineering, and STDL network machine learning algorithm architecture.

FIGURE 1
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1

Illustration of the machine-learning-based forecasting procedure

2.1 Definition of Phase Scintillation Occurrence

The objective, as illustrated in Figure 1, is to forecast the occurrence of phase scintillation at the target station. We define the scintillation label (phase scintillation occurrence) by setting a threshold on the average value of σϕ from all satellites in view (elevation mask: 30°), where an average σϕ that is higher than the threshold denotes the occurrence of scintillation and vice versa. Here, σϕ is defined as the standard deviation of the detrended carrier phase measurements (Jiao & Morton, 2015). The threshold is empirically set to 5° by not excluding the weak scintillation cases (Jiao et al., 2013). A different threshold can be set depending on the design requirement. For example, if strong scintillation is the target, we can increase the threshold. It should be noted that a change in threshold results in re-training of the model, including hyperparameter tuning.

2.2 Feature Engineering

Feature engineering is the process of using domain knowledge of the data to create features that can provide information for the forecasting task. In this work, we utilize three types of features that contribute collaboratively to the forecasting task, i.e., local GNSS measurements, external features, and surrounding GNSS measurements. Here, “collaboratively” indicates that the spatiotemporal information is incorporated. This feature selection follows the work in Wu & Liu (2021). Similar to most machine learning models, normalization is required to preprocess all of the features to follow a normal distribution, which prevents certain features from dominating the prediction (Bishop, 2006).

2.2.1 Local GNSS Measurements

In this work, a high-latitude GNSS receiver located at Poker Flat, Alaska (65.1° N, 147.4° W) was selected as the target station (blue icon in Figure 2) (Wu & Liu, 2021). In a time-series forecasting task, historical labeling of the forecasting state is critical. As a result, the binary scintillation labels1 (indicating whether phase scintillation occurred) of the target GNSS station from tn–k to tn are utilized as features. In addition, the average S4, average σϕ, and average signal-to-noise ratio (SNR) from all satellites in view (election mask: 30°) at the target station are also employed. Here, S4 and σϕ are the commonly used amplitude and phase scintillation indicators, respectively (Jiao et al., 2013). A summary of the features in local GNSS measurements is provided in Table 1.

FIGURE 2
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2

Illustration of the target station (blue) and surrounding auxiliary stations (yellow)

View this table:
  • View inline
  • View popup
TABLE 1

List of Features in Local GNSS Measurements From Wu & Liu (2021)

2.2.2 External Features

Solar wind parameters observed at Lagrange Point L1 from tn–k to tn are used as features, which are denoted as space-based observations. As it usually takes around 1 h or longer for the solar wind measured at Lagrange Point L1 to impact the Earth (Jensen, 2013), these observations potentially offer lead-time information. In addition, ground-based magnetic activity indices, geomagnetic storm indices, etc. are also employed (Mandea & Korte, 2010). These space-based and ground-based solar–geomagnetic activity observations are denoted as external features in this work. A summary of the features used is given in Table 2. It should be noted that the Lyman alpha feature is measured by geosynchronous-orbit satellites and is categorized as a space-based observation (Machol et al., 2019).

View this table:
  • View inline
  • View popup
TABLE 2

List of External Features (Wu & Liu, 2021)

2.2.3 Measurements from Surrounding GNSS Stations

Plasma irregularities in the ionosphere, which cause scintillation, drift over time (Wang et al., 2018). A plasma irregularity near the target station may impact the target station at a later time if the irregularity moves toward the target station. One way to detect these nearby irregularities is through the GNSS monitoring stations in the proximity of the target station. Therefore, historical measurements from surrounding GNSS stations are used as features to offer spatial information regarding plasma irregularities. Low-rate (every 30 s per sample) GNSS station receivers from the UNAVCO network are utilized (Pritchard et al., 2012). The surrounding GNSS stations are marked as yellow icons in Figure 2. Because of the unavailability of σϕ in low-rate GNSS receivers, another commonly used disturbance indicator known as the rate of total electron content (TEC) index (ROTI) is employed (McCaffrey et al., 2018; Pi et al., 1997). The rate of TEC (ROT) is also included as a feature in this study. A summary of the features is given in Table 3.

View this table:
  • View inline
  • View popup
TABLE 3

List of Features From Surrounding GNSS Stations (Wu & Liu, 2021)

2.3 Machine Learning Algorithm—STDL Network

Let us assume that we have a data set with m samples D = {(x1, y1),…, (xm, ym)}, where xi, i = 1,…, m denotes the input features extracted from feature engineering and Embedded Image, i = 1,…, m is the corresponding binary forecast label (scintillation or no disturbance). The objective of the machine learning model is to learn a mapping function ŷ = f(x) such that ŷ matches the ground truth y as accurately as possible. Concatenating all features extracted from local GNSS measurements, external features, and measurements from surrounding GNSS stations into a feature vector may potentially lead to a loss of temporal information from historical measurements as well as spatial information from surrounding GNSS stations.

To address this problem, we apply an STDL network that adaptively captures spatiotemporal information (Liang et al., 2018). A block diagram of the STDL network is shown in Figure 3. Local GNSS measurements are shown as blue dots, while measurements from surrounding GNSS stations are denoted as yellow dots. Historical GNSS measurements from tn–k to tn are employed. In addition, external features are also employed. The breakdown of the STDL network is as follows:

  1. At each time step, both local and surrounding GNSS measurements are first passed to a spatial fusion module that adaptively incorporates spatial information and constructs a fused feature vector. Here, the distance from a surrounding station to the target station is also employed in the spatial fusion module (more details can be found in Equation (4) in Liang et al. (2018)). Details regarding the implementation of a spatial fusion module can be found in Section 3.1 in Liang et al. (2018). The spatial module takes information regarding the distance between stations into consideration, reflected as the similarity term P in the equation. In addition, the attention mechanism is also applied to adaptively learn the correlations between stations. Eventually, a weighted combination controlled by lambda is obtained.

  2. The fused feature vector at each time step is passed to the long short-term memory (LSTM) module to construct a hidden state that incorporates the temporal information. LSTM is a popular recurrent neural network (Hochreiter & Schmidhuber, 1997).

  3. The hidden states produced by LSTM are passed to a temporal fusion module to adaptively incorporate information from all time steps. The temporal fusion module is implemented based on the attention mechanism (Vaswani et al., 2017). More details on the implementation can be found in Section 3.2 in Liang et al. (2018). Here, the attention mechanism learns the optimal weighted combination across all hidden states, where the weight gamma is learned via an attention mechanism.

  4. The temporally fused feature vector is concatenated with the external features and passed to a fully connected neural network (FCNN). Here, the FCNN is a basic deep learning architecture that conducts multilayer nonlinear mappings on the input vector (Bishop, 2006; Liu et al., 2019). This network is also known as a multilayer perceptron.

  5. The output layer of the FCNN, which is also the output of STDL, is a single value that ranges from 0 to 1. This layer is designed to represent the probability of scintillation occurrence at the forecasted time.

  6. To determine whether scintillation will occur, a threshold is determined beforehand and applied to the output. Any probability that is higher than the threshold denotes that scintillation will occur and vice versa. Here, the threshold is usually determined by the application requirements. For example, if a specific false positive rate is desired, a threshold that produces that false positive rate will be selected. In this work, we will evaluate the performance across all thresholds, as discussed in Section 4.1.

FIGURE 3
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3

Block diagram of the STDL network

The target and surrounding GNSS stations are represented by blue and yellow dots, respectively.

The implementation of STDL follows the work in Liang et al. (2018), and the corresponding source code can be found at https://github.com/yoshall/GeoMAN. We use the same hyperparameters (e.g., learning rate, dropout rate) employed in Liang et al. (2018) to train the model. The original work in Liang et al. (2018) deals with a regression problem, where the loss function is the mean squared error. To adapt this network to our application, we modify the network to handle classification problems by applying a sigmoid function to the output of the original network. In addition, the loss function is changed to the focal loss, which deals with classification problems with an imbalanced data set (Lin et al., 2017). To incorporate station distance information into the network, Equation (4) in Liang et al. (2018) is implemented. The tunable parameter λ in Equation (4) is selected as 0.9 (Bishop, 2006; Liang et al., 2018). Here, a grid search of λ (step size of 0.1) from 0 to 1 is conducted to select the λ value that achieves the best performance in the validation set. Pi,j in Equation (4), defined as the correlation between station i and j, is set to the reciprocal of the geographical distance between these two stations. This setup follows the intuition that two nearby stations are more correlated than two stations that are far from each other.

3 DATA SET DESCRIPTION

In this work, we use the 2015 data set utilized in Wu & Liu (2021). A GNSS station equipped with a Septentrio PolaRx5S receiver located at Poker Flat, Alaska (65.1°N, 147.4° W) is used as the target station, which collects high-rate data, with 50 – Hz signal intensities and 100 – Hz phase measurements. The surrounding GNSS stations belong to the UNAVCO GNSS network, where the station ID is given next to the yellow icons in Figure 2 (Pritchard et al., 2012). More details can be found in https://kb.unavco.org/kb/article/unavco-resources-permanent-gps-gnss-stations-634.html.The external features are extracted from the National Aeronautics and Space Administration (NASA)/Goddard Space Flight Center (GSFC) OMNI data set through OMNIWeb (J. H. King & Papitashvili, 2005). Because the solar wind parameters in OMNI have been time-shifted to the Bow-shock nose, we process the data by shifting back in time to locate the data measured at Lagrange Point L1 (J. King & Papitashvili, n.d.). For the data set, occasionally missing values are interpolated, whereas data containing large numbers of consecutive missing values are discarded.

Historical measurements from the past 6 h with a time interval of 10 min (36 time steps) are used as features, and the forecasting lead time is 1 h. Measurements with a high sampling frequency (sampling intervals smaller than 10 min, i.e., S4, σϕ) are down-sampled, and measurements with low sampling frequency (sampling intervals greater than 10 min, i.e., sunspot number) are interpolated by propagating the last valid observation forward. The data set contains approximately 400,000 samples, where 13% of the samples are labeled as scintillation. Thus, this data set is an imbalanced data set, where a specific loss function known as the focal loss is utilized (discussed in Section 2.3). The first 70%, the next 10%, and the last 20% of data are used for training, validation, and testing, respectively.

4 PERFORMANCE EVALUATION

In this section, we first discuss the performance evaluation metrics, followed by a performance comparison against five baseline methods and an investigation of the importance of external features.

4.1 Evaluation Metrics

As discussed in Section 2.3, the STDL forecasts the probability of scintillation occurrence. To determine whether scintillation will occur, a threshold is applied. A comprehensive performance evaluation is conducted by varying the threshold from 0 to 1 with a step size of 10-5. For each threshold value, the STDL output for each sample test data set is converted to a binary label (scintillation/quiet time) based on a comparison with the threshold. The resulting labels are used as the forecasted labels for this threshold. The performance is then evaluated by comparing the forecasted labels with the truth.

Because our forecasting data set is imbalanced, the metric of accuracy can be misleading. Instead, we use the following metrics to evaluate the model performance, where positive samples denote scintillation:

  • Detection rate (recall/true positive rate): the proportion of actual positive samples that are correctly classified as positive.

  • False positive rate: the proportion of negative samples that are incorrectly classified as positive samples.

  • Precision (positive predictive value): the proportion of predicted positive samples that are actual positive samples.

For each threshold, a detection rate, a false positive rate, and a precision are obtained. A comprehensive performance evaluation is conducted by representing these three metrics for all thresholds on two curves: the receiver operating characteristic (ROC) curve and the precision–detection rate curve (Boyd et al., 2013; Brown & Davis, 2006). Both curves take the detection rate into consideration and show dependence on other metrics. The ROC curve focuses on the false positive rate, whereas the precision–detection rate curve emphasizes precision. A comprehensive performance evaluation is established based on analyses of both curves.

4.2 Performance Comparison

The STDL is evaluated using the data set discussed in Section 3. For comparison purposes, we also evaluate the forecasting performance of five baseline methods on the same data set. A grid search of hyperparameters of these models is conducted on the validation data set:

  • Naïve method: The method takes the scintillation labels for the previous 36 time steps and computes the percentage of positive outcomes. This percentage is denoted as the probability of occurrence of scintillation for the future time step. This method serves as a baseline benchmark for all other methods.

  • Logistic regression (LR) (Bishop, 2006): LR models the forecast label ŷ as a logistic sigmoid acting on a linear function of the feature vector x: ŷ = σ(wTx + b), where σ(·) is the sigmoid function defined as Embedded Image. Embedded Image and Embedded Image are the trainable weights and bias, respectively. Because LR only utilizes a feature vector, all features are concatenated to form this vector by ignoring the spatiotemporal information.

  • Gradient boosting decision tree (GBDT) (Friedman, 2002; Mason et al., 1999; Wu & Liu, 2021): A GBDT conducts the classification by combining several weak learners, where each learner is a decision tree. The GBDT is known to be one of the most effective machine learning algorithms for a variety of applications. Similar to LR, the input feature vector is obtained by concatenating all features.

  • FCNN (Bishop, 2006; Liu et al., 2019): The FCNN is a multilayer deep learning structure. Each layer consists of a linear mapping followed by nonlinear activation functions. Its input is the same feature vector that is used for LR. In contrast to LR and GBDT, nonlinearity is introduced in the model.

  • LSTM (Hochreiter & Schmidhuber, 1997): LSTM is a type of recurrent neural network designed to handle time-series data by preserving temporal information. All features at each time step are concatenated to form a feature vector and passed to LSTM.

To ensure a fair comparison against STDL, all baseline methods (except the naïve method) utilize the exact same features. The only difference lies in the way each model organizes these features. In addition, all baseline methods forecast the probability of scintillation occurrence rather than the binary scintillation label, which ensures that each method can produce both the ROC curve and the precision–detection rate curve.

ROC curves for all methods are shown in Figure 4. Here, a curve that is closer to the top left corner has a higher detection rate and a lower false positive rate, which indicates a better overall performance. The STDL achieves the best performance by adaptively incorporating both spatial and temporal information. The LR, GBDT, FCNN, and LSTM show slightly inferior performance compared with the STDL, as these four models are not capable of incorporating spatial information. Finally, the naïve method shows the worst performance, as it only utilizes historical scintillation labels and does not apply a machine learning model. The area under the curve (AUC), which is a metric used to quantify the overall performance of a model’s ROC curve by integrating the AUC, is also listed in the legend of Figure 4. This metric corroborates our observations that STDL has the best performance. It should be noted that the training time for STDL is at least three-fold greater than that of other methods, which is a tradeoff that must be considered in model selection.

FIGURE 4
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4

Performance comparison of ROC curves

Precision–detection rate curves are shown in Figure 5. Again, the STDL demonstrates the best overall performance. A precision improvement of approximately 5% over the second-best model can be observed near a detection rate of 70%.

FIGURE 5
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5

Performance comparison of precision–detection rate curves

It should be noted that this evaluation provides an overall picture of the performance across thresholds from 0 to 1. As mentioned in Section 2.3, the final threshold is usually determined by the application requirements.

4.3 Investigation on the Importance of External Features

STDL utilizes not only GNSS measurements, but also external features. An experiment with STDL excluding external features was conducted to study the effectiveness of utilizing external features. The ROC and precision–detection rate curves are shown in Figure 6 and Figure 7, respectively. The results demonstrate the importance of external features, where excluding these features leads to performance degradation. This degradation occurs because space-based observations, such as solar wind parameters, offer lead-time information. In addition, ground-based observations are drivers of scintillation occurrence. Inputting these observations into the model provides additional information that aids in the forecasting task.

FIGURE 6
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 6

Performance comparison of ROC curves between STDL with external features (STDL-w/Ext) and without external features (STDL-noExt)

FIGURE 7
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 7

Performance comparison of precision–detection rate curves between STDL with external features (STDL-w/Ext) and without external features (STDL-noExt)

5 CONCLUSIONS AND FUTURE WORK

In this work, an STDL network was presented to forecast GNSS phase scintillation at high latitudes. The STDL achieves the best performance by incorporating spatial and temporal information and external features obtained by space-based and ground-based instruments that measure solar wind parameters and geomagnetic field disturbances. Several future efforts can be pursued to improve the forecasting performance. First, the current method employs all available external features, which may impair the performance by including irrelevant features. By following the work in Wu & Liu (2021), only important features can be used to investigate whether a better performance can be achieved. In addition, measurements from GNSS receivers on low Earth orbit satellites can also be incorporated into the network to enhance the spatial resolution of the surrounding information. Finally, we are working on image-based representations of scintillation occurrence over an entire region, similar to the manner in which meteorological weather forecasting is conducted. This method offers continuous indicators for any user-specified locations within the region.

HOW TO CITE THIS ARTICLE

Liu, Y., Yang, Z., Morton, Y. J., & Li, R. (2023). Spatiotemporal deep learning network for high-latitude ionospheric phase scintillation forecasting. NAVIGATION, 70(4). https://doi.org/10.33012/navi.615

ACKNOWLEDGMENTS

This work is supported by a Defense Advanced Research Projects Agency (DARPA) contract (AWD-102938-G3) under the DARPA Space Environment Exploitation program. The data used in this study were collected at the global ionospheric scintillation monitoring network established by the Satellite Navigation and Sensing (SeNSe) Lab at the University of Colorado Boulder and the GNSS monitoring networks by UNAVCO. We acknowledge the use of NASA/GSFC’s Space Physics Data Facility’s OMNIWeb (or CDAWeb or ftp) service and OMNI data. In addition, we thank Professor William Bristow for providing the cross cap potential data.

Footnotes

  • ↵1 The definition of the scintillation label will be discussed in Section 2.1.

This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

REFERENCES

  1. ↵
    1. Bishop, C. M.
    (2006). Pattern recognition and machine learning. Springer.
  2. ↵
    1. Boyd, K.,
    2. Eng, K. H., &
    3. Page, C. D.
    (2013). Area under the precision-recall curve: Point estimates and confidence intervals. Proc. of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECMLPKDD 2013), Prague, Czech Republic, 451–466. https://doi.org/10.1007/978-3-642-40994-3_29
  3. ↵
    1. Breitsch, B.,
    2. Morton, Y. J.,
    3. Rino, C., &
    4. Xu, D.
    (2020). GNSS carrier phase cycle slips due to diffractive ionosphere scintillation: Simulation and characterization. IEEE Transactions on Aerospace and Electronic Systems 56(5), 3632–3644. https://doi.org/10.1109/TAES.2020.2979025
  4. ↵
    1. Brown, C. D., &
    2. Davis, H. T.
    (2006). Receiver operating characteristics curves and related decision measures: A tutorial. Chemometrics and Intelligent Laboratory Systems, 80(1), 24–38. https://doi.org/10.1016/j.chemolab.2005.05.004
    CrossRef
    1. Burke, D.
    (n.d.). Plasma beta (physics). https://en.wikipedia.org/wiki/Beta_(plasma_physics). Accessed: 2020-07-29
  5. ↵
    1. Carter, B. A.,
    2. Retterer, J. M.,
    3. Yizengaw, E.,
    4. Wiens, K.,
    5. Wing, S.,
    6. Groves, K.,
    7. Caton, R.,
    8. Bridgwood, C.,
    9. Francis, M.,
    10. Terkildsen, M.,
    11. Norman, R., &
    12. Zhang, K.
    (2014). Using solar wind data to predict daily GPS scintillation occurrence in the African and Asian low-latitude regions. Geophysical Research Letters, 41(23), 8176–8184. https://doi.org/10.1002/2014GL062203
  6. ↵
    1. Costa, E.,
    2. Roddy, P.,
    3. Wiens, K., &
    4. Valladares, C.
    (2011). Equatorial scintillation predictions from C/NOFS planar Langmuir probe electron density fluctuation data. Proc. of the XXXIth URSI General Assembly and Scientific Symposium, Beijing, China, 1–4. https://doi.org/10.1109/URSIGASS.2014.6929723
  7. ↵
    1. Cowley, S. W. H.
    (2000). Magnetosphere-ionosphere interactions: A tutorial review. Magnetospheric Current Systems, Geophysical Monograph Series, 118, 91–106. https://doi.org/10.1029/GM118p0091
  8. ↵
    1. de Lima, G. R. T.,
    2. Stephany, S.,
    3. de Paula, E. R.,
    4. Batista, I. S., &
    5. Abdu, M. A.
    (2015). Prediction of the level of ionospheric scintillation at equatorial latitudes in Brazil using a neural network. Space Weather, 13(8), 446–457. https://doi.org/10.1002/2015SW001182
  9. ↵
    1. Friedman, J. H.
    (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis, 38(4), 367–378. https://doi.org/10.1016/S0167-9473(01)00065-2
    1. Greenwald, R. A.,
    2. Baker, K. B.,
    3. Dudeney, J. R.,
    4. Pinnock, M.,
    5. Jones, T. B.,
    6. Thomas, E. C.,
    7. Villain, J. -P.,
    8. Cerisier, J. -C.,
    9. Senior, C.,
    10. Hanuise, R.,
    11. Hunsucker, R. D.,
    12. Sofko, G.,
    13. Koehler, J.,
    14. Nielsen, E.,
    15. Pellinen, R.,
    16. Walker, A. D. M.,
    17. Sato, N., &
    18. Yamagishi, H.
    (1995). Darn/-superDARN. Space Science Reviews, 71(1–4), 761–796. https://doi.org/10.1007/BF00751350
    CrossRef
  10. ↵
    1. Hochreiter, S., &
    2. Schmidhuber, J.
    (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
    CrossRefPubMed
  11. ↵
    1. Jensen, P. F.
    (2013). Analysis of methods for solar wind propagation from lagrangian point l1 to earth (Publication No. AAT 3573020 [Doctoral Thesis, University of Alaska Fairbanks]. ProQuest Dissertations and Theses. https://ui.adsabs.harvard.edu/abs/2013PhDT........72J/abstract
  12. ↵
    1. Jiao, Y., &
    2. Morton, Y. J.
    (2015). Comparison of the effect of high-latitude and equatorial ionospheric scintillation on GPS signals during the maximum of solar cycle 24. Radio Science, 50(9), 886–903. https://doi.org/10.1002/2015RS005719
  13. ↵
    1. Jiao, Y.,
    2. Morton, Y. J.,
    3. Taylor, S., &
    4. Pelgrum, W.
    (2013). Characterization of high-latitude ionospheric scintillation of GPS signals. Radio Science, 48(6), 698–708. https://doi.org/10.1002/2013RS005259
  14. ↵
    1. Jin, Y.,
    2. Moen, J. I., &
    3. Miloch, W. J.
    (2015). On the collocation of the cusp aurora and the GPS phase scintillation: A statistical study. Journal of Geophysical Research: Space Physics, 120(10), 9176–9191. https://doi.org/10.1002/2015JA021449
  15. ↵
    1. King, J., &
    2. Papitashvili, N.
    (n.d.). Time shifting of solar wind parameters. Retrieved from https://omniweb.gsfc.nasa.gov/html/HROdocum.html#3
  16. ↵
    1. King, J. H., &
    2. Papitashvili, N. E.
    (2005). Solar wind spatial scales in and comparisons of hourly wind and ace plasma and magnetic field data. Journal of Geophysical Research: Space Physics, 110(A2). https://doi.org/10.1029/2004JA010649
  17. ↵
    1. Kintner, P. M.,
    2. Ledvina, B. M., &
    3. De Paula, E. R.
    (2007). GPS and ionospheric scintillations. Space Weather, 5(9). https://doi.org/10.1029/2006SW000260
  18. ↵
    1. Lamb, K.,
    2. Malhotra, G.,
    3. Vlontzos, A.,
    4. Wagstaff, E.,
    5. Baydin, A. G.,
    6. Bhiwandiwalla, A.,
    7. Gal, Y.,
    8. Kalaitzis, A.,
    9. Reina, A., &
    10. Bhatt, A.
    (2019). Prediction of GNSS phase scintillations: A machine learning approach. arXiv preprint arXiv:1910.01570. https://doi.org/10.48550/arXiv.1910.01570
  19. ↵
    1. Liang, Y.,
    2. Ke, S.,
    3. Zhang, J.,
    4. Yi, X., &
    5. Zheng, Y.
    (2018). GeoMAN: Multi-level attention networks for geo-sensory time series prediction. Proc. of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018), Stockholm, Sweden, 3428–3434. https://doi.org/10.24963/ijcai.2018/476
  20. ↵
    1. Lin, T. -Y.,
    2. Goyal, P.,
    3. Girshick, R.,
    4. He, K., &
    5. Dollár, P.
    (2017). Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 42(2), 318–327. https://doi.org/10.1109/TPAMI.2018.2858826
  21. ↵
    1. Liu, Y.,
    2. Collett, I., &
    3. Morton, Y. J.
    (2019). Application of neural network to GNSS-R wind speed retrieval. IEEE Transactions on Geoscience and Remote Sensing, 57(12), 9756–9766. https://doi.org/10.1109/TGRS.2019.2929002
  22. ↵
    1. Liu, Y.,
    2. Morton, Y., &
    3. Jiao, Y. J.
    (2018). Application of machine learning to characterization of GPS l1 ionospheric amplitude scintillation. Proc. of the 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS), Monterey, CA, 1159–1166. https://doi.org/10.1109/PLANS.2018.8373500
  23. ↵
    1. Machol, J.,
    2. Snow, M.,
    3. Woodraska, D.,
    4. Woods, T.,
    5. Viereck, R., &
    6. Coddington, O.
    (2019). An improved lyman-alpha composite. Earth and Space Science, 6(12), 2263–2272. https://doi.org/10.1029/2019EA000648
  24. ↵
    1. Mandea, M., &
    2. Korte, M.
    (2010). Geomagnetic observations and models (Vol. 5). Springer. https://doi.org/10.1007/978-90-481-9858-0
  25. ↵
    1. Mason, L.,
    2. Baxter, J.,
    3. Bartlett, P., &
    4. Frean, M.
    (1999). Boosting algorithms as gradient descent in function space. Proc. of the Advances in Neural Information Processing Systems 12 (NIPS 1999), Denver, CO, Vol. 12, 512–518. https://papers.nips.cc/paper_files/paper/1999/file/96a93ba89a5b5c6c226e49b88973f46e-Paper.pdf
  26. ↵
    1. McCaffrey, A. M., &
    2. Jayachandran, P. T.
    (2019). Determination of the refractive contribution to GPS phase “scintillation.” Journal of Geophysical Research: Space Physics, 124(2), 1454–1469. https://doi.org/10.1029/2018JA025759
  27. ↵
    1. McCaffrey, A. M.,
    2. Jayachandran, P. T.,
    3. Langley, R. B., &
    4. Sleewaegen, J. -M.
    (2018). On the accuracy of the GPS l2 observable for ionospheric monitoring. GPS Solutions, 22(1), 23. https://doi.org/10.1007/s10291-017-0688-4
  28. ↵
    1. McGranaghan, R. M.,
    2. Mannucci, A. J.,
    3. Wilson, B.,
    4. Mattmann, C. A., &
    5. Chadwick, R.
    (2018). New capabilities for prediction of high-latitude ionospheric scintillation: A novel approach with machine learning. Space Weather, 16(11), 1817–1846. https://doi.org/10.1029/2018SW002018
  29. ↵
    1. Morton, Y. J.,
    2. van Diggelen, F.,
    3. Spilker Jr, J. J.,
    4. Parkinson, B. W.,
    5. Lo, S., &
    6. Gao, G.
    (2021). Position, navigation, and timing technologies in the 21st century: Integrated satellite navigation, sensor systems, and civil applications. John Wiley & Sons. https://doi.org/10.1002/9781119458449
    1. Papitashvili, N.
    (n.d.). Electric field derivation. Accessed: 2020-07-29. https://omniweb.gsfc.nasa.gov/html/omni_min_data.html.
  30. ↵
    1. Pi, X.,
    2. Mannucci, A. J.,
    3. Lindqwister, U. J., &
    4. Ho, C. M.
    (1997). Monitoring of global ionospheric irregularities using the worldwide GPS network. Geophysical Research Letters, 24(18), 2283–2286. https://doi.org/10.1029/97GL02273
  31. ↵
    1. Prikryl, P.,
    2. Jayachandran, P. T.,
    3. Mushini, S. C., &
    4. Richardson, I. G.
    (2012). Toward the probabilistic forecasting of high-latitude GPS phase scintillation. Space Weather, 10(8), 1–16. https://doi.org/10.1029/2012SW000800
  32. ↵
    1. Prikryl, P.,
    2. Jayachandran, P. T.,
    3. Mushini, S. C., &
    4. Richardson, I. G.
    (2014). High-latitude GPS phase scintillation and cycle slips during high-speed solar wind streams and interplanetary coronal mass ejections: A superposed epoch analysis. Earth, Planets and Space, 66(1), 62. https://doi.org/10.1186/1880-5981-66-62
  33. ↵
    1. Prikryl, P.,
    2. Sreeja, V.,
    3. Aquino, M., &
    4. Jayachandran, P. T.
    (2013). Probabilistic forecasting of ionospheric scintillation and GNSS receiver signal tracking performance at high latitudes. Annals of Geophysics, 56(2), 0222. https://doi.org/10.4401/ag-6219
  34. ↵
    1. Pritchard, M.,
    2. Owen, S.,
    3. Anandakrishnan, S.,
    4. Holt, W.,
    5. Bennett, R.,
    6. La Femina, P.,
    7. Jansma, P.,
    8. MacGregor, I.,
    9. Raymond, C.,
    10. Schwartz, S.,
    11. Stein, S., &
    12. Miller, M.
    (2012). Open access to geophysical data sets requires community responsibility. Eos, Transactions American Geophysical Union, 93(26), 243–243. https://doi.org/10.1029/2012EO260006
  35. ↵
    1. Rezende, L. F. C.,
    2. de Paula, E. R.,
    3. Stephany, S.,
    4. Kantor, I. J.,
    5. Muella, M. T. A. H.,
    6. de Siqueira, P. M., &
    7. Correa, K. S.
    (2010). Survey and prediction of the ionospheric scintillation using data mining techniques. Space Weather, 8(6). https://doi.org/10.1029/2009SW000532
  36. ↵
    1. Secan, J. A.,
    2. Bussey, R. M.,
    3. Fremouw, E. J., &
    4. Basu, S.
    (1995). An improved model of equatorial scintillation. Radio Science, 30(3), 607–617. https://doi.org/10.1029/94RS03172
  37. ↵
    1. Secan, J. A.,
    2. Bussey, R. M.,
    3. Fremouw, E. J., &
    4. Basu, S.
    (1997). High-latitude upgrade to the wideband ionospheric scintillation model. Radio Science, 32(4), 1567–1574. https://doi.org/10.1029/97RS00453
  38. ↵
    1. Taabu, S. D.,
    2. D’ujanga, F. M., &
    3. Ssenyonga, T.
    (2016). Prediction of ionospheric scintillation using neural network over East African region during ascending phase of sunspot cycle 24. Advances in Space Research, 57(7), 1570–1584. https://doi.org/10.1016/j.asr.2016.01.014
    1. Tapping, K. F.
    (2013). The 10.7 cm solar radio flux (f10. 7). Space Weather, 11(7), 394–406. https://doi.org/10.1002/swe.20064
  39. ↵
    1. Vaswani, A.,
    2. Shazeer, N.,
    3. Parmar, N.,
    4. Uszkoreit, J.,
    5. Jones, L.,
    6. Gomez, A. N.,
    7. Kaiser, L., &
    8. Polosukhin, I.
    (2017). Attention is all you need. Proc. of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, 5998–6008. https://doi.org/10.48550/arXiv.1706.03762
  40. ↵
    1. Wang, J.,
    2. Morton, Y. J., &
    3. Hampton, D.
    (2018). New results on ionospheric irregularity drift velocity estimation using multi-GNSS spaced-receiver array during high-latitude phase scintillation. Radio Science, 53(2), 228–240. https://doi.org/10.1002/2017RS006470
  41. ↵
    1. Wernik, A. W.,
    2. Secan, J. A., &
    3. Fremouw, E. J.
    (2003). Ionospheric irregularities and scintillation. Advances in Space Research, 31(4), 971–981. https://doi.org/10.1016/S0273-1177(02)00795-0
  42. ↵
    1. Wu, A. J., &
    2. Liu, Y.
    (2021). Machine learning-based investigation of feature importance for high-latitude ionospheric scintillation forecasting. Proc. of the 2021 International Technical Meeting of the Institute of Navigation, 637–647. https://doi.org/10.33012/2021.17855
  43. ↵
    1. Yang, R.,
    2. Xu, D., &
    3. Morton, Y. J.
    (2019). Generalized multifrequency GPS carrier tracking architecture: Design and performance analysis. IEEE Transactions on Aerospace and Electronic Systems. https://doi.org/10.1109/TAES.2019.2948535
  44. ↵
    1. Yang, Z., &
    2. Liu, Z.
    (2016). Observational study of ionospheric irregularities and GPS scintillations associated with the 2012 tropical cyclone Tembin passing Hong Kong. Journal of Geophysical Research: Space Physics, 121(5), 4705–4717. https://doi.org/10.1002/2016JA022398
  45. ↵
    1. Yang, Z., &
    2. Liu, Z.
    (2018). Low-latitude ionospheric density irregularities and associated scintillations investigated by combining COSMIC RO and ground-based global positioning system observations over a solar active period. Journal of Geophysical Research: Space Physics, 123(5), 3998–4014. https://doi.org/10.1029/2017JA024199
  46. ↵
    1. Yang, Z., &
    2. Morton, Y. J.
    (2020). Low-latitude GNSS ionospheric scintillation dependence on magnetic field orientation and impacts on positioning. Journal of Geodesy, 94(6), 1–15. https://doi.org/10.1007/s00190-020-01391-7
  47. ↵
    1. Yang, Z.,
    2. Morton, Y. J.,
    3. Zakharenkova, I.,
    4. Cherniak, I.,
    5. Song, S., &
    6. Li, W.
    (2020). Global view of ionospheric disturbance impacts on kinematic GPS positioning solutions during the 2015 St. Patrick’s Day storm. Journal of Geophysical Research: Space Physics, 125(7), e2019JA027681. https://doi.org/10.1029/2019JA027681
PreviousNext
Back to top

In this issue

NAVIGATION: Journal of the Institute of Navigation: 70 (4)
NAVIGATION: Journal of the Institute of Navigation
Vol. 70, Issue 4
Winter 2023
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on NAVIGATION: Journal of the Institute of Navigation.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Spatiotemporal Deep Learning Network for High-Latitude Ionospheric Phase Scintillation Forecasting
(Your Name) has sent you a message from NAVIGATION: Journal of the Institute of Navigation
(Your Name) thought you would like to see the NAVIGATION: Journal of the Institute of Navigation web site.
Citation Tools
Spatiotemporal Deep Learning Network for High-Latitude Ionospheric Phase Scintillation Forecasting
Yunxiang Liu, Zhe Yang, Y. Jade Morton,, Ruoyu Li
NAVIGATION: Journal of the Institute of Navigation Dec 2023, 70 (4) navi.615; DOI: 10.33012/navi.615

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Spatiotemporal Deep Learning Network for High-Latitude Ionospheric Phase Scintillation Forecasting
Yunxiang Liu, Zhe Yang, Y. Jade Morton,, Ruoyu Li
NAVIGATION: Journal of the Institute of Navigation Dec 2023, 70 (4) navi.615; DOI: 10.33012/navi.615
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Abstract
    • 1 INTRODUCTION
    • 2 METHODOLOGY
    • 3 DATA SET DESCRIPTION
    • 4 PERFORMANCE EVALUATION
    • 5 CONCLUSIONS AND FUTURE WORK
    • HOW TO CITE THIS ARTICLE
    • ACKNOWLEDGMENTS
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • References
  • Info & Metrics
  • PDF

Related Articles

  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • ATLAS: Orbit Determination and Time Transfer for a Lunar Radio Navigation System
  • GNSS L5/E5a Code Properties in the Presence of a Blanker
  • Robust Interference Mitigation in GNSS Snapshot Receivers
Show more Original Article

Similar Articles

Keywords

  • forecast
  • ionospheric phase scintillation
  • machine learning

Unless otherwise noted, NAVIGATION content is licensed under a Creative Commons CC BY 4.0 License.

© 2025 The Institute of Navigation, Inc.

Powered by HighWire