Skip to main content

Main menu

  • Home
  • Current Issue
  • Archive
  • About Us
    • About NAVIGATION
    • Editorial Board
    • Peer Review Statement
    • Open Access
  • More
    • Email Alerts
    • Info for Authors
    • Info for Subscribers
  • Other Publications
    • ion

User menu

  • My alerts

Search

  • Advanced search
NAVIGATION: Journal of the Institute of Navigation
  • Other Publications
    • ion
  • My alerts
NAVIGATION: Journal of the Institute of Navigation

Advanced Search

  • Home
  • Current Issue
  • Archive
  • About Us
    • About NAVIGATION
    • Editorial Board
    • Peer Review Statement
    • Open Access
  • More
    • Email Alerts
    • Info for Authors
    • Info for Subscribers
  • Follow ion on Twitter
  • Visit ion on Facebook
  • Follow ion on Instagram
  • Visit ion on YouTube
Research ArticleOriginal Article
Open Access

Improved Automatic Detection of GPS Satellite Oscillator Anomaly using a Machine Learning Algorithm

Yunxiang Liu, and Y. Jade Morton
NAVIGATION: Journal of the Institute of Navigation March 2022, 69 (1) navi.500; DOI: https://doi.org/10.33012/navi.500
Yunxiang Liu,
Smead Aerospace Engineering Sciences Department, University of Colorado, Boulder Boulder, CO, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: [email protected]
Y. Jade Morton
Smead Aerospace Engineering Sciences Department, University of Colorado, Boulder Boulder, CO, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • References
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Additional Files
  • FIGURE 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 1

    Satellite oscillator anomaly detection block diagram

  • FIGURE 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 2

    Illustration of a decision tree for a three-class classification task

  • FIGURE 3
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 3

    Illustration of the random forest structure consisting of many decision trees, in which each decision tree makes its classification independently. A majority vote is employed to obtain the final predicted label

  • FIGURE 4
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 4

    Scatterplot of L1 vs. L2 phase deviations; an example of oscillator anomalies is shown as black circles; the ratio of phase deviations for each oscillator anomaly event is Embedded Image black line); an example of scintillation is shown as red crosses. The ratio of phase deviation for a scintillation event is approximately Embedded Image red line). From Liu and Morton (2020b)

  • FIGURE 5
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 5

    Illustration of feature importance of the random-forest algorithm. The top 12 most important features are presented. In this example, the random forest is trained using Feature Set #3 with triple-frequency signals.

  • FIGURE 6
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 6

    Comparison of the distributions of L1 maximum phase deviation between random forest and SVM-RBF SVM. The curves above are obtained by the distribution fit to the histograms

  • FIGURE 7
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 7

    A satellite oscillator anomaly that is simultaneously observed by four stations (Alaska, South Korea, Greenland, and Puerto Rico). The anomaly occurred at 6:39 AM, on May 23, 2018 UTC for PRN 10, which is over Pacific Ocean, close to the US coast at that time

  • FIGURE 8
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 8

    Satellite-wise average number of detected satellite oscillator anomaly events per visible day at each station. PRNs are sorted by launch time (PRN 17 is the oldest satellite). Red PRN numbers refer to GPS Block IIRM and blue PRN numbers refer to GPS Block IIF. The anomalies are detected by the random-forest algorithm.

  • FIGURE 9
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 9

    Satellite oscillator anomaly daily occurrence over Greenland. a) PRN 1; b) PRN 10. The anomalies are detected by the random-forest method.

Tables

  • Figures
  • Additional Files
    • View popup
    TABLE 1

    The mean and standard deviation (SD) of the detection accuracy of the random forest algorithm. A total of 10 different training/testing splits were used. The best performances are highlighted in bold.

    Random Forest
    AlgorithmDual-frequencyTriple-frequency
    Feature set #123123
    AccuracyMean93.6%93.2%98.4%92.9%96.5%99.0%
    SD1.1%1.0%0.4%1.0%1.1%0.5%
    • View popup
    TABLE 2

    Performance evaluation of the random forest using Feature Set #3. Ten different training/testing splits are used. The mean and standard deviation (SD) of the metrics are shown. FPR, TPR, and PPV denote false positive rate, true positive rate, and positive predictive value, respectively.

    Random Forest
    AlgorithmDualTriple
    AccuracyMean98.4%99.0%
    SD0.4%0.5%
    FPR (False Alarm)Mean0.5%0.4%
    SD0.3%0.2%
    TPR (Recall)Mean95.5%97.6%
    SD2.4%2.9%
    PPV (Precision)Mean97.7%98.0%
    SD1.4%0.9%
    F1 scoreMean96.5%97.8%
    SD1.2%1.6%
    • View popup
    TABLE 3

    Performance comparison between the random-forest algorithm, logistic regression, linear SVM, decision tree, neural network, RBF SVM, and SVM-RBF SVM. Ten different training/testing splits are used. The mean of the metrics is shown. FPR denotes false positive rate; TPR denotes true positive rate; PPV denotes positive predictive value. Dual and triple denotes dual- and triple-frequency signals.

    AlgorithmLogistic RegressionLinear SVMDecision TreeNeural NetworkRBF SVMSVM-RBF SVMRandom Forest
    AccuracyDual94.0%95.9%96.8%96.5%97.8%93.3%98.4%
    Triple96.4%97.7%96.0%98.8%99.0%93.5%99.0%
    FPR (False Alarm)Dual2.6%2.1%1.6%2.1%1.1%0.4%0.5%
    Triple0.6%0.5%0.7%1.0%0.8%0.3%0.5%
    TPR (recall)Dual86.8%92.8%94.8%93.6%96.8%75.9%95.5%
    Triple95.0%98.8%96.1%98.0%99.1%77.0%97.6%
    PPV (precision)Dual87.2%89.7%92.1%89.8%94.7%97.4%97.7%
    Triple94.5%95.0%96.4%95.2%96.2%98.2%98.0%
    F1 scoreDual86.9%91.2%93.3%91.6%95.7%85.3%96.5%
    Triple94.7%96.8%96.2%96.6%97.6%86.3%97.8%
    • View popup
    TABLE 4

    Summary of data availability

    LocationCoordinatesDateNumber of Days AvailablePercentage of Availability
    Greenland67.0°N, 50.9°W01-2018 to 05-201814697%
    Alaska65.1°N, 147.4°W01-2018 to 10-201823878%
    South Korea37.4°N, 126.9°E05-2018 to 07-20185054%
    Puerto Rico18.3°N, 66.8°W01-2018 to 12-201832188%
    Chile30.1°S, 71.1°W01-2017 to 07-20176531%
    • View popup
    TABLE 5

    Comparison of station-wise statistics of detected satellite oscillator anomaly events on GPS Block IIRM and Block IIF satellites

    Station LocationNumber of Days AvailableNumber of Detected Oscillator AnomalyAverage Number Per Day
    SVM-RBF SVMRandom ForestSVM-RBF SVMRandom Forest
    Greenland1463065,3322.136.6
    Alaska23882111,7263.449.6
    South Korea50991,9412.038.9
    Puerto Rico32178410,7932.434.3
    Chile651132,2311.734.3
    • View popup
    TABLE 6

    Satellite Oscillator Anomalies Observed by Multiple Stations in 2018. Stations include Greenland, Alaska, South Korea, and Puerto Rico.

    Number of AnomaliesNumber of Detected Events
    Observed by Two Stations5,3852 × 5,385
    Observed by Three Stations1,0853 × 1,085
    Observed by Four Stations54 × 5
    All6,47514,045

Additional Files

  • Figures
  • Tables
  • Video Abstract

PreviousNext
Back to top

In this issue

NAVIGATION: Journal of the Institute of Navigation: 69 (1)
NAVIGATION: Journal of the Institute of Navigation
Vol. 69, Issue 1
Spring 2022
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on NAVIGATION: Journal of the Institute of Navigation.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Improved Automatic Detection of GPS Satellite Oscillator Anomaly using a Machine Learning Algorithm
(Your Name) has sent you a message from NAVIGATION: Journal of the Institute of Navigation
(Your Name) thought you would like to see the NAVIGATION: Journal of the Institute of Navigation web site.
Citation Tools
Improved Automatic Detection of GPS Satellite Oscillator Anomaly using a Machine Learning Algorithm
Yunxiang Liu,, Y. Jade Morton
NAVIGATION: Journal of the Institute of Navigation Mar 2022, 69 (1) navi.500; DOI: 10.33012/navi.500

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Improved Automatic Detection of GPS Satellite Oscillator Anomaly using a Machine Learning Algorithm
Yunxiang Liu,, Y. Jade Morton
NAVIGATION: Journal of the Institute of Navigation Mar 2022, 69 (1) navi.500; DOI: 10.33012/navi.500
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Abstract
    • 1 INTRODUCTION
    • 2 METHODOLOGY
    • 3 DATA SET DESCRIPTION AND PERFORMANCE EVALUATION
    • 4 DETECTION RESULTS
    • 5 CONCLUSION AND FUTURE WORK
    • HOW TO CITE THIS ARTICLE
    • ACKNOWLEDGMENTS
    • REFERENCES
  • Figures & Data
  • Supplemental
  • References
  • Info & Metrics
  • PDF

Related Articles

  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Thirty Years of Maintaining WGS 84 with GPS
  • Doppler Positioning Using Multi-Constellation LEO Satellite Broadband Signals as Signals of Opportunity
  • Federated Learning of Jamming Classifiers: From Global to Personalized Models
Show more Original Article

Similar Articles

Keywords

  • global monitoring system
  • GPS
  • machine learning
  • phase scintillation
  • random forest
  • satellite oscillator anomaly
  • signal quality monitoring
  • support vector machine

Unless otherwise noted, NAVIGATION content is licensed under a Creative Commons CC BY 4.0 License.

© 2025 The Institute of Navigation, Inc.

Powered by HighWire