Research ArticleOriginal Article
Open Access

Robust GPS-Vision Localization via Integrity-Driven Landmark Attention

Sriramya Bhamidipati, and Grace Gao
NAVIGATION: Journal of the Institute of Navigation March 2022, 69 (1) navi.501; DOI: https://doi.org/10.33012/navi.501

REFERENCES

  1. ↵
    1. Al Hage, J.,
    2. Xu, P., &
    3. Bonnifait, P.
    (2018). Bounding localization errors with student distribution for road vehicles. International Technical Symposium on Navigation and Timing, Toulouse, France. https://www.doi.org/10.31701/itsnt2018.11
  2. ↵
    1. Al Hage, J.,
    2. Xu, P.,
    3. Bonnifait, P., &
    4. Ibanez-Guzman, J.
    (2020). Localization integrity for intelligent vehicles through fault detection and position error characterization. IEEE Transactions on Intelligent Transportation Systems, 1–13. https://www.doi.org/10.1109/tits.2020.3027433
  3. ↵
    1. Althoff, M.
    (2016). CORA 2016 manual. Technische Universität München.
  4. ↵
    1. Althoff, M., &
    2. Dolan, J. M.
    (2014). Online verification of automated road vehicles using reachability analysis. IEEE Transactions on Robotics, 30(4), 903–918. https://www.doi.org/10.1109/tro.2014.2312453
  5. ↵
    1. Althoff, M.,
    2. Stursberg, O., &
    3. Buss, M.
    (2009). Safety assessment for stochastic linear systems using enclosing hulls of probability density functions. 2009 European Control Conference (ECC), Budapest, Hungary. https://www.doi.org/10.23919/ecc.2009.7074473
  6. ↵
    1. Angus, J. E.
    (2006). RAIM with multiple faults. NAVIGATION, 53(4), 249–257. https://www.doi.org/10.1002/j.2161-4296.2006.tb00387.x
  7. ↵
    1. August, E.,
    2. Lu, J., &
    3. Koeppl, H.
    (2012). Trajectory enclosures for nonlinear systems with uncertain initial conditions and parameters. 2012 American Control Conference (ACC), Montreal, QC. https://www.doi.org/10.1109/acc.2012.6314741
  8. ↵
    1. Bhamidipati, S., &
    2. Gao, G. X.
    (2018). Multiple GPS fault detection and isolation using a Graph-SLAM framework. Proc. of the 31st International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2018), Miami, FL. https://www.doi.org/10.33012/2018.16030
  9. ↵
    1. Bhamidipati, S. &
    2. Gao, G. X.
    (2019). Distributed cooperative SLAM-based integrity monitoring via a network of receivers. Proc. of the 32nd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2019), Miami, FL, 2023–2034. https://www.doi.org/10.33012/2019.16882
  10. ↵
    1. Bhamidipati, S., &
    2. Gao, G. X.
    (2020a). Integrity monitoring of Graph-SLAM using GPS and fish-eye camera. NAVIGATION, 67(3), 583–600. https://www.doi.org/10.1002/navi.381
  11. ↵
    1. Bhamidipati, S., &
    2. Gao, G. X.
    (2020b). Integrity-driven landmark attention for GPS-vision navigation via stochastic reachability. Proc. of the 33rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2020), 2311–2326. https://www.doi.org/10.33012/2020.17546
  12. ↵
    1. Bhamidipati, S.,
    2. Kim, K. J.,
    3. Sun, H., &
    4. Orlik, P. V.
    (2019). GPS spoofing detection and mitigation in PMUs using distributed multiple directional antennas. 2019 IEEE International Conference on Communications (ICC), Shanghai, China. https://www.doi.org/10.1109/icc.2019.8761208
  13. ↵
    1. Binjammaz, T.,
    2. Al-Bayatti, A., &
    3. Al-Hargan, A.
    (2013) GPS integrity monitoring for an intelligent transport system. 2013 10th Workshop on Positioning, Navigation and Communication (WPNC), Dresden, Germany. https://www.doi.org/10.1109/wpnc.2013.6533268
  14. ↵
    1. Boyd, S., &
    2. Vandenberghe, L.
    (2004). Convex optimization. Cambridge University Press. https://www.doi.org/10.1017/cbo9780511804441.005
  15. ↵
    1. Cadena, C.,
    2. Carlone, L.,
    3. Carrillo, H.,
    4. Latif, Y.,
    5. Scaramuzza, D.,
    6. Neira, J.,
    7. Reid, I., &
    8. Leonard, J. J.
    (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309–1332. https://www.doi.org/10.1109/tro.2016.2624754
  16. ↵
    1. Caduff, D., &
    2. Timpf, S.
    (2008). On the assessment of landmark salience for human navigation. Cognitive Processing, 9(4), 249–267. https://www.doi.org/10.1007/s10339-007-0199-2
  17. ↵
    1. Carlone, L., &
    2. Karaman, S.
    (2017). Attention and anticipation in fast visual-inertial navigation. 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore. https://www.doi.org/10.1109/icra.2017.7989448
  18. ↵
    1. Chen, X.,
    2. Hu, W.,
    3. Zhang, L.,
    4. Shi, Z., &
    5. Li, M.
    (2018). Integration of low-cost GNSS and monocular cameras for simultaneous localization and mapping. Sensors, 18(7). https://doi.org/10.3390/s18072193
  19. ↵
    1. Chlamtac, E., &
    2. Tulsiani, M.
    (2012) Convex relaxations and integrality gaps. In M. F. Anjos & J. B. Lasserre (Eds.), Handbook on Semidefinite, Conic and Polynomial Optimization (pp. 139–169). Springer. https://www.doi.org/10.1007/978-1-4614-0769-0_6
  20. ↵
    1. Ebinuma, T.
    (2020). GPS-SDR-SIM. Github. https://github.com/osqzss/gps-sdr-sim
  21. ↵
    1. El-Mowafy, A., &
    2. Kubo, N.
    (2017). Integrity monitoring of vehicle positioning in urban environment using RTK-GNSS, IMU and speedometer. Measurement Science and Technology, 28(5). https://www.doi.org/10.1088/1361-6501/aa5c66
  22. ↵
    1. Engel, J.,
    2. Koltun, V., &
    3. Cremers, D.
    (2018). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625. https://www.doi.org/10.1109/tpami.2017.2658577
  23. ↵
    1. Engel, J.,
    2. Schöps, T., &
    3. Cremers, D.
    (2014). LSD-SLAM: Large-scale direct monocular SLAM. In D. Fleet, T. Pajdla, B. Schiele, & T. Tuytelaars (Eds.), Computer Vision – ECCV 2014 (pp. 834–849). Springer. https://www.doi.org/10.1007/978-3-319-10605-2_54
  24. ↵
    1. Engel, J.,
    2. Usenko, V., &
    3. Cremers, D.
    (2016). A photometrically calibrated benchmark for monocular visual odometry.
  25. ↵
    1. Forster, C.,
    2. Pizzoli, M., &
    3. Scaramuzza, D.
    (2014). SVO: Fast semi-direct monocular visual odometry. 2014 IEEE international Conference on Robotics and Automation (ICRA), Hong Kong, China. https://www.doi.org/10.1109/icra.2014.6906584
  26. ↵
    1. Ghinamo, G.,
    2. Boiero, G.,
    3. Lovisolo, P.,
    4. Dalla Torre, A., &
    5. Detoma, E.
    (2010). Hybrid fault detection technique in assisted GNSS. IEEE/ION Position, Location and Navigation Symposium, Indian Wells, CA. https://www.doi.org/10.1109/plans.2010.5507262
  27. ↵
    1. Gil, A.,
    2. Reinoso, O.,
    3. Mozos, O. M.,
    4. Stachniss, C., &
    5. Burgard, W.
    (2006). Improving data association in vision-based SLAM. 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China. https://www.doi.org/10.1109/iros.2006.282483
  28. ↵
    1. Grant, M., &
    2. Boyd, S.
    (2014). CVX: Matlab software for disciplined convex programming (version 2.1). http://cvxr.com/cvx
  29. ↵
    1. Gupta, S. &
    2. Gao, G. X.
    (2019). Particle RAIM for Integrity Monitoring. Proc. of the 32nd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2019), Miami, FL, 811–826. https://www.doi.org/10.33012/2019.16939
  30. ↵
    1. Heredia, G.,
    2. Caballero, F.,
    3. Maza, I.,
    4. Merino, L.,
    5. Viguria, A., &
    6. Ollero, A.
    (2009). Multi-unmanned aerial vehicle (UAV) cooperative fault detection employing differential global positioning (DGPS), inertial and vision sensors. Sensors, 9(9), 7566–7579. https://www.doi.org/10.3390/s90907566
  31. ↵
    1. Hsu, L.-T.,
    2. Tokura, H.,
    3. Kubo, N.,
    4. Gu, Y., &
    5. Kamijo, S.
    (2017). Multiple faulty GNSS measurement exclusion based on consistency check in urban canyons. IEEE Sensors Journal, 17(6), 1909–1917. https://www.doi.org/10.1109/jsen.2017.2654359
  32. ↵
    1. Huber, P. J.
    (2004). Robust statistics. John Wiley & Sons. https://www.doi.org/10.1002/0471725250
  33. ↵
    1. Joerger, M.,
    2. Arana, G. D.,
    3. Spenko, M., &
    4. Pervan, B.
    (2017). Landmark data selection and unmapped obstacle detection in lidar-based navigation. Proc. of the 30th International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2017), Portland, OR, 1886–1903. https://www.doi.org/10.33012/2017.15406
  34. ↵
    1. Joerger, M.,
    2. Chan, F.-C., &
    3. Pervan, B.
    (2014). Solution separation versus residual-based RAIM. NAVIGATION, 61(4), 273–291. https://www.doi.org/10.1002/navi.71
  35. ↵
    1. Joerger, M., &
    2. Spenko, M.
    (2017). Towards navigation safety for autonomous cars. Inside GNSS. https://insidegnss.com/towards-navigation-safety-for-autonomous-cars
  36. ↵
    1. Joshi, S., &
    2. Boyd, S.
    (2009). Sensor selection via convex optimization. IEEE Transactions on Signal Processing, 57(2), 451–462. https://www.doi.org/10.1109/tsp.2008.2007095
  37. ↵
    1. Kaddour, M.,
    2. El Najjar, M. E.,
    3. Naja, Z.,
    4. Tmazirte, N. A., &
    5. Moubayed, N.
    (2015). Fault detection and exclusion for GNSS measurements using observations projection on information space. 2015 Fifth International Conference on Digital Information and Communication Technology and its Applications (DICTAP), Beirut, Lebanon. https://www.doi.org/10.1109/DICTAP.2015.7113199
  38. ↵
    1. Larson, J. D.,
    2. Gebre-Egziabher, D., &
    3. Rife, J. H.
    (2019). Gaussian-Pareto overbounding of DGNSS pseudoranges from CORS. NAVIGATION, 66(1), 139–150. https://www.doi.org/10.1002/navi.276
  39. ↵
    1. Le Guernic, C., &
    2. Girard, A.
    (2010). Reachability analysis of linear systems using support functions. Nonlinear Analysis: Hybrid Systems, 4(2), 250–262. https://doi.org/10.1016/j.nahs.2009.03.002
  40. ↵
    1. Lerner, R.,
    2. Rivlin, E., &
    3. Shimshoni, I.
    (2007). Landmark selection for task-oriented navigation. IEEE Transactions on Robotics, 23(3), 494–505. https://www.doi.org/10.1109/tro.2007.895070
  41. ↵
    1. Li, F.,
    2. Bonnifait, P.,
    3. Ibanez-Guzman, J., &
    4. Zinoune, C.
    (2017). Lane-level map-matching with integrity on high-definition maps. 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA. https://www.doi.org/10.1109/ivs.2017.7995872
  42. ↵
    1. Li, A.,
    2. Wu, Y.,
    3. Xia, X.,
    4. Huang, Y.,
    5. Feng, C., &
    6. Zheng, Z.
    (2015). Computational method for correcting complex optical distortion based on FOV division. Applied Optics, 54(9), 2441–2449. https://www.doi.org/10.1364/ao.54.002441
    1. Lourakis, M. I. A.
    (2005). A brief description of the Levenberg-Marquardt algorithm implemented by levmar. Foundation of Research and Technology, 4(1), 1–6. https://www.researchgate.net/publication/239328019_A_Brief_Description_of_the_Levenberg-Marquardt_Algorithm_Implemened_by_levmar
  44. ↵
    1. Maaref, M., &
    2. Kassas, Z. M.
    (2019). UAV integrity monitoring measure improvement using terrestrial signals of opportunity. Proc. of the 32nd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2019), Miami, FL, 3045–3056. https://www.doi.org/10.33012/2019.17009
  45. ↵
    1. Maaref, M.,
    2. Khalife, J., &
    3. Kassas, Z. M.
    (2020). Enhanced safety of autonomous driving by incorporating terrestrial signals of opportunity. 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain. https://www.doi.org/10.1109/icassp40776.2020.9053017
  46. ↵
    1. Misra, P. &
    2. Enge, P.
    (2006) Global positioning system: Signals, measurements, and performance (2nd ed.). Ganga-Jamuna Press.
  47. ↵
    1. Mohanty, A.,
    2. Gupta, S., &
    3. Gao, G. X.
    (2020). A particle filtering framework for integrity risk of GNSS-camera sensor fusion. Proc. of the 33rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2020), 2440–2452. https://www.doi.org/10.33012/2020.17660
  48. ↵
    1. Mousavi, H. K. &
    2. Motee, N.
    (2020). Estimation with fast feature selection in robot visual navigation. IEEE Robotics and Automation Letters, 5(2), 3572–3579. https://www.doi.org/10.1109/lra.2020.2974654
  49. ↵
    1. Nuñez, J. R.,
    2. Anderton, C. R., &
    3. Renslow, R. S.
    (2018). Optimizing colormaps with consideration for color vision deficiency to enable accurate interpretation of scientific data. PloS ONE, 13(7). https://www.doi.org/10.1371/journal.pone.0199239
  50. ↵
    1. Ochieng, W. Y.,
    2. Sauer, K.,
    3. Walsh, D.,
    4. Brodin, G.,
    5. Griffin, S., &
    6. Denney, M.
    (2003). GPS integrity and potential impact on aviation safety. The Journal of Navigation, 56(1), 51–65. https://www.doi.org/10.1017/s0373463302002096
  51. ↵
    1. Oldham, K. B.,
    2. Myland, J. C., &
    3. Spanier, J.
    (2009). The error function erf (x) and its complement erfc (x). In An Atlas of Functions (pp. 405–415). Springer. https://doi.org/10.1007/978-0-387-48807-3_41
  52. ↵
    1. Paul, K.
    (2020). Soft GNSS. Github. https://github.com/kristianpaul/SoftGNSS
  53. ↵
    1. Phelts, R. E., &
    2. Enge, P.
    (2000). Multipath mitigation for narrowband receivers. IEEE 2000 Position, Location and Navigation Symposium, San Diego, CA. https://www.doi.org/10.1109/plans.2000.838280
    1. Rabaoui, A.,
    2. Viandier, N.,
    3. Duflos, E.,
    4. Marais, J., &
    5. Vanheeghe, P.
    (2011). Dirichlet process mixtures for density estimation in dynamic nonlinear modeling: Application to GPS positioning in urban canyons. IEEE Transactions on Signal Processing, 60(4), 1638–1655. https://www.doi.org/10.1109/tsp.2011.2180901
  55. ↵
    1. Schroth, G.,
    2. Ene, A.,
    3. Blanch, J.,
    4. Walter, T., &
    5. Enge, P.
    (2008). Failure detection and exclusion via range consensus.
  56. ↵
    1. Shepard, D. P., &
    2. Humphreys, T. E.
    (2014). 2014 IEEE/ION Position, Location and Navigation Symposium (PLANS 2014), Monterey, CA. https://www.doi.org/10.1109/plans.2014.6851506
  57. ↵
    1. Shytermeja, E.,
    2. Garcia-Pena, A., &
    3. Julien, O.
    (2014). Proposed architecture for integrity monitoring of a GNSS/MEMS system with a fisheye camera in urban environment. International Conference on Localization and GNSS 2014 (ICL-GNSS 2014), Helsinki, Finland. https://www.doi.org/10.1109/icl-gnss.2014.6934179
  58. ↵
    1. Snay, R. A., &
    2. Soler, T.
    (2008). Continuously operating reference station (CORS): History, applications, and future enhancements. Journal of Surveying Engineering, 134(4), 95–104. https://www.doi.org/10.1061/9780784411643.ch01
    CrossRefWeb of Science
  59. ↵
    1. Tmazirte, N. A.,
    2. El Najjar, M. E.,
    3. Smaili, C., &
    4. Pomorski, D.
    (2012). Multi-sensor data fusion based on information theory. Application to GNSS positioning and integrity monitoring. 2012 15th International Conference on Information Fusion, Singapore.
  60. ↵
    1. Torralba, A.,
    2. Oliva, A.,
    3. Castelhano, M. S., &
    4. Henderson, J. M.
    (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113(4), 766–786. https://www.doi.org/10.1037/0033-295x.113.4.766
    CrossRefPubMedWeb of Science
  61. ↵
    1. Tossaint, M.,
    2. Samson, J.,
    3. Toran, F.,
    4. Ventura-Traveset, J.,
    5. Hernandez-Pajares, M.,
    6. Juan, J. M.,
    7. Sanz, J., &
    8. Ramos-Bosch, P.
    (2007). The Stanford-ESA integrity diagram: A new tool for the user domain SBAS integrity assessment. NAVIGATION, 54(2), 153–162.
  62. ↵
    1. Woeginger, G. J.
    (2003). Exact algorithms for NP-hard problems: A survey. In M. Jünger, G. Reinelt, & G. Rinaldi (Eds.), Combinatorial optimization—Eureka, you shrink! (pp. 185–207). Springer.
  63. ↵
    1. Won, D. H.,
    2. Lee, E.,
    3. Heo, M.,
    4. Lee, S.-W.,
    5. Lee, J.,
    6. Kim, J.,
    7. Sung, S., &
    8. Lee, Y. J.
    (2014). Selective integration of GNSS, vision sensor, and INS using weighted DOP under GNSS-challenged environments. IEEE Transactions on Instrumentation and Measurement, 63(9), 2288–2298. https://www.doi.org/10.1109/tim.2014.2304365
  64. ↵
    1. Zhang, L.,
    2. Li, J.,
    3. Cui, T., and
    4. Liu, S.
    (2017). An adapted RAIM algorithm for urban canyon environment. 2017 Forum on Cooperative Positioning and Service (CPGPS), Harbin, China. https://www.doi.org/10.1109/cpgps.2017.8075108
  65. ↵
    1. Zhang, S.,
    2. Lo, S.,
    3. Chen, Y.-H.,
    4. Walter, T., &
    5. Enge, P.
    (2018). GNSS multipath detection in urban environment using 3D building model. 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS), Monterey, CA. https://www.doi.org/10.1109/plans.2018.8373486
  66. ↵
    1. Zhang, Q., &
    2. Gui, Q.
    (2015). A new Bayesian RAIM for multiple faults detection and exclusion in GNSS. The Journal of Navigation, 68(3), 465–479. https://www.doi.org/10.1017/s0373463314000721
  67. ↵
    1. Zhu, N.,
    2. Marais, J.,
    3. Bétaille, D., &
    4. Berbineau, M.
    (2018). GNSS position integrity in urban environments: A review of literature. IEEE Transactions on Intelligent Transportation Systems, 19(9), 2762–2778. https://www.doi.org/10.1109/tits.2017.2766768
  68. ↵
    1. Ziebold, R.,
    2. Lanca, L., &
    3. Romanovas, M.
    (2017). On fault detection and exclusion in snapshot and recursive positioning algorithms for maritime applications. European Transport Research Review, 9(1). https://www.doi.org/10.1007/s12544-016-0217-5
Back to top

In this issue

Print
Download PDF
Article Alerts
Email Article
Citation Tools
Robust GPS-Vision Localization via Integrity-Driven Landmark Attention
Sriramya Bhamidipati,, Grace Gao
NAVIGATION: Journal of the Institute of Navigation Mar 2022, 69 (1) navi.501; DOI: 10.33012/navi.501
Twitter logo Facebook logo Mendeley logo
Bookmark this article

Jump to section