Indoor topological localization using a visual landmark sequence

Jiasong Zhu, Qing Li, Rui Cao, Ke Sun, Tao Liu, Jonathan Garibaldi, Qingquan Li, Bozhi Liu, Guoping Qiu

Research output: Journal PublicationArticlepeer-review

17 Citations (Scopus)
34 Downloads (Pure)


This paper presents a novel indoor topological localization method based on mobile phone videos. Conventional methods suffer from indoor dynamic environmental changes and scene ambiguity. The proposed Visual Landmark Sequence-based Indoor Localization (VLSIL) method is capable of addressing problems by taking steady indoor objects as landmarks. Unlike many feature or appearance matching-based localization methods, our method utilizes highly abstracted landmark sematic information to represent locations and thus is invariant to illumination changes, temporal variations, and occlusions. We match consistently detected landmarks against the topological map based on the occurrence order in the videos. The proposed approach contains two components: a convolutional neural network (CNN)-based landmark detector and a topological matching algorithm. The proposed detector is capable of reliably and accurately detecting landmarks. The other part is the matching algorithm built on the second order hidden Markov model and it can successfully handle the environmental ambiguity by fusing sematic and connectivity information of landmarks. To evaluate the method, we conduct extensive experiments on the real world dataset collected in two indoor environments, and the results show that our deep neural network-based indoor landmark detector accurately detects all landmarks and is expected to be utilized in similar environments without retraining and that VLSIL can effectively localize indoor landmarks.
Original languageEnglish
Pages (from-to)73
JournalRemote Sensing
Issue number1
Publication statusPublished - 3 Jan 2019


  • indoor topological localization
  • onvolutional neural network(CNN)
  • second order hidden Markov model
  • visual landmark sequence


Dive into the research topics of 'Indoor topological localization using a visual landmark sequence'. Together they form a unique fingerprint.

Cite this