IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Multimodal Search on Mobile Devices: Exploring Innovative Query Modalities for Mobile Search

Multimodal Search on Mobile Devices: Exploring Innovative Query Modalities for Mobile Search
View Sample PDF
Author(s): Xin Fan (University of Sheffield, UK), Mark Sanderson (University of Sheffield, UK)and Xing Xie (Microsoft Research Asia, China)
Copyright: 2010
Pages: 18
Source title: Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability
Source Author(s)/Editor(s): Stan Kurkovsky (Central Connecticut State University, USA)
DOI: 10.4018/978-1-60566-978-6.ch010

Purchase

View Multimodal Search on Mobile Devices: Exploring Innovative Query Modalities for Mobile Search on the publisher's website for pricing and purchasing information.

Abstract

The increasingly popularity of powerful mobile devices, such as smart phones and PDAs, enables users to search for information on the move. However, text is still the main input modality in most current mobile search services although some providers are attempting to provide voice-based mobile search solutions. In this chapter, we explore the innovative query modalities to enable mobile devices to support queries such as text, voice, image, location, and their combinations. We propose a solution to support mobile users to perform visual queries. The queries by captured pictures and text information are studied in depth. For example, the user can simply take a photo of an unfamiliar flower or surrounding buildings to find related information from the Web. A set of indexing schemes are designed to achieve accurate results and fast search through large volumes of data. Experimental results show that our prototype system achieved satisfactory performance. Also, we briefly introduce a prospective mobile search solution based on our ongoing research, which supports multimodal queries including location information, captured pictures and text information.

Related Content

Tapan Kumar Behera. © 2023. 20 pages.
B. Narendra Kumar Rao. © 2023. 17 pages.
Blendi Rrustemi, Deti Baholli, Herolind Balaj. © 2023. 18 pages.
Alma Beluli. © 2023. 11 pages.
Jona Ndrecaj, Shkurte Berisha, Erita Çunaku. © 2023. 15 pages.
Yllka Totaj. © 2023. 12 pages.
Hla Myo Tun, Devasis Pradhan. © 2023. 31 pages.
Body Bottom