Interactive mobile information services
Tan, Yue Han
Date of Issue2017-05-18
School of Electrical and Electronic Engineering
With the increasing amount searches made per year, Mobile Visual Search (MVS) will bring about a different experience compared to conventional text typing search. In a single snap and shoot, the image will be queried and results will be returned in mere seconds. MVS provides some advantages over conventional text typing. From basic search queries to shopping applications and even Math solvers, MVS provides one with the technology to do that. Combined with Augmented Reality (AR), results could be brought to users through dynamically interactive means. This report explores the possibilities of integrating MVS with AR in a single application. An application will be made in this project. The application will be based on a textbook companion, providing interactive information to users. Users can then access the information based on what they have scanned and view multimedia related to the image scanned. The textbook companion covers some key concept figures in the textbook that students should read up more on in order to allow them to have a better and deeper understanding of the material. The application has been experimented on and it achieved a recognition accuracy of 96.25% with an average response time of 3.938s. The application is to be used in conjunction with a specified textbook.
Final Year Project (FYP)
Nanyang Technological University