Scene understanding based on heterogeneous data fusion
Date of Issue2017-05-09
School of Electrical and Electronic Engineering
Artificial intelligence has boosted human’s life; this technology has become something that will totally change people’s life in the future. Scene understanding is one of the most popular research areas under this topic. This project focuses on developing a high-performance deep learning neural network which could help scene understanding model perform well in image classification. This project uses convolutional neural network as the fundamental network architecture. Nearly ten thousand images are collected, and these images are classified into 20 different classes based on image descriptions. With pre-trained Keras VGG-16 model, several sets of features are extracted from different layers. New classifiers are created and trained by passing those features through. This network achieves 0.77 mean average precision without any fine tuning. Moreover, after fine tuning process, the highest mAP score it can reach is 0.804. Experiments on testing different variables are implemented, and the results are elaborated as well. Difference between these tests are discussed as well.
Final Year Project (FYP)
Nanyang Technological University