Image Caption Generator
Megha J Panicker1, Vikas Upadhayay2, Gunjan Sethi3, Vrinda Mathur4
1Megha J Panicker, Department. of Computer science and Engineering Delhi Technical Campus GGSIPU, Delhi, India.
2Vikas Upadhayay, Department. of Computer science and Engineering Delhi Technical Campus GGSIPU, Delhi, India.
3Gunjan Sethi, Department. of Computer science and Engineering Delhi Technical Campus GGSIPU, Delhi, India.
4Vrinda Mathur, Department. of Computer science and Engineering Delhi Technical Campus GGSIPU, Delhi, India.
Manuscript received on December 18, 2020. | Revised Manuscript received on January 08, 2020. | Manuscript published on January 10, 2021. | PP: 87-92 | Volume-10 Issue-3, January 2021 | Retrieval Number: 100.1/ijitee.C83830110321| DOI: 10.35940/ijitee.C8383.0110321
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: In the modern era, image captioning has become one of the most widely required tools. Moreover, there are inbuilt applications that generate and provide a caption for a certain image, all these things are done with the help of deep neural network models. The process of generating a description of an image is called image captioning. It requires recognizing the important objects, their attributes, and the relationships among the objects in an image. It generates syntactically and semantically correct sentences. In this paper, we present a deep learning model to describe images and generate captions using computer vision and machine translation. This paper aims to detect different objects found in an image, recognize the relationships between those objects and generate captions. The dataset used is Flickr8k and the programming language used was Python3, and an ML technique called Transfer Learning will be implemented with the help of the Xception model, to demonstrate the proposed experiment. This paper will also elaborate on the functions and structure of the various Neural networks involved. Generating image captions is an important aspect of Computer Vision and Natural language processing. Image caption generators can find applications in Image segmentation as used by Facebook and Google Photos, and even more so, its use can be extended to video frames. They will easily automate the job of a person who has to interpret images. Not to mention it has immense scope in helping visually impaired people.
Keywords: Image, Caption, CNN, Xception, RNN, LSTM, Neural Network.
Scope of the Article: Neural Network