Currently me and three of my friends are working on a project to generate an image description based on the objects in that particular image (When an image is given to the system novel description has to be generated based on the objects and relationship among them). So simply one person is planning to identify objects in the image and label them using a Fast Regional based CNN (FRCNN). In my part I have to implement a meaningful description based on those image labels (Output of the FRCNN is planning to take as the input to my RNN) by considering the relationship among them.
Currently I'm planning to implement a Recurrent neural network (RNN) to generate the description. but however I have a doubt that whether is it possible to generate a description using an RNN when it is just given set of words (Image label names) as an input. since RNNs are mainly used for use cases which have sequences and if I just give label names will it be able to generate a description by considering the relationship among them ?
If not can anyone please tell me what would be the best way to implement this ?
PS: I'm very new to machine learning and hope to get a clear idea to come to a better solution.