Skip to main content
Login | Suomeksi | På svenska | In English

A New Approach of Story Generation Based on Transformers

Show full item record

Title: A New Approach of Story Generation Based on Transformers
Author(s): Kang, Taize
Contributor: University of Helsinki, Faculty of Science
Degree program: Master's Programme in Data Science
Specialisation: Algorithms
Language: English
Acceptance year: 2022
Story generation is an artificial intelligence task in which a computer program is used to create literature or stories. This kind of task usually involves giving an initial scene, characters, background information and goals, and then letting the computer program automatically generate a storyline and complete the narrative of the story. Transformers are widely used and achieved state of the art for many different natural language processing tasks, including story generation. With the help of attention mechanism, transforms can overcome overfittting and achieved great results. Generative Pre-trained Transformer (GPT) series are one of the best transformers, which attract many researchers. In this thesis, transformer models are used to design and implement a machine learning method for the generation of very short stories. By introducing a commonsense knowledge base and a rule generator based on it, the models can learn the relationships between context and generate coherent narratives. By given the first sentence of the story as the input, the model can complete the story. The model is based on GPT-2 model and COINS. The dataset used is a collection of short stories. By comparing with the generated results of different models in many aspects, we proved the effectiveness of the model. In addition, the compared results are analyzed to find the potential optimization methods.
Keyword(s): Natural Language Processing Story Generation Transformers

Files in this item

Files Size Format View
Master thesis Taize Kang.pdf 842.6Kb PDF

This item appears in the following Collection(s)

Show full item record