Skip to main content
Login | Suomeksi | På svenska | In English

A New Approach of Story Generation Based on Transformers

Show simple item record 2023-02-01T16:19:08Z 2023-02-01T16:19:08Z 2023-02-01
dc.title A New Approach of Story Generation Based on Transformers en
ethesis.faculty Matemaattis-luonnontieteellinen tiedekunta fi
ethesis.faculty Faculty of Science en
ethesis.faculty Matematisk-naturvetenskapliga fakulteten sv
ethesis.faculty.URI Helsingin yliopisto fi University of Helsinki en Helsingfors universitet sv
dct.creator Kang, Taize
dct.issued 2022
dct.abstract Story generation is an artificial intelligence task in which a computer program is used to create literature or stories. This kind of task usually involves giving an initial scene, characters, background information and goals, and then letting the computer program automatically generate a storyline and complete the narrative of the story. Transformers are widely used and achieved state of the art for many different natural language processing tasks, including story generation. With the help of attention mechanism, transforms can overcome overfittting and achieved great results. Generative Pre-trained Transformer (GPT) series are one of the best transformers, which attract many researchers. In this thesis, transformer models are used to design and implement a machine learning method for the generation of very short stories. By introducing a commonsense knowledge base and a rule generator based on it, the models can learn the relationships between context and generate coherent narratives. By given the first sentence of the story as the input, the model can complete the story. The model is based on GPT-2 model and COINS. The dataset used is a collection of short stories. By comparing with the generated results of different models in many aspects, we proved the effectiveness of the model. In addition, the compared results are analyzed to find the potential optimization methods. en
dct.subject Natural Language Processing
dct.subject Story Generation
dct.subject Transformers
ethesis.isPublicationLicenseAccepted true
ethesis.language englanti fi
ethesis.language English en
ethesis.language engelska sv
ethesis.thesistype pro gradu -tutkielmat fi
ethesis.thesistype master's thesis en
ethesis.thesistype pro gradu-avhandlingar sv
dct.identifier.ethesis E-thesisID:6efcbf99-d178-4912-bd71-b1aff7b979ea
dct.identifier.urn URN:NBN:fi:hulib-202302011243
ethesis.facultystudyline Algoritmit fi
ethesis.facultystudyline Algorithms en
ethesis.facultystudyline Algoritmer sv
ethesis.mastersdegreeprogram Datatieteen maisteriohjelma fi
ethesis.mastersdegreeprogram Master's Programme in Data Science en
ethesis.mastersdegreeprogram Magisterprogrammet i data science sv

Files in this item

Files Size Format View
Master thesis Taize Kang.pdf 842.6Kb PDF

This item appears in the following Collection(s)

Show simple item record