Skip to main content
Login | Suomeksi | På svenska | In English

Using element-level website usage data to improve online learning materials and predict learning outcomes

Show simple item record

dc.date.accessioned 2017-06-20T11:11:42Z und
dc.date.accessioned 2017-10-24T12:24:29Z
dc.date.available 2017-06-20T11:11:42Z und
dc.date.available 2017-10-24T12:24:29Z
dc.date.issued 2017-06-20T11:11:42Z
dc.identifier.uri http://radr.hulib.helsinki.fi/handle/10138.1/6124 und
dc.identifier.uri http://hdl.handle.net/10138.1/6124
dc.title Using element-level website usage data to improve online learning materials and predict learning outcomes en
ethesis.discipline Computer science en
ethesis.discipline Tietojenkäsittelytiede fi
ethesis.discipline Datavetenskap sv
ethesis.discipline.URI http://data.hulib.helsinki.fi/id/1dcabbeb-f422-4eec-aaff-bb11d7501348
ethesis.department.URI http://data.hulib.helsinki.fi/id/225405e8-3362-4197-a7fd-6e7b79e52d14
ethesis.department Institutionen för datavetenskap sv
ethesis.department Department of Computer Science en
ethesis.department Tietojenkäsittelytieteen laitos fi
ethesis.faculty Matematisk-naturvetenskapliga fakulteten sv
ethesis.faculty Matemaattis-luonnontieteellinen tiedekunta fi
ethesis.faculty Faculty of Science en
ethesis.faculty.URI http://data.hulib.helsinki.fi/id/8d59209f-6614-4edd-9744-1ebdaf1d13ca
ethesis.university.URI http://data.hulib.helsinki.fi/id/50ae46d8-7ba9-4821-877c-c994c78b0d97
ethesis.university Helsingfors universitet sv
ethesis.university University of Helsinki en
ethesis.university Helsingin yliopisto fi
dct.creator Leppänen, Leo
dct.issued 2017
dct.language.ISO639-2 eng
dct.abstract In this study we use element-level usage data that was collected from the online learning material of an university level introductory programming course for identification of areas-of-interest in the course material as well as for prediction of student learning outcomes. The data was collected in-situ using a JavaScript component embedded in the online learning material, which recorded which HTML elements were visible on the user's screen after each interaction (movement and click) and if the user's screen had been still for at least 2500 milliseconds. A visual analysis indicates that students spend large amounts of time on material sections that discuss special syntactic structures that they are unable to infer from previous experience. Overall, the analysis was able to identify areas of the online learning material that seem to be too long and in-depth for the concepts they are discussing, when the things the students have previously learned are taken into account. This high-level analysis also revealed that the time the students spent viewing an assignment's prompt was statistically significantly correlated with the perceived workload, difficulty and educational value of that same assignment. We observe that when partial correlations are considered, and multiple comparisons are corrected for, time spent with an assignment's prompt on the screen is no longer statistically significantly correlated with the three variables. The same usage data was used to investigate whether material usage statistics can predict learning outcomes or identify strong and at-risk students. The results indicate that based on just three to four weeks of data, it is possible to identify strong and at-risk students with some accuracy. Furthermore, it seems possible to identify student programming assignment scores and total course scores with a somewhat high accuracy. Models based on material usage statistics also displayed some light predictive power in predicting student exam scores. It was also shown that the predictive powers of these models are not based solely on student effort or time-on-task. All told, this thesis demonstrates that fine-grained online learning material usage data is feasible to collect and useful in understanding both the students and the learning material. The results suggest that very simple and almost entirely domain-independent data sources can be used to predict student performance to a relatively large degree, suggesting that a combination of such simple domain-independent metrics could match highly domain dependent and more complex metrics in predictive power, giving raise to more widely usable educational analytics tools. en
dct.language en
ethesis.language.URI http://data.hulib.helsinki.fi/id/languages/eng
ethesis.language English en
ethesis.language englanti fi
ethesis.language engelska sv
ethesis.thesistype pro gradu-avhandlingar sv
ethesis.thesistype pro gradu -tutkielmat fi
ethesis.thesistype master's thesis en
ethesis.thesistype.URI http://data.hulib.helsinki.fi/id/thesistypes/mastersthesis
dct.identifier.urn URN:NBN:fi-fe2017112252261
dc.type.dcmitype Text

Files in this item

Files Size Format View
leppanen-thesis.pdf 4.878Mb PDF

This item appears in the following Collection(s)

Show simple item record