The role of knowledge visualisation in supporting postgraduate dissertation assessment

Karen Renaud*, Judy Van Biljon

*Corresponding author for this work

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

There has been a worldwide increase in the number of postgraduate students over the last few years and therefore some examiners struggle to maintain high standards of consistency, accuracy and fairness. This is especially true in developing countries where the increase is supervision capacity is not on a par with the growth in student numbers. The aim of this research is to deploy freely available technology in order to find a way to help examiners to cope with this extra pressure, while maintaining the rigour of the assessment process. In terms of methodology, we commenced by mining the literature to ascertain exactly what criteria dissertation examiners were assessing, and how they went about doing this. We discovered that examiners tend first to gain an initial impression of a dissertation by reading the summary sections of the report: the abstract, introduction and conclusion. This delivers a helpful overview that eases the subsequent thorough examination of the dissertation, where they work their way through each chapter. This “overview then zoom” practice is reminiscent of the primary information visualisation mantra. This led us to consider whether knowledge visualisation could be the ameliorative mechanism we were looking for. We then carried out a systematic literature overview in order to determine whether knowledge visualisation had been used in this context. This revealed a surprising lack of research on the use of knowledge visualisation for assessment. We thus commenced to study extant use of visualisations. A case study approach was employed to study extant use of visualisations, in terms of how adequately they provided evidence of students having satisfied the previously identified assessment criteria. A number of experienced supervisors were then surveyed to gather their opinions about the role of knowledge visualisations in dissertations. Our findings indicate that knowledge visualisations can indeed provide evidence that particular criteria have been satisfied within a dissertation, and they do this more efficiently than text. Given the advances in technology, all postgraduate students are now able easily to produce computer-generated visualisations, so requiring their inclusion would be no great impediment. We conclude that knowledge visualisations demonstrate promise in terms of supporting assessment of postgraduate dissertations. Our recommendations are that the deliberate deployment of knowledge visualisations in this context be investigated further to determine whether this initial promise can be realised in actual practice. A video abstract of this article can be viewed at https://www.youtube.com/embed/Y7mcF2ZBNT8

Original languageEnglish
Pages (from-to)1475-1490
Number of pages16
JournalBritish Journal of Educational Technology
Volume48
Issue number6
Early online date26 Jul 2017
DOIs
Publication statusPublished - 1 Nov 2017

Fingerprint

earning a doctorate
visualization
knowledge
examiner
student
assessment criteria
fairness
supervision
evidence
video
inclusion
developing country
examination

Cite this

@article{0fdf454c5a9243db99e663515704cc95,
title = "The role of knowledge visualisation in supporting postgraduate dissertation assessment",
abstract = "There has been a worldwide increase in the number of postgraduate students over the last few years and therefore some examiners struggle to maintain high standards of consistency, accuracy and fairness. This is especially true in developing countries where the increase is supervision capacity is not on a par with the growth in student numbers. The aim of this research is to deploy freely available technology in order to find a way to help examiners to cope with this extra pressure, while maintaining the rigour of the assessment process. In terms of methodology, we commenced by mining the literature to ascertain exactly what criteria dissertation examiners were assessing, and how they went about doing this. We discovered that examiners tend first to gain an initial impression of a dissertation by reading the summary sections of the report: the abstract, introduction and conclusion. This delivers a helpful overview that eases the subsequent thorough examination of the dissertation, where they work their way through each chapter. This “overview then zoom” practice is reminiscent of the primary information visualisation mantra. This led us to consider whether knowledge visualisation could be the ameliorative mechanism we were looking for. We then carried out a systematic literature overview in order to determine whether knowledge visualisation had been used in this context. This revealed a surprising lack of research on the use of knowledge visualisation for assessment. We thus commenced to study extant use of visualisations. A case study approach was employed to study extant use of visualisations, in terms of how adequately they provided evidence of students having satisfied the previously identified assessment criteria. A number of experienced supervisors were then surveyed to gather their opinions about the role of knowledge visualisations in dissertations. Our findings indicate that knowledge visualisations can indeed provide evidence that particular criteria have been satisfied within a dissertation, and they do this more efficiently than text. Given the advances in technology, all postgraduate students are now able easily to produce computer-generated visualisations, so requiring their inclusion would be no great impediment. We conclude that knowledge visualisations demonstrate promise in terms of supporting assessment of postgraduate dissertations. Our recommendations are that the deliberate deployment of knowledge visualisations in this context be investigated further to determine whether this initial promise can be realised in actual practice. A video abstract of this article can be viewed at https://www.youtube.com/embed/Y7mcF2ZBNT8",
author = "Karen Renaud and Biljon, {Judy Van}",
year = "2017",
month = "11",
day = "1",
doi = "10.1111/bjet.12494",
language = "English",
volume = "48",
pages = "1475--1490",
journal = "British Journal of Educational Technology",
issn = "0007-1013",
publisher = "Wiley-Blackwell",
number = "6",

}

The role of knowledge visualisation in supporting postgraduate dissertation assessment. / Renaud, Karen; Biljon, Judy Van.

In: British Journal of Educational Technology, Vol. 48, No. 6, 01.11.2017, p. 1475-1490.

Research output: Contribution to journalArticle

TY - JOUR

T1 - The role of knowledge visualisation in supporting postgraduate dissertation assessment

AU - Renaud, Karen

AU - Biljon, Judy Van

PY - 2017/11/1

Y1 - 2017/11/1

N2 - There has been a worldwide increase in the number of postgraduate students over the last few years and therefore some examiners struggle to maintain high standards of consistency, accuracy and fairness. This is especially true in developing countries where the increase is supervision capacity is not on a par with the growth in student numbers. The aim of this research is to deploy freely available technology in order to find a way to help examiners to cope with this extra pressure, while maintaining the rigour of the assessment process. In terms of methodology, we commenced by mining the literature to ascertain exactly what criteria dissertation examiners were assessing, and how they went about doing this. We discovered that examiners tend first to gain an initial impression of a dissertation by reading the summary sections of the report: the abstract, introduction and conclusion. This delivers a helpful overview that eases the subsequent thorough examination of the dissertation, where they work their way through each chapter. This “overview then zoom” practice is reminiscent of the primary information visualisation mantra. This led us to consider whether knowledge visualisation could be the ameliorative mechanism we were looking for. We then carried out a systematic literature overview in order to determine whether knowledge visualisation had been used in this context. This revealed a surprising lack of research on the use of knowledge visualisation for assessment. We thus commenced to study extant use of visualisations. A case study approach was employed to study extant use of visualisations, in terms of how adequately they provided evidence of students having satisfied the previously identified assessment criteria. A number of experienced supervisors were then surveyed to gather their opinions about the role of knowledge visualisations in dissertations. Our findings indicate that knowledge visualisations can indeed provide evidence that particular criteria have been satisfied within a dissertation, and they do this more efficiently than text. Given the advances in technology, all postgraduate students are now able easily to produce computer-generated visualisations, so requiring their inclusion would be no great impediment. We conclude that knowledge visualisations demonstrate promise in terms of supporting assessment of postgraduate dissertations. Our recommendations are that the deliberate deployment of knowledge visualisations in this context be investigated further to determine whether this initial promise can be realised in actual practice. A video abstract of this article can be viewed at https://www.youtube.com/embed/Y7mcF2ZBNT8

AB - There has been a worldwide increase in the number of postgraduate students over the last few years and therefore some examiners struggle to maintain high standards of consistency, accuracy and fairness. This is especially true in developing countries where the increase is supervision capacity is not on a par with the growth in student numbers. The aim of this research is to deploy freely available technology in order to find a way to help examiners to cope with this extra pressure, while maintaining the rigour of the assessment process. In terms of methodology, we commenced by mining the literature to ascertain exactly what criteria dissertation examiners were assessing, and how they went about doing this. We discovered that examiners tend first to gain an initial impression of a dissertation by reading the summary sections of the report: the abstract, introduction and conclusion. This delivers a helpful overview that eases the subsequent thorough examination of the dissertation, where they work their way through each chapter. This “overview then zoom” practice is reminiscent of the primary information visualisation mantra. This led us to consider whether knowledge visualisation could be the ameliorative mechanism we were looking for. We then carried out a systematic literature overview in order to determine whether knowledge visualisation had been used in this context. This revealed a surprising lack of research on the use of knowledge visualisation for assessment. We thus commenced to study extant use of visualisations. A case study approach was employed to study extant use of visualisations, in terms of how adequately they provided evidence of students having satisfied the previously identified assessment criteria. A number of experienced supervisors were then surveyed to gather their opinions about the role of knowledge visualisations in dissertations. Our findings indicate that knowledge visualisations can indeed provide evidence that particular criteria have been satisfied within a dissertation, and they do this more efficiently than text. Given the advances in technology, all postgraduate students are now able easily to produce computer-generated visualisations, so requiring their inclusion would be no great impediment. We conclude that knowledge visualisations demonstrate promise in terms of supporting assessment of postgraduate dissertations. Our recommendations are that the deliberate deployment of knowledge visualisations in this context be investigated further to determine whether this initial promise can be realised in actual practice. A video abstract of this article can be viewed at https://www.youtube.com/embed/Y7mcF2ZBNT8

UR - https://www.youtube.com/embed/Y7mcF2ZBNT8

U2 - 10.1111/bjet.12494

DO - 10.1111/bjet.12494

M3 - Article

VL - 48

SP - 1475

EP - 1490

JO - British Journal of Educational Technology

JF - British Journal of Educational Technology

SN - 0007-1013

IS - 6

ER -