Susan Illingworth
This page is also available as a:
Teachers and students need to have a well-founded confidence in their assessment methods. Assessment should be objective, consistent, transparent and appropriate to the needs of the subject area. This paper will consider assessment within applied and professional ethics learning and teaching, to determine whether this subject area raises particular concerns and challenges.
Assessment of applied ethics modules within humanities based disciplines such as philosophy and religious studies is broadly similar to that found in other humanities-based fields of study.
Firstly, students are assessed on their knowledge of the subject matter. In ethics this will mean addressing themes drawn from moral theory and/or the history of ethical thought and their application to real life or life-like situations.
Secondly, students are assessed on those skills and intellectual faculties needed to develop a critical understanding of their subject matter. In ethics this will normally entail demonstrating a capacity for conceptual analysis and the ability to construct reasoned arguments. Students will also be expected to show an awareness of differing perspectives on contested issues and a willingness to subject those perspectives to equally stringent scrutiny including (and indeed, especially) their own point of view.
Assessment methods vary but traditional written forms such as essay writing are seen as a useful format, allowing tutors to assess the student's understanding of the topic, their willingness to evaluate it critically and their capacity to present their ideas and arguments in a coherent, consistent and structured form.
In some modules a capacity to engage in verbal discussion will be considered desirable. However, assessment of this ability is more difficult, both in terms of its initial application and its susceptibility to external examination techniques such as double-marking. Verbal presentation forms are therefore less likely to contribute to the student's final degree classification.
Assessment methods within the humanities are under constant review, as they are in most areas of Higher Education, but there is no reason to think that ethics poses any special problems, over and above those of the parent discipline. However, for ethics learning and teaching in other faculties such as science, medicine and healthcare, the situation is somewhat different and assessment presents challenges that are unique to the subject.
A key difference between assessment of professional ethics modules and assessment of ethics within a general programme of philosophical enquiry centres on the relationship between ethics learning and teaching and the conduct of individual students.
Benchmarking statements and professional codes from science, engineering and a range of applied disciplines indicate that ethics is now seen as an integral part of a graduate's ability to function effectively in the workplace. As a result, ethics may be embedded in the rapidly evolving notion of what it means to be a 'Professional', an ideal that links ethical behaviour to interpersonal communication, professional competence and management skills rather than a facility with moral theory. This ideal of professional competence may sometimes be linked to a requirement that students recognise and are able to think critically about moral issues arising from their primary area of study. In these cases, assessment will be broadly similar to that found in theory-oriented disciplines although it should be applied in a way which is sensitive to the fact that the students' broader programme of study might be unsupportive of the skills and aptitudes required for a consideration of moral theory.
For subjects such as medicine, nursing, pharmacy, dentistry, social work and education, the link between ethics and professional conduct is paramount as graduation will normally lead directly or indirectly to state registration and graduates must therefore meet behavioural standards in addition to academic criteria to ensure their Fitness to Practice.
For example the benchmark statement for Medicine states that:
Assessment strategies and methods must ensure that the knowledge, understanding, skills and attitudes are sufficiently covered.[1]
Similarly, the benchmark statement for Midwifery requires student-centred learning approaches that:
... enable students to be self-critical and make adjustments to their attitudes and goals.[2]
Assessment of student performance is therefore important as a means of determining whether they have reached the acceptable minimum level of attainment with regard to Fitness for Practice. In some cases it will also be used to grade their performance against a scale of achievement superseding that minimum acceptable level.
However, assessment of student performance is also of increasing use as a means of appraising the effectiveness of the learning and teaching environment. The main difference between assessment in these two contexts is that assessment of the student's performance requires an end-state appraisal with respect to the defined aims of the course, while assessment of the learning and teaching environment will normally require at least two measurement points - one at the start of the module and one at its completion - to determine whether the learning environment has brought about a change in student performance with respect to the defined aims of the course.
A high level of student attainment will often be taken to indicate that the learning and teaching environment is of similarly high quality, but there are other significant factors, such as student entry level of knowledge and natural aptitude for the subject.
For any course, however successful and whatever the subject area, it can be useful to consider how far the quality of student performance reflects the quality of the learning and teaching environment but this is of particular utility in professional ethics where:
Within any subject area there will be some skills or aptitudes that students are expected to bring to the course, as a necessary precondition and no student is likely to enter Higher Education as an ethical tabla rasa. They can be expected to have moral principles (even if they do not recognise them as such), and some capacity for discussion of ethically sensitive issues. In more general terms they will have what might be called a moral character; a behavioural and attitudinal disposition that can be evaluated against the professional standards or criteria of Fitness for Practice. Selection therefore offers an alternative way of ensuring that students are fit for practice, and can be applied in tandem with, or as an alternative to, instruction.
One criticism of selection is that there are no reliable methods of selecting students on the basis of good or virtuous character. All the selection systems on offer (interviews, character references, psychological tests, record of public service etc.) have some deficiencies. These criticisms would also hold true for instruction aimed at developing or improving moral character as one cannot evaluate the success of a course without a reliable way of measuring its intended outcomes. However, Pellegrino and Thomasma argue that there are many elements of medical education that do not yield to easy measurement.[3] This does not mean that one cannot gain some idea of the student's competence, but rather that assessment must itself be assessed carefully.
The benchmark statement for Medicine acknowledges that:
'Assessment of some qualities will require extended observations to be made. While professional attitudes, for example, may be difficult to assess directly, the consequences of attitudes on behaviour must be assessed - usually by observation of that behaviour over a period of time. Assessment needs to be thorough but should not be so onerous or so frequent as to interfere with the learning process'.[4]
Currently, a mixture of selection and instruction with respect to ethically relevant characteristics is applied for courses in which Fitness for Practice is an issue. For example, empathy may be specified as desirable quality in applicants to schools of nursing, but the course modules will aim to foster and develop this trait, in concert with other ethically relevant skills.
One of the most contentious elements within Professional ethics is the role of moral reasoning. While few would argue that moral reasoning skills alone are sufficient to ensure high standards of conduct, there are those who insist that they are necessary, if not a sufficient condition. Gillon compares the attempt to define the virtues of a good doctor:
without critical philosophical study of the moral assumptions and objectives of medical practice ... to ... specifying the syllabus for therapeutics while claiming that neither medical students nor the doctors laying down the syllabus need to know any pharmacology.[5]
Much of the literature on ethics pedagogical research emphasises the enhancement of critical reasoning faculties as a key objective for professional ethics modules. However contested the connection between moral reasoning and high moral standards of behaviour, there is some consensus that moral reasoning is the aspect which:
The neo-Kohlbergian approach to the measurement of moral reasoning capacity arose from collaboration between moral philosophy and moral psychology and has been very influential in recent literature. Kohlberg [6]defined a theory of moral development in which we progress through six identifiable stages that can be classified into three levels of reasoning about moral dilemmas:
Pre-Conventional - reasoning based on self-interest. The individual aims to win rewards and avoid punishment.
Conventional - reasoning based on conformity to social norms and expectations such as family or peer-group pressures.
Post-conventional - reasoning based on universal ethical principles, centred on the notion of justice.[7]
Progression through these stages is regarded as a move towards increasing sophistication in moral reasoning, and can therefore be used to assess the impact of the learning and teaching environment on the moral development. Adults would normally be expected to have already attained the second (conventional) level of reasoning so ethics within Higher Education has focussed upon progression to the third, post-conventional, level.
Kohlberg developed the Moral Judgement Interview (MJI)[8][9] as an assessment tool which uses dilemmas to assess moral judgement.
The MJI consists of a 45-minute semi structured oral tape-recorded interview in which subjects are asked to resolve a series of three moral dilemmas. Each dilemma is followed by a systematic set of open-ended probe questions designed to enable the subject to reveal the structure of logic of his or her responses. Scoring yields an overall score, which is a continuous measure of moral maturity; and a score that reflects the subject's stage of moral reasoning.[10]
The MJI is sensitive to the skill of the person responsible for scoring the subject's reply, and therefore requires that those administering the test have some training to enable them to perform it adequately. It also requires that the subject is able to explain their moral reasoning logically and coherently. The test might therefore favour people who have some background in moral philosophy.
Other research has built on Kohlberg's approach to develop assessment methods that aim to determine whether students have made the transition from conventional to post-conventional moral reasoning, most notably with the Defining Issues Test (DIT).
Defining Issues Test (DIT) is self-administered. Subjects are presented with short vignettes or dilemmas then asked to select their answers on a multiple-choice basis.
Because the DIT does not require the subject to articulate a reply in their own words, it 'measures recognition knowledge, a type of tacit knowledge [rather than explicit verbal knowledge].' For a discussion of the DIT and its application see:
Online information can be found at:
Other publications from the originators of the DIT are:
Other research evaluating the DIT:
Research that has used the DIT:
It has, however, been acknowledged that moral reasoning alone is insufficient to produce moral behaviour and Rest[11], Bebeau[12] and Thoma have developed Kohlberg's theory to propose a Four Component Model (FCM) of Morality[13], summarised as follows:
Drawing primarily on research in psychology and philosophy, they apply the FCM to professional ethics by adding profession-specific measures labelled 'intermediate concepts'[14], stressing the need for more interdisciplinary collaboration.
Profession-specific tests developed by them include:
The Dental Ethical Sensitivity Test (DEST): see
For a comparison of the DIT, with the TESS and the Perry Questionnaire (details of TESS & Perry below) see:
The Dental Ethical Reasoning and Judgement Test (DERJT): see:
Another test based on Kohlberg's theory is the The Sociomoral Reflection Measure (SRM) developed by John C. Gibbs, Keith F. Widaman and Anne Colby (1982). This measures the stages of moral reasoning using the Social Reflection Questionnaire. It is held to be simpler than the MJI but more expansive than the DIT. Like the MJI it requires the subject to explain their moral decisions in their own words, but unlike the MJI the SRM requires a written answer. The SRM can be administered to groups.
For details on using the SRM see:
Further references:
Within Business ethics the Multidimensional Ethics Scale (MES) has been widely used. See:
Other evaluations of the MES:
The MES has been used in research by:
The Perry Questionnaire assesses students' meta-ethical understanding. For a description of the method see:
For use of the Perry Questionnaire see:
The Ethical Reasoning Tool (ERT)
The ERT was developed for use with nurses and categorises responses to a case study into three 'professional response levels':[15]
These levels identify reflective thinking as the basis on which nurses are likely to challenge unethical practises.
See: McAlpine H.; Kristjanson L.; Poroch D. , 'Development and testing of the ethical reasoning tool (ERT): an instrument to measure the ethical reasoning of nurses' Journal of Advanced Nursing, 1997, vol. 25, no. 6, pp. 1151-1161.
Ethics and Health Care Survey Instrument, Goldie et al. have used an adapted version of the Ethics and Health Care Survey Instrument (full details may be obtained from the authors), developed and tested by Kipnis & Gerhard at the University of Hawaii, John A. Burns School of Medicine. This method comprised 12 case vignettes, nine of which 'featured 'consensus problems', about which there is broadly shared, responsibly warranted agreement among specialists in medical ethics'.[18] The other cases featured contested issues. Like the DIT, students are asked to make a selection from predefined answers, but they are also asked to provide reasons for their response. See:
Virtue Ethics Scale. This was used by Shanahan and Hyman to classify people according to their beliefs about the virtuous qualities of businesspeople.
See: Shanahan K.J. & Hyman M.R. (2003), 'The Development of a Virtue Ethics Scale,' Journal of Business Ethics,Vol. 42: pp. 197-208.
Ethic of Care Interview. This test is designed to measure the development of the care ethic. It divides development into five hierarchical levels:
See:
Test for Ethical Sensitivity in Science (TESS)
The TESS requires students to produce written responses to an unstructured story in which a number of ethical issues are embedded. Their responses are then scored according to their level of recognition of those ethical issues.
See:
Clarekeburn, H. (2002) 'A Test for Ethical Sensitivity in Science' Journal of Moral Education, vol. 31, no. 4, pp. 439-453.
For a comparison of DIT, TESS and the Perry Questionnaire see.
Clarkeburn H.; Downie J.R.; Matthew B, (2002), 'Impact of an Ethics Programme in a Life Sciences Curriculum', Teaching in Higher Education, vol. 7, no. 1, pp. 65-79.
For an online summary of assessment methods suitable for use in ethics learning and teaching see:
The Ethics Tool Database: http://www.bc.edu/bc_org/
avp/son/ethics/database.html
Assessment instruments: http://www.character.org/resources/assessment
The conclusion to this guide to assessment within applied and professional ethics is that there is at present, no reliable conclusion to be drawn regarding the best way to assess ethics learning and teaching. However, there are many tests available, particularly in respect of the measurement of moral reasoning capacity.
What should one assess, and how should one assess it? Neither question has an easy answer, but it is vital that those concerned with ethics learning and teaching, particularly as it concerns professional ethics, continue to debate and develop this vital if contested area.
Created on: April 17th 2007
Updated on: June 4th 2007