This article is a review of the literature on classroom formative assessment. Several studies show firm evidence that innovations designed to strengthen the frequent feedback that students receive about their learning yield substantial learning gains. The perceptions of students and their role in self‐assessment are considered alongside analysis of the strategies used by teachers and the formative strategies incorporated in such systemic approaches as mastery learning. There follows a more detailed and theoretical analysis of the nature of feedback, which provides a basis for a discussion of the development of theoretical models for formative assessment and of the prospects for the improvement of practice.

Assessment and Classroom Learning

generalize create, solve unseen problems, extrapolate to unknown domains 22831.indb 124 6/15/11 2:11 PM Designing intended learning outcomes 125 • the verb at the appropriate level of understanding or of performance intended; • the topic content the verb is meant to address, the object of the verb in other words; • the context of the content discipline in which the verb is to be deployed. The ILOs for the course The Nature of Teaching and Learning illustrate these points: 1 Explain why a particular course topic is important to teaching. 2 Apply a course topic to your own teaching. 3 Refl ect on your teaching in terms of a working theory you have gained from the course. 4 Evaluate a situation that has gone wrong and apply a solution. The fi rst refers to declarative knowledge: the students have to reach a level of understanding that requires them to explain something, not just describe or list it: the latter only display multistructural levels of understanding, but explaining requires students to be able to relate the topic to the context of teaching and is at a relational level of understanding. The second is a functioning knowledge example also at the relational level as it requires a level of understanding that enables the student to apply the topic to teaching. The other two are also about functioning knowledge and should be at the relational to extended abstract level of understanding, depending on the originality of the student’s response. The content in (3) is the student’s own working theory and the context the student’s own teaching, and in (4), the content is the theory used in evaluating and the context the problematic situation in teaching. As a note on the number of ILOs per course, we stated earlier that there should be no more fi ve or six ILOs for any course, even though there may be up to ten topics that need addressing. The answer is to write integrating ILOs that address several topics, or, as in ILOs (1) and (2) above, the ILO allows the student to select just one topic for demonstrating ability to achieve the ILO. Another thing to watch out for are redundant ILOs, such as ‘Describe and explain . . .’. ‘Describe’ is redundant because if the student can explain the topic, he or she can certainly describe it. The other matter one should keep in mind at this stage is that desirable but unintended outcomes, or outcomes unforeseen by the teacher, may emerge. This is the nature of extended abstract responses by the student, and they will be accounted for in the normal assessment, but others may simply be things that the student sees as important and relevant learning. This matter becomes a practical issue during assessment, and we address it in Chapter 10. You should now be in a position to design and write your own ILOs for a course you are teaching (Task 7.1). 22831.indb 125 6/15/11 2:11 PM 126 Designing constructively aligned outcomes-based teaching and learning Task 7.1 Writing course ILOs Take a course that you are teaching. Consider the course aim and write the course ILOs by identifying: a the kind of knowledge to be learned (declarative or functioning). b the content or topic to be learned. c the level of understanding or performance to be achieved. d any particular context in which the outcome verb is to be enacted. The following grid may be a useful framework to help you think. Kind of knowledge Level of Content topic Context Declar/function understanding (outcome verb) ______________________________________________________________ ______________________________________________________________ ______________________________________________________________ ______________________________________________________________ ______________________________________________________________ ______________________________________________________________ Now go across the rows and write out the course ILOs by stating the intended level of understanding or performance (outcome verb), topic and the context in which the verb is to be enacted. There is no need to include the kind of knowledge in the ILO as that is defi ned by the verb(s) you use. To recap an example of a course ILO from our course The Nature of Teaching and Learning : Students should be able to: Refl ect (level of understanding and performance) on your teaching (context) in terms of a working theory you have gained from the course (content). Now write your course ILOs. Students should be able to: ILO1: _______________________________________________________ ILO2: _______________________________________________________ ILO3: _______________________________________________________ 22831.indb 126 6/15/11 2:11 PM Designing intended learning outcomes 127 Aligning ILOs at three levels: curriculum mapping Now that we have written the course ILOs, we have the task of checking to see that the three levels of intended outcomes, graduate, programme and course, are aligned. We can achieve this by curriculum mapping (Huet et al. 2009), which is a systematic means of ensuring alignment between programme ILOs and graduate outcomes, and course ILOs and programme ILOs. Graduate outcomes and programme ILOs Table 7.4 shows a simply way of checking the alignment between graduate outcomes and programme ILOs. The table is a device to ensure that the match between programme ILOs and graduate outcomes has at least been considered. Programme ILOs should not be forced to match graduate outcomes that don’t belong in the programme. Because of the different natures of different disciplines or professions, different programmes may have different emphases in addressing the graduate outcomes. It is not necessary that every programme should address all graduate outcomes to the same extent because some may not be relevant to the programme. Programme ILOs are simply the reasons that the programme is being taught, which is a matter of professional and academic judgment. However, university policy will prevail on this. Task 7.2 parallels Table 7.4: it asks you to align programme ILOs with the graduate outcomes of your university, if it has any. If the programme ILOs ILO4: _______________________________________________________ ILO5:_______________________________________________________ ILO6:_______________________________________________________ Review the ILOs to see whether: a the kind of knowledge, content and level of understanding or performance are relevant to achieve the course aim. b they cover all the main reasons for teaching the course. c they are clearly written, especially in identifying the level of understanding or performance to be achieved by the students, and the context (if appropriate). d the number is manageable for designing aligned teaching/learning activities and assessment tasks. How does this new set of course ILOs compare to your existing course ‘objectives’? Does the existing set need to be rewritten? 22831.indb 127 6/15/11 2:11 PM 128 Designing constructively aligned outcomes-based teaching and learning haven’t yet been articulated, discuss them with the programme coordinator and derive a set, then match them with the graduate outcomes. This should give you a clearer idea of how graduate outcomes can suitably be addressed in your teaching. How does your attempt gel with your university’s policy on this? Gelade and Fursenko (2007) also describe a tool for systematically mapping courses and programmes for graduate outcomes. Task 7.2 Aligning programme ILOs with graduate outcomes 1 Take a programme in which you are teaching and either list the programme ILOs if they are already articulated or, if they are not, sit down with the programme coordinator or programme committee chairperson and fi rst write the aims of the programme and a list of programme ILOs that meet those aims. 2 What are the graduate outcomes of your university? List them in the left-hand column in the grid below. 3 In the right-hand column list the programme ILOs that would address the graduate outcomes. Are all graduate outcomes addressed somewhere? Which are not? Does it matter?’ Graduate outcomes Programme ILO 1 2 etc. Table 7.4 An example of aligning programme ILOs with graduate outcomes Graduate outcomes Programme ILO Competent in professional Analyse and apply principles to real-life practice accounting situations Communicate effectively Communicate as a professional with clients and colleagues in real-life accounting situations Teamwork Operate effectively and ethically as a team member in real-life accounting situations Ethical professional As above 22831.indb 128 6/15/11 2:11 PM Designing intended learning outcomes 129 Programme ILOs and course ILOs The next level of alignment is between the programme and the course ILOs. As each programme is served by its constituent courses, it is important that, when aligning course ILOs to the programme ILOs, the course ILOs in total address all aspects of the programme ILOs. Often a programme ILO will be addressed by several courses, from different and increasingly more complex angles. You may attempt this in Task 7.3. Task 7.3 Aligning course ILOs with programme ILOs For individual teachers 1 List the programme ILOs of the programme. 2 List the course ILOs of the courses that you are teaching in a given programme. 3 Consider what programme ILO(s) each of the course ILOs addresses in the following table. Programme ILOs Course 1 ILOs Course 2 ILOs Course 3 ILOs

Teaching For Quality Learning At University

Problem-based approaches to learning have a long history of advocating experience-based education. Psychological research and theory suggests that by having students learn through the experience of solving problems, they can learn both content and thinking strategies. Problem-based learning (PBL) is an instructional method in which students learn through facilitated problem solving. In PBL, student learning centers on a complex problem that does not have a single correct answer. Students work in collaborative groups to identify what they need to learn in order to solve a problem. They engage in self-directed learning (SDL) and then apply their new knowledge to the problem and reflect on what they learned and the effectiveness of the strategies employed. The teacher acts to facilitate the learning process rather than to provide knowledge. The goals of PBL include helping students develop 1) flexible knowledge, 2) effective problem-solving skills, 3) SDL skills, 4) effective collaboration skills, and 5) intrinsic motivation. This article discusses the nature of learning in PBL and examines the empirical evidence supporting it. There is considerable research on the first 3 goals of PBL but little on the last 2. Moreover, minimal research has been conducted outside medical and gifted education. Understanding how these goals are achieved with less skilled learners is an important part of a research agenda for PBL. The evidence suggests that PBL is an instructional approach that offers the potential to help students develop flexible understanding and lifelong learning skills.

/pdf/problem-based-learning-what-and-how-do-students-learn-456c11ro51.pdf

Problem-Based Learning: What and How Do Students Learn?.

Two lines of thinking are becoming increasingly important in higher educational practice. The first derives from constructivist learning theory, and the second from the instructional design literature. Constructivism comprises a family of theories but all have in common the centrality of the learner's activities in creating meaning. These and related ideas have important implications for teaching and assessment. Instructional designers for their part have emphasised alignment between the objectives of a course or unit and the targets for assessing student performance. “Constructive alignment” represents a marriage of the two thrusts, constructivism being used as a framework to guide decision-making at all stages in instructional design: in deriving curriculum objectives in terms of performances that represent a suitably high cognitive level, in deciding teaching/learning activities judged to elicit those performances, and to assess and summatively report student performance. The “performances of understanding” nominated in the objectives are thus used to systematically align the teaching methods and the assessment. The process is illustrated with reference to a professional development unit in educational psychology for teachers, but the model may be generalized to most units or programs in higher education.

/pdf/enhancing-teaching-through-constructive-alignment-4j3girmwo2.pdf

Enhancing Teaching through Constructive Alignment.

The idea that a new generation of students is entering the education system has excited recent attention among educators and education commentators. Termed ‘digital natives’ or the ‘Net generation’, these young people are said to have been immersed in technology all their lives, imbuing them with sophisticated technical skills and learning preferences for which traditional education is unprepared. Grand claims are being made about the nature of this generational change and about the urgent necessity for educational reform in response. A sense of impending crisis pervades this debate. However, the actual situation is far from clear. In this paper, the authors draw on the fields of education and sociology to analyse the digital natives debate. The paper presents and questions the main claims made about digital natives and analyses the nature of the debate itself. We argue that rather than being empirically and theoretically informed, the debate can be likened to an academic form of a ‘moral panic’. We propose that a more measured and disinterested approach is now required to investigate ‘digital natives’ and their implications for education.

/pdf/the-digital-natives-debate-a-critical-review-of-the-evidence-1fsfykqt2p.pdf

The 'digital natives' debate: a critical review of the evidence

This bestselling book is a unique introduction to the practice of university teaching and its underlying theory. This new edition has been fully revised and updated in view of the extensive changes which have taken place in higher education over the last decade and includes new material on the higher education context, evaluation and staff development.The first part of the book provides an outline of the experience of teaching and learning from the student's point of view, out of which grows a set of prinicples for effective teaching in higher education. Part two shows how these ideas can enhance educational standards, looking in particular at four key areas facing every teacher in higher education:* Organising the content of undergraduate courses* Selecting teaching methods* Assessing student learning* Evaluating the effectivenesss of teaching.Case studies of exemplary teaching are used throughout to connect ideas to practice and to illustrate how to ensure better student learning. The final part of the book looks in more detail at appraisal, performance indicators, accountability and educational development and training. The book is essential reading for new and experienced lecturers, particularly those following formal programmes in university teaching, such as courses leading to ILT accreditation.

Learning to Teach in Higher Education

Part 1: Learning and Teaching in Higher Education 1.Introduction 2.Ways if Understanding Teaching 3.What Students Learn 4.Approaches to Learning 5.Learning form the Student's Perspective 6.The Nature of Good Teaching in Higher Education 7.Theories of Teaching in Higher Education Part 2: Design for Learning 8.The Goals and Structure of a Course 9.Tecahing Strategies for Effective Learning 10.Assessing for Understanding Part 3: Evaluating and Improving the Quality of Teaching and Learning 11.Evaluating the Quality of Higher Education 12.What Does it Take to Improve Teaching?

Performance indicators (PIs) in higher education have focused chiefly on research outputs. They have largely ignored the teaching function of universities and colleges. This article outlines the development of a student evaluation instrument designed to measure the teaching performance of academic organisational units. The theory of teaching and learning that underlies the Course Experience Questionnaire (CEQ) is described. The instrument's statistical qualities and its ability to discriminate intelligibly between different courses are discussed in the context of results from national trials in Australian higher education. The principal conclusion reached is that the CEQ offers a reliable, verifiable and useful means of determining the perceived teaching quality of academic units in systems of higher education that are based on British models. Several technical and political issues remain unresolved in its application as a PI.

A performance indicator of teaching quality in higher education: The Course Experience Questionnaire

Learning to Lead in Higher Education, by Paul Ramsden. New York: Routledge, 1998. 288 pp. $75.00 (24.99) Is academic leadership an oxymoron or a serious field of study? Until 20 years ago the major works on academic leadership focused on the roles of presidents and chief academic officers. The literature on academic department chairs was silent, with most of the information and attention coming from anecdotal speeches, professional papers, popular journal articles, a couple of text-type books, and a few data-based studies. Two decades ago the main reference for department chairs was Allen Tucker's Chairing the Academic Department (1981). Through the 1980s the academic department chair remained the least studied and most misunderstood position in the academy. Although many education scholars wrote about the organization and governance of higher education, relatively little was known about those who led and supported academic units. In addition, the management role of the department chair has no parallel in business and industry, or education for that matter. Typical faculty manuals at most colleges and universiti es provide a list of chairs' duties and responsibilities but do not provide insight into department leadership. The 1990s brought an onslaught of new publications shedding light on the overshadowed role of department chair. In 1990 John Creswell and his colleagues introduced The Academic Chairperson's Handbook, followed by Gmelch and Miskin's Leadership Skills for Department Chairs (1993), Ann Lucas's Strengthening Leadership: A Team-Building Guide for Chairs in Colleges and Universities (1994), Mary Lou Higgerson's Communication Skills for Department Chairs (1996), and Irene Hecht and her colleagues' recently released The Department Chair as Academic Leader (1999). Australian scholars extrapolated the role of the department head from English and American writings and studies until the release of Moses and Roe's (1990) ground-breaking work on Australian department heads and Sarros and Gmelch's replication of American department chair research in Australia (1996). Within this context Paul Ramsden's book Learning to Lead in Higher Education represents the second major work written for academic department leaders based on the Australian experience. Whereas Moses and Roe illuminated the world of the chair/head within the department, Ramsden looks at the role as part of a larger institutional nexus. In the introductory chapter Ramsden posits a simple three-stage systems model of presage-process-product to understand the challenges faced by academic leaders. Chapter 2 empirically addresses the presage or environmental factors of changing external forces on higher education (knowledge differentiation, mass higher education, and reduced public funding) and internal characteristics of universities (academic values and culture). Chapter 3 explores aspects of the academic outcomes or products constituting the third part of the model, underscoring the leader's job to increase productivity. He follows up in Chapters 4 and 5 with evidence suggesting that departmental leadership and intellectual climate can influence the output of research productivity and effective teaching. Chapter 6 concludes Part I with an inconclusive exploration of whether there are any useful leadership principles common to both university and other organizations. Ramsden postulates a series of principles characterizing competent academic leadership: a dynamic process, an outcomes-focused agenda, a phenomenon of both personal and organizational development, a relationship between leaders and followers, and a personal transformation process through reflection and learning. The second and third parts of the book attempt to demonstrate ways to manage in order to improve the context of academic work. Ramsden argues (unconvincingly in the opinion of this reviewer) that the framework for improving university teaching is similar to the practice of academic leadership. …

Learning to Lead in Higher Education

A single science textbook often provides the syllabus for courses at upper secondary and tertiary levels, and may be used as a principal source of information or explanation. The research reported in this article challenges such practices. The ways in which the concept, acceleration, is treated in physics textbooks is compared with understandings of the concept demonstrated by final-year secondary (Year 12) and first-year university students. Some students' understandings are shown to be incomplete in ways that parallel misleading or inaccurate textbook treatments of the concept. In addition to misleading or inaccurate statements, the limitations of some textbook treatments of acceleration were found to include: lack of attempts to make explicit relationships with other concepts, failure to point out when it is appropriate to use particular definitions or that an alternative definition might be more appropriate in specific situations, inclusion of operational definitions without conceptual explanations, and a focus on quantitative treatments while overlooking the development of qualitative understanding. Two principal aspects that distinguished the ways in which the students understood acceleration were identified: (a) the relation between acceleration and velocity; and (b) the relation between acceleration and force(s). The results of the study have implications for teaching and, in particular, for the use of textbooks in teaching. These implications are discussed in the article.

Paul Ramsden

Papers

Learning to Teach in Higher Education

Learning to Teach in Higher Education

A performance indicator of teaching quality in higher education: The Course Experience Questionnaire

Learning to Lead in Higher Education

Textbook treatments and students' understanding of acceleration