Such diverse thinkers as Lao-Tze, Confucius, and U.S. Defense Secretary Donald Rumsfeld have all pointed out that we need to be able to tell the difference between real and assumed knowledge. The systematic review is a scientific tool that can help with this difficult task. It can help, for example, with appraising, summarising, and communicating the results and implications of otherwise unmanageable quantities of data. This is important because quite often there are so many studies, and their results are often so conflicting, that no policymaker or practitioner could possibly carry out this task themselves.Systematic review methods have been widely used in health care, and are becoming increasingly common in the social sciences (fostered, for example, by the work of the Campbell Collaboration). 

This book outlines the rationale and methods of systematic reviews, giving worked examples from social science and other fields. It requires no previous knowledge, but takes the reader through the process stage by stage. It draws on examples from such diverse fields as psychology, criminology, education, transport, social welfare, public health, and housing and urban policy, among others.The book includes detailed sections on assessing the quality of both quantitative, and qualitative research; searching for evidence in the social sciences;meta-analytic and other methods of evidence synthesis; publication bias; heterogeneity; and approaches to dissemination.

Systematic Reviews in the Social Sciences: A Practical Guide

SUMMARY Review date: 1969 to 2003, 34 years. Background and context: Simulations are now in widespread use in medical education and medical personnel evaluation. Outcomes research on the use and effectiveness of simulation technology in medical education is scattered, inconsistent and varies widely in methodological rigor and substantive focus. Objectives: Review and synthesize existing evidence in educational science that addresses the question, ‘What are the features and uses of high-fidelity medical simulations that lead to most effective learning?’. Search strategy: The search covered five literature databases (ERIC, MEDLINE, PsycINFO, Web of Science and Timelit) and employed 91 single search terms and concepts and their Boolean combinations. Hand searching, Internet searches and attention to the ‘grey literature’ were also used. The aim was to perform the most thorough literature search possible of peer-reviewed publications and reports in the unpublished literature that have been judged for academic quality. Inclusion and exclusion criteria: Four screening criteria were used to reduce the initial pool of 670 journal articles to a focused set of 109 studies: (a) elimination of review articles in favor of empirical studies; (b) use of a simulator as an educational assessment or intervention with learner outcomes measured quantitatively; (c) comparative research, either experimental or quasi-experimental; and (d) research that involves simulation as an educational intervention. Data extraction: Data were extracted systematically from the 109 eligible journal articles by independent coders. Each coder used a standardized data extraction protocol. Data synthesis: Qualitative data synthesis and tabular presentation of research methods and outcomes were used. Heterogeneity of research designs, educational interventions, outcome measures and timeframe precluded data synthesis using meta-analysis. Headline results: Coding accuracy for features of the journal articles is high. The extant quality of the published research is generally weak. The weight of the best available evidence suggests that high-fidelity medical simulations facilitate learning under the right conditions. These include the following:

/pdf/features-and-uses-of-high-fidelity-medical-simulations-that-51wb8k5opy.pdf

Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review

Lessons from applying the systematic literature review process within the software engineering domain

BACKGROUND: The delivery of effective, high-quality patient care is a complex activity. It demands health and social care professionals collaborate in an effective manner. Research continues to suggest that collaboration between these professionals can be problematic. Interprofessional education (IPE) offers a possible way to improve interprofessional collaboration and patient care. OBJECTIVES: To assess the effectiveness of IPE interventions compared to separate, profession-specific education interventions; and to assess the effectiveness of IPE interventions compared to no education intervention.
SEARCH METHODS: For this update we searched the Cochrane Effective Practice and Organisation of Care Group specialised register, MEDLINE and CINAHL, for the years 2006 to 2011. We also handsearched the Journal of Interprofessional Care (2006 to 2011), reference lists of all included studies, the proceedings of leading IPE conferences, and websites of IPE organisations. SELECTION CRITERIA: Randomised controlled trials (RCTs), controlled before and after (CBA) studies and interrupted time series (ITS) studies of IPE interventions that reported objectively measured or self reported (validated instrument) patient/client or healthcare process outcomes. DATA COLLECTION AND ANALYSIS: At least two review authors independently assessed the eligibility of potentially relevant studies. For included studies, at least two review authors extracted data and assessed study quality. A meta-analysis of study outcomes was not possible due to heterogeneity in study designs and outcome measures. Consequently, the results are presented in a narrative format. MAIN RESULTS: This update located nine new studies, which were added to the six studies from our last update in 2008. This review now includes 15 studies (eight RCTs, five CBA and two ITS studies). All of these studies measured the effectiveness of IPE interventions compared to no educational intervention. Seven studies indicated that IPE produced positive outcomes in the following areas: diabetes care, emergency department culture and patient satisfaction; collaborative team behaviour and reduction of clinical error rates for emergency department teams; collaborative team behaviour in operating rooms; management of care delivered in cases of domestic violence; and mental health practitioner competencies related to the delivery of patient care. In addition, four of the studies reported mixed outcomes (positive and neutral) and four studies reported that the IPE interventions had no impact on either professional practice or patient care. AUTHORS' CONCLUSIONS: This updated review reports on 15 studies that met the inclusion criteria (nine studies from this update and six studies from the 2008 update). Although these studies reported some positive outcomes, due to the small number of studies and the heterogeneity of interventions and outcome measures, it is not possible to draw generalisable inferences about the key elements of IPE and its effectiveness. To improve the quality of evidence relating to IPE and patient outcomes or healthcare process outcomes, the following three gaps will need to be filled: first, studies that assess the effectiveness of IPE interventions compared to separate, profession-specific interventions; second, RCT, CBA or ITS studies with qualitative strands examining processes relating to the IPE and practice changes; third, cost-benefit analyses.

/pdf/interprofessional-education-effects-on-professional-practice-frwteh5fla.pdf

Interprofessional education: effects on professional practice and healthcare outcomes (update)

Background: Preparing healthcare professionals for teaching is regarded as essential to enhancing teaching effectiveness. Although many reports describe various faculty development interventions, there is a paucity of research demonstrating their effectiveness.Objective: To synthesize the existing evidence that addresses the question: “What are the effects of faculty development interventions on the knowledge, attitudes and skills of teachers in medical education, and on the institutions in which they work?”Methods: The search, covering the period 1980–2002, included three databases (Medline, ERIC and EMBASE) and used the keywords: staff development; in-service training; medical faculty; faculty training/development; continuing medical education. Manual searches were also conducted.Articles with a focus on faculty development to improve teaching effectiveness, targeting basic and clinical scientists, were reviewed. All study designs that included outcome data beyond participant satisfaction were accepted....

/pdf/a-systematic-review-of-faculty-development-initiatives-3otzax43oj.pdf

A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8.

Background and review context: Evidence to support the proposition that learning together will help practitioners and agencies work better together remains limited and thinly spread. This review id...

A best evidence systematic review of interprofessional education: BEME Guide no. 9

Effective Interprofessional Education: Argument, Assumption, And Evidence

Effective interprofessional education : development, delivery and evaluation

Effective Interprofessional Education

Over the past decade systematic reviews of interprofessional education (IPE) have provided a more informed understanding of the effects of this type of education. This paper contributes to this literature by reporting an update of a Cochrane systematic review published in this journal ten years ago (Zwarenstein et al., 1999 ). In updating this initial review, our current work involved searches of a number of electronic databases from 1999-2006, as well as reference lists, books, conference proceedings and websites. Like the previous review, only studies which employed randomized controlled trials, controlled-before and-after-studies and interrupted time series studies of IPE, and that reported validated professional practice and health care outcomes, were included. While the first review found no studies which met its inclusion criteria, the updated review located six IPE studies. This paper aims to add to the ongoing development of evidence for IPE. Despite some useful progress being made in relation to strengthening the evidence base for IPE, the paper concludes by stressing that further rigorous mixed method studies of IPE are needed to provide a greater clarity of IPE and its effects on professional practice and patient/client care.

Ivan Koppel

Papers

A best evidence systematic review of interprofessional education: BEME Guide no. 9

Effective Interprofessional Education: Argument, Assumption, And Evidence

Effective interprofessional education : development, delivery and evaluation

Effective Interprofessional Education

The effectiveness of interprofessional education: Key findings from a new systematic review