Social Sciences â€ș Sociology and Political Science

Delphi Technique in Research

Description

This cluster of papers revolves around the Delphi Method, a research technique used for consensus building and expert opinions. It focuses on topics such as developing core outcome sets, healthcare quality indicators, systematic reviews, nominal group technique, and methodological guidelines for conducting Delphi studies.

Keywords

Delphi Method; Consensus Building; Research Technique; Core Outcome Sets; Expert Opinions; Healthcare Quality Indicators; Systematic Review; Nominal Group Technique; Forecasting; Methodological Guidelines

Aim. The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10‐year period in a variety of 
 Aim. The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10‐year period in a variety of applications. Background. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how ‘experts’ are selected and how non‐respondents are pursued. Discussion. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi‐anonymity for participants; how to estimate the time needed to collect the data, analyse each ‘round’, feed back results to participants, and gain their responses to this feedback; how to define and select the ‘experts’ who will be asked to participate; how to enhance response rates; and how many ‘rounds’ to conduct. Conclusion. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.
The final development of the Sickness Impact Profile (SIP), a behaviorally based measure of health status, is presented. A large field trial on a random sample of prepaid group practice 
 The final development of the Sickness Impact Profile (SIP), a behaviorally based measure of health status, is presented. A large field trial on a random sample of prepaid group practice enrollees and smaller trials on samples of patients with hyperthyroidism, rheumatoid arthritis and hip replacements were undertaken to assess reliability and validity of the SIP and provide data for category and item analyses. Test-retest reliability (r = 0.92) and internal consistency (r = 0.94) were high. Convergent and discriminant validity was evaluated using the multitrait–multimethod technique. Clinical validity was assessed by determining the relationship between clinical measures of disease and the SIP scores. The relationship between the SIP and criterion measures were moderate to high and in the direction hypotheszed. A technique for describing and assessing similarities and differences among groups was developed using profile and pattern analysis. The final SIP contains 136 items in 12 categories. Overall, category, and dimension scores may be calculated.
Consensus methods such as the Delphi survey technique are being employed to help enhance effective decision-making in health and social care. The Delphi survey is a group facilitation technique, which 
 Consensus methods such as the Delphi survey technique are being employed to help enhance effective decision-making in health and social care. The Delphi survey is a group facilitation technique, which is an iterative multistage process, designed to transform opinion into group consensus. It is a flexible approach, that is used commonly within the health and social sciences, yet little guidance exists to help researchers undertake this method of data collection. This paper aims to provide an understanding of the preparation, action steps and difficulties that are inherent within the Delphi. Used systematically and rigorously, the Delphi can contribute significantly to broadening knowledge within the nursing profession. However, careful thought must be given before using the method; there are key issues surrounding problem identification, researcher skills and data presentation that must be addressed. The paper does not claim to be definitive; it purports to act as a guide for those researchers who wish to exploit the Delphi methodology.
To provide recommendations for the core outcome domains that should be considered by investigators conducting clinical trials of the efficacy and effectiveness of treatments for chronic pain. Development of a 
 To provide recommendations for the core outcome domains that should be considered by investigators conducting clinical trials of the efficacy and effectiveness of treatments for chronic pain. Development of a core set of outcome domains would facilitate comparison and pooling of data, encourage more complete reporting of outcomes, simplify the preparation and review of research proposals and manuscripts, and allow clinicians to make informed decisions regarding the risks and benefits of treatment.Under the auspices of the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT), 27 specialists from academia, governmental agencies, and the pharmaceutical industry participated in a consensus meeting and identified core outcome domains that should be considered in clinical trials of treatments for chronic pain.There was a consensus that chronic pain clinical trials should assess outcomes representing six core domains: (1) pain, (2) physical functioning, (3) emotional functioning, (4) participant ratings of improvement and satisfaction with treatment, (5) symptoms and adverse events, (6) participant disposition (e.g. adherence to the treatment regimen and reasons for premature withdrawal from the trial). Although consideration should be given to the assessment of each of these domains, there may be exceptions to the general recommendation to include all of these domains in chronic pain trials. When this occurs, the rationale for not including domains should be provided. It is not the intention of these recommendations that assessment of the core domains should be considered a requirement for approval of product applications by regulatory agencies or that a treatment must demonstrate statistically significant effects for all of the relevant core domains to establish evidence of its efficacy.
Aim. To outline the key concepts and principles of the Delphi technique. Methods. Reference is made to a selection of studies that illustrate a variety of methodological interpretations. Drawing on 
 Aim. To outline the key concepts and principles of the Delphi technique. Methods. Reference is made to a selection of studies that illustrate a variety of methodological interpretations. Drawing on Heshusius's concept of ‘goodness criteria’, particular emphasis is given to the question of scientific merit and means of evaluation. Conclusion. Although the technique should be used with caution, it appears to be an established method of harnessing the opinions of an often diverse group of experts on practice‐related problems.
The scoping review has become an increasingly popular approach for synthesizing research evidence. It is a relatively new approach for which a universal study definition or definitive procedure has not 
 The scoping review has become an increasingly popular approach for synthesizing research evidence. It is a relatively new approach for which a universal study definition or definitive procedure has not been established. The purpose of this scoping review was to provide an overview of scoping reviews in the literature. A scoping review was conducted using the Arksey and O'Malley framework. A search was conducted in four bibliographic databases and the gray literature to identify scoping review studies. Review selection and characterization were performed by two independent reviewers using pretested forms. The search identified 344 scoping reviews published from 1999 to October 2012. The reviews varied in terms of purpose, methodology, and detail of reporting. Nearly three-quarter of reviews (74.1%) addressed a health topic. Study completion times varied from 2 weeks to 20 months, and 51% utilized a published methodological framework. Quality assessment of included studies was infrequently performed (22.38%). Scoping reviews are a relatively new but increasingly common approach for mapping broad topics. Because of variability in their conduct, there is a need for their methodological standardization to ensure the utility and strength of evidence.
CRISP, JACKIE; PELLETIER, DIANNE; DUFFIELD, CHRISTINE; ADAMS, ANNE; NAGY, SUE Author Information CRISP, JACKIE; PELLETIER, DIANNE; DUFFIELD, CHRISTINE; ADAMS, ANNE; NAGY, SUE Author Information
The selection of appropriate outcomes or domains is crucial when designing clinical trials in order to compare directly the effects of different interventions in ways that minimize bias. If the 
 The selection of appropriate outcomes or domains is crucial when designing clinical trials in order to compare directly the effects of different interventions in ways that minimize bias. If the findings are to influence policy and practice then the chosen outcomes need to be relevant and important to key stakeholders including patients and the public, health care professionals and others making decisions about health care. There is a growing recognition that insufficient attention has been paid to the outcomes measured in clinical trials. These issues could be addressed through the development and use of an agreed standardized collection of outcomes, known as a core outcome set, which should be measured and reported, as a minimum, in all trials for a specific clinical area. Accumulating work in this area has identified the need for general guidance on the development of core outcome sets. Key issues to consider in the development of a core outcome set include its scope, the stakeholder groups to involve, choice of consensus method and the achievement of a consensus.
The National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS) Roadmap initiative (www.nihpromis.org) is a 5-year cooperative group program of research designed to develop, validate, and standardize item 
 The National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS) Roadmap initiative (www.nihpromis.org) is a 5-year cooperative group program of research designed to develop, validate, and standardize item banks to measure patient-reported outcomes (PROs) relevant across common medical conditions. In this article, we will summarize the organization and scientific activity of the PROMIS network during its first 2 years.The network consists of 6 primary research sites (PRSs), a statistical coordinating center (SCC), and NIH research scientists. Governed by a steering committee, the network is organized into functional subcommittees and working groups. In the first year, we created an item library and activated 3 interacting protocols: Domain Mapping, Archival Data Analysis, and Qualitative Item Review (QIR). In the second year, we developed and initiated testing of item banks covering 5 broad domains of self-reported health.The domain mapping process is built on the World Health Organization (WHO) framework of physical, mental, and social health. From this framework, pain, fatigue, emotional distress, physical functioning, social role participation, and global health perceptions were selected for the first wave of testing. Item response theory (IRT)-based analysis of 11 large datasets supplemented and informed item-level qualitative review of nearly 7000 items from available PRO measures in the item library. Items were selected for rewriting or creation with further detailed review before the first round of testing in the general population and target patient populations.The NIH PROMIS network derived a consensus-based framework for self-reported health, systematically reviewed available instruments and datasets that address the initial PROMIS domains. Qualitative item research led to the first wave of network testing which began in the second year.
Without a complete published description of interventions, clinicians and patients cannot reliably implement interventions that are shown to be useful, and other researchers cannot replicate or build on research findings. 
 Without a complete published description of interventions, clinicians and patients cannot reliably implement interventions that are shown to be useful, and other researchers cannot replicate or build on research findings. The quality of description of interventions in publications, however, is remarkably poor. To improve the completeness of reporting, and ultimately the replicability, of interventions, an international group of experts and stakeholders developed the Template for Intervention Description and Replication (TIDieR) checklist and guide. The process involved a literature review for relevant checklists and research, a Delphi survey of an international panel of experts to guide item selection, and a face to face panel meeting. The resultant 12 item TIDieR checklist (brief name, why, what (materials), what (procedure), who provided, how, where, when and how much, tailoring, modifications, how well (planned), how well (actual)) is an extension of the CONSORT 2010 statement (item 5) and the SPIRIT 2013 statement (item 11). While the emphasis of the checklist is on trials, the guidance is intended to apply across all evaluative study designs. This paper presents the TIDieR checklist and guide, with an explanation and elaboration for each item, and examples of good reporting. The TIDieR checklist and guide should improve the reporting of interventions and make it easier for authors to structure accounts of their interventions, reviewers and editors to assess the descriptions, and readers to use the information.
Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) 
 Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice.
An international association advancing the multidisciplinary study of informing systems. Founded in 1998, the Informing Science Institute (ISI) is a global community of academics shaping the future of informing science. An international association advancing the multidisciplinary study of informing systems. Founded in 1998, the Informing Science Institute (ISI) is a global community of academics shaping the future of informing science.
The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties 
 The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties of health-related patient reported outcomes (HR-PROs). In this paper, we explain our choices for the design requirements and preferred statistical methods for which no evidence is available in the literature or on which the Delphi panel members had substantial discussion. The issues described in this paper are a reflection of the Delphi process in which 43 panel members participated. The topics discussed are internal consistency (relevance for reflective and formative models, and distinction with unidimensionality), content validity (judging relevance and comprehensiveness), hypotheses testing as an aspect of construct validity (specificity of hypotheses), criterion validity (relevance for PROs), and responsiveness (concept and relation to validity, and (in) appropriate measures). We expect that this paper will contribute to a better understanding of the rationale behind the items, thereby enhancing the acceptance and use of the COSMIN checklist.
Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement 
 Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist.A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'.Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed.The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.
Consensus methods are being used increasingly to solve problems in medicine and health. Their main purpose is to define levels of agreement on controversial subjects. Advocates suggest that, when properly 
 Consensus methods are being used increasingly to solve problems in medicine and health. Their main purpose is to define levels of agreement on controversial subjects. Advocates suggest that, when properly employed, consensus strategies can create structured environments in which experts are given the best available information, allowing their solutions to problems to be more justifiable and credible than otherwise. This paper surveys the characteristics of several major methods (Delphi, Nominal Group, and models developed by the National Institutes of Health and Glaser) and provides guidelines for those who want to use the techniques. Among the concerns these guidelines address are selecting problems, choosing members for consensus panels, specifying acceptable levels of agreement, properly using empirical data, obtaining professional and political support, and disseminating results.
Health providers face the problem of trying to make decisions in situations where there is insufficient information and also where there is an overload of (often contradictory) information. Statistical methods 
 Health providers face the problem of trying to make decisions in situations where there is insufficient information and also where there is an overload of (often contradictory) information. Statistical methods such as meta-analysis have been developed to summarise and to resolve inconsistencies in study findings--where information is available in an appropriate form. Consensus methods provide another means of synthesising information, but are liable to use a wider range of information than is common in statistical methods, and where published information is inadequate or non-existent these methods provide a means of harnessing the insights of appropriate experts to enable decisions to be made. Two consensus methods commonly adopted in medical, nursing, and health services research--the Delphi process and the nominal group technique (also known as the expert panel)--are described, together with the most appropriate situations for using them; an outline of the process involved in undertaking a study using each method is supplemented by illustrations of the authors' work. Key methodological issues in using the methods are discussed, along with the distinct contribution of consensus methods as aids to decision making, both in clinical practice and in health service development.
Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used 
 Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how 'consensus' is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of 'experts.' Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.
Scoping reviews are used to identify knowledge gaps, set research agendas, and identify implications for decision-making. The conduct and reporting of scoping reviews is inconsistent in the literature. We conducted 
 Scoping reviews are used to identify knowledge gaps, set research agendas, and identify implications for decision-making. The conduct and reporting of scoping reviews is inconsistent in the literature. We conducted a scoping review to identify: papers that utilized and/or described scoping review methods; guidelines for reporting scoping reviews; and studies that assessed the quality of reporting of scoping reviews. We searched nine electronic databases for published and unpublished literature scoping review papers, scoping review methodology, and reporting guidance for scoping reviews. Two independent reviewers screened citations for inclusion. Data abstraction was performed by one reviewer and verified by a second reviewer. Quantitative (e.g. frequencies of methods) and qualitative (i.e. content analysis of the methods) syntheses were conducted. After searching 1525 citations and 874 full-text papers, 516 articles were included, of which 494 were scoping reviews. The 494 scoping reviews were disseminated between 1999 and 2014, with 45 % published after 2012. Most of the scoping reviews were conducted in North America (53 %) or Europe (38 %), and reported a public source of funding (64 %). The number of studies included in the scoping reviews ranged from 1 to 2600 (mean of 118). Using the Joanna Briggs Institute methodology guidance for scoping reviews, only 13 % of the scoping reviews reported the use of a protocol, 36 % used two reviewers for selecting citations for inclusion, 29 % used two reviewers for full-text screening, 30 % used two reviewers for data charting, and 43 % used a pre-defined charting form. In most cases, the results of the scoping review were used to identify evidence gaps (85 %), provide recommendations for future research (84 %), or identify strengths and limitations (69 %). We did not identify any guidelines for reporting scoping reviews or studies that assessed the quality of scoping review reporting. The number of scoping reviews conducted per year has steadily increased since 2012. Scoping reviews are used to inform research agendas and identify implications for policy or practice. As such, improvements in reporting and conduct are imperative. Further research on scoping review methodology is warranted, and in particular, there is need for a guideline to standardize reporting.
O presente artigo tem por objetivo a atualização e a familiarização de profissionais envolvidos com a reabilitação daClassificação Internacional de Funcionalidade (CIF) desenvolvida pela Organização Mundial de SaĂșde. SĂŁo abordados 
 O presente artigo tem por objetivo a atualização e a familiarização de profissionais envolvidos com a reabilitação daClassificação Internacional de Funcionalidade (CIF) desenvolvida pela Organização Mundial de SaĂșde. SĂŁo abordados seu histĂłrico, finalidade e perspectivas de aplicação na ĂĄrea de reabilitação.
Case reports have been a long held tradition within the surgical literature. Reporting guidelines can improve transparency and reporting quality. However, recent consensus-based guidelines for case reports (CARE) are not 
 Case reports have been a long held tradition within the surgical literature. Reporting guidelines can improve transparency and reporting quality. However, recent consensus-based guidelines for case reports (CARE) are not surgically focused. Our objective was to develop surgical case report guidelines.The CARE statement was used as the basis for a Delphi consensus. The Delphi questionnaire was administered via Google Forms and conducted using standard Delphi methodology. A multidisciplinary group of surgeons and others with expertise in the reporting of case reports were invited to participate. In round one, participants stated how each item of the CARE statement should be changed and what additional items were needed. Revised and additional items from round one were put forward into a further round, where participants voted on the extent of their agreement with each item, using a nine-point Likert scale, as proposed by the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) working group.In round one, there was a 64% (38/59) response rate. Following adjustment of the guideline with the incorporation of recommended changes, round two commenced and there was an 83% (49/59) response rate. All but one of the items were approved by the participants, with Likert scores 7-9 awarded by >70% of respondents. The final guideline consists of a 14-item checklist.We present the SCARE Guideline, consisting of a 14-item checklist that will improve the reporting quality of surgical case reports.
The Delphi technique is a widely used and accepted method for gathering data from respondents within their domain of expertise. The technique is designed as a group communication process which 
 The Delphi technique is a widely used and accepted method for gathering data from respondents within their domain of expertise. The technique is designed as a group communication process which aims to achieve a convergence of opinion on a specific real-world issue. The Delphi process has been used in various fields of study such as program planning, needs assessment, policy determination, and resource utilization to develop a full range of alternatives, explore or expose underlying assumptions, as well as correlate judgments on a topic spanning a wide range of disciplines. The Delphi technique is well suited as a method for consensus-building by using a series of questionnaires delivered using multiple iterations to collect data from a panel of selected subjects. Subject selection, time frames for conducting and completing a study, the possibility of low response rates, and unintentionally guiding feedback from the respondent group are areas which should be considered when designing and implementing a Delphi study.
Background: The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. Aim: To systematically examine the application 
 Background: The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. Aim: To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. Design: A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Data sources: Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. Results: A total of 30 empirical studies (1997–2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a ‘round’ or a ‘modified Delphi study’. Conclusion: Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.
The selection of appropriate outcomes is crucial when designing clinical trials in order to compare the effects of different interventions directly. For the findings to influence policy and practice, the 
 The selection of appropriate outcomes is crucial when designing clinical trials in order to compare the effects of different interventions directly. For the findings to influence policy and practice, the outcomes need to be relevant and important to key stakeholders including patients and the public, health care professionals and others making decisions about health care. It is now widely acknowledged that insufficient attention has been paid to the choice of outcomes measured in clinical trials. Researchers are increasingly addressing this issue through the development and use of a core outcome set, an agreed standardised collection of outcomes which should be measured and reported, as a minimum, in all trials for a specific clinical area.Accumulating work in this area has identified the need for guidance on the development, implementation, evaluation and updating of core outcome sets. This Handbook, developed by the COMET Initiative, brings together current thinking and methodological research regarding those issues. We recommend a four-step process to develop a core outcome set. The aim is to update the contents of the Handbook as further research is identified.
The original COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was developed to assess the methodological quality of single studies on measurement properties of Patient-Reported Outcome Measures 
 The original COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was developed to assess the methodological quality of single studies on measurement properties of Patient-Reported Outcome Measures (PROMs). Now it is our aim to adapt the COSMIN checklist and its four-point rating system into a version exclusively for use in systematic reviews of PROMs, aiming to assess risk of bias of studies on measurement properties.For each standard (i.e., a design requirement or preferred statistical method), it was discussed within the COSMIN steering committee if and how it should be adapted. The adapted checklist was pilot-tested to strengthen content validity in a systematic review on the quality of PROMs for patients with hand osteoarthritis.Most important changes were the reordering of the measurement properties to be assessed in a systematic review of PROMs; the deletion of standards that concerned reporting issues and standards that not necessarily lead to biased results; the integration of standards on general requirements for studies on item response theory with standards for specific measurement properties; the recommendation to the review team to specify hypotheses for construct validity and responsiveness in advance, and subsequently the removal of the standards about formulating hypotheses; and the change in the labels of the four-point rating system.The COSMIN Risk of Bias checklist was developed exclusively for use in systematic reviews of PROMs to distinguish this application from other purposes of assessing the methodological quality of studies on measurement properties, such as guidance for designing or reporting a study on the measurement properties.
Content validity is the most important measurement property of a patient-reported outcome measure (PROM) and the most challenging to assess. Our aims were to: (1) develop standards for evaluating the 
 Content validity is the most important measurement property of a patient-reported outcome measure (PROM) and the most challenging to assess. Our aims were to: (1) develop standards for evaluating the quality of PROM development; (2) update the original COSMIN standards for assessing the quality of content validity studies of PROMs; (3) develop criteria for what constitutes good content validity of PROMs, and (4) develop a rating system for summarizing the evidence on a PROM's content validity and grading the quality of the evidence in systematic reviews of PROMs. An online 4-round Delphi study was performed among 159 experts from 21 countries. Panelists rated the degree to which they (dis)agreed to proposed standards, criteria, and rating issues on 5-point rating scales ('strongly disagree' to 'strongly agree'), and provided arguments for their ratings. Discussion focused on sample size requirements, recording and field notes, transcribing cognitive interviews, and data coding. After four rounds, the required 67% consensus was reached on all standards, criteria, and rating issues. After pilot-testing, the steering committee made some final changes. Ten criteria for good content validity were defined regarding item relevance, appropriateness of response options and recall period, comprehensiveness, and comprehensibility of the PROM. The consensus-based COSMIN methodology for content validity is more detailed, standardized, and transparent than earlier published guidelines, including the previous COSMIN standards. This methodology can contribute to the selection and use of high-quality PROMs in research and clinical practice.
Systematic reviews of patient-reported outcome measures (PROMs) differ from reviews of interventions and diagnostic test accuracy studies and are complex. In fact, conducting a review of one or more PROMs 
 Systematic reviews of patient-reported outcome measures (PROMs) differ from reviews of interventions and diagnostic test accuracy studies and are complex. In fact, conducting a review of one or more PROMs comprises of multiple reviews (i.e., one review for each measurement property of each PROM). In the absence of guidance specifically designed for reviews on measurement properties, our aim was to develop a guideline for conducting systematic reviews of PROMs. Based on literature reviews and expert opinions, and in concordance with existing guidelines, the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) steering committee developed a guideline for systematic reviews of PROMs. A consecutive ten-step procedure for conducting a systematic review of PROMs is proposed. Steps 1–4 concern preparing and performing the literature search, and selecting relevant studies. Steps 5–8 concern the evaluation of the quality of the eligible studies, the measurement properties, and the interpretability and feasibility aspects. Steps 9 and 10 concern formulating recommendations and reporting the systematic review. The COSMIN guideline for systematic reviews of PROMs includes methodology to combine the methodological quality of studies on measurement properties with the quality of the PROM itself (i.e., its measurement properties). This enables reviewers to draw transparent conclusions and making evidence-based recommendations on the quality of PROMs, and supports the evidence-based selection of PROMs for use in research and in clinical practice.
Scoping reviews, a type of knowledge synthesis, follow a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. Although more scoping reviews 
 Scoping reviews, a type of knowledge synthesis, follow a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. Although more scoping reviews are being done, their methodological and reporting quality need improvement. This document presents the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) checklist and explanation. The checklist was developed by a 24-member expert panel and 2 research leads following published guidance from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. The final checklist contains 20 essential reporting items and 2 optional items. The authors provide a rationale and an example of good reporting for each item. The intent of the PRISMA-ScR is to help readers (including researchers, publishers, commissioners, policymakers, health care providers, guideline developers, and patients or consumers) develop a greater understanding of relevant terminology, core concepts, and key items to report for scoping reviews.
INTRODUCTION: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods 
 INTRODUCTION: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods Appraisal Tool (MMAT). The aim of this paper is to present the enhance ments made to the MMAT. DEVELOPMENT: The MMAT was initially developed in 2006 based on a literature review on systematic reviews combining qualitative and quantitative evidence. It was subject to pilot and interrater reliability testing. A revised version of the MMAT was developed in 2018 based on the results from usefulness testing, a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts to identify core criteria. TOOL DESCRIPTION: The MMAT assesses the quality of qualitative, quantitative, and mixed methods studies. It focuses on methodological criteria and includes five core quality criteria for each of the following five categories of study designs: (a) qualitative, (b) randomized controlled, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods. CONCLUSION: The MMAT is a unique tool that can be used to appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more efficient appraisal.
Research guidelines for the Delphi survey technique Consensus methods such as the Delphi survey technique are being employed to help enhance effective decision‐making in health and social care. The Delphi 
 Research guidelines for the Delphi survey technique Consensus methods such as the Delphi survey technique are being employed to help enhance effective decision‐making in health and social care. The Delphi survey is a group facilitation technique, which is an iterative multistage process, designed to transform opinion into group consensus. It is a flexible approach, that is used commonly within the health and social sciences, yet little guidance exists to help researchers undertake this method of data collection. This paper aims to provide an understanding of the preparation, action steps and difficulties that are inherent within the Delphi. Used systematically and rigorously, the Delphi can contribute significantly to broadening knowledge within the nursing profession. However, careful thought must be given before using the method; there are key issues surrounding problem identification, researcher skills and data presentation that must be addressed. The paper does not claim to be definitive; it purports to act as a guide for those researchers who wish to exploit the Delphi methodology.
The objective of this paper is to describe the updated methodological guidance for conducting a JBI scoping review, with a focus on new updates to the approach and development of 
 The objective of this paper is to describe the updated methodological guidance for conducting a JBI scoping review, with a focus on new updates to the approach and development of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (the PRISMA-ScR).Scoping reviews are an increasingly common approach to informing decision-making and research based on the identification and examination of the literature on a given topic or issue. Scoping reviews draw on evidence from any research methodology and may also include evidence from non-research sources, such as policy. In this manner, scoping reviews provide a comprehensive overview to address broader review questions than traditionally more specific systematic reviews of effectiveness or qualitative evidence. The increasing popularity of scoping reviews has been accompanied by the development of a reporting guideline: the PRISMA-ScR. In 2014, the JBI Scoping Review Methodology Group developed guidance for scoping reviews that received minor updates in 2017 and was most recently updated in 2020. The updates reflect ongoing and substantial developments in approaches to scoping review conduct and reporting. As such, the JBI Scoping Review Methodology Group recognized the need to revise the guidance to align with the current state of knowledge and reporting standards in evidence synthesis.Between 2015 and 2020, the JBI Scoping Review Methodology Group expanded its membership; extensively reviewed the literature; engaged via annual face-to-face meetings, regular teleconferences, and email correspondence; sought advice from methodological experts; facilitated workshops; and presented at scientific conferences. This process led to updated guidance for scoping reviews published in the JBI Manual for Evidence Synthesis. The updated chapter was endorsed by JBI's International Scientific Committee in 2020.The updated JBI guidance for scoping reviews includes additional guidance on several methodological issues, such as when a scoping review is (or is not) appropriate, and how to extract, analyze, and present results, and provides clarification for implications for practice and research. Furthermore, it is aligned with the PRISMA-ScR to ensure consistent reporting.The latest JBI guidance for scoping reviews provides up-to-date guidance that can be used by authors when conducting a scoping review. Furthermore, it aligns with the PRISMA-ScR, which can be used to report the conduct of a scoping review. A series of ongoing and future methodological projects identified by the JBI Scoping Review Methodology Group to further refine the methodology are planned.
Dworkin, Robert H.a,*; Turk, Dennis C.b; Farrar, John T.c; Haythornthwaite, Jennifer A.d; Jensen, Mark P.b; Katz, Nathaniel P.e; Kerns, Robert D.f; Stucki, Geroldg; Allen, Robert R.h; Bellamy, Nicholasi; Carr, Daniel 
 Dworkin, Robert H.a,*; Turk, Dennis C.b; Farrar, John T.c; Haythornthwaite, Jennifer A.d; Jensen, Mark P.b; Katz, Nathaniel P.e; Kerns, Robert D.f; Stucki, Geroldg; Allen, Robert R.h; Bellamy, Nicholasi; Carr, Daniel B.j; Chandler, Juliek; Cowan, Penneyl; Dionne, Raymondm; Galer, Bradley S.n; Hertz, Sharono; Jadad, Alejandro R.p; Kramer, Lynn D.q; Manning, Donald C.r; Martin, Susans; McCormick, Cynthia G.t; McDermott, Michael P.u; McGrath, Patrickv; Quessy, Stevew; Rappaport, Bob A.o; Robbins, Wendyex; Robinson, James P.b; Rothman, Margarety; Royal, Mike A.z; Simon, Leeo; Stauffer, Joseph W.aa; Stein, Wendyab; Tollett, Janeac; Wernicke, Joachimad; Witter, Jameso Author Information
The Surgical CAse REport (SCARE) guidelines were first published in 2016 as a tool for surgeons to document and report their surgical cases in a standardised and comprehensive manner. However, 
 The Surgical CAse REport (SCARE) guidelines were first published in 2016 as a tool for surgeons to document and report their surgical cases in a standardised and comprehensive manner. However, with advances in technology and changes in the healthcare landscape, it is important to revise and update these guidelines to ensure they remain relevant and valuable for surgeons.The updated guidelines were produced through a Delphi consensus exercise. Members of the SCARE 2020 guidelines Delphi group, editorial board members, and peer reviewers were invited to participate. Potential contributors were contacted by e-mail. An online survey was completed to indicate their agreement with the proposed changes to the guideline items.A total of 54 participants were invited to participate and 44 (81.5%) completed the survey. There was a high degree of agreement among reviewers, with 36 items (83.7%) meeting the threshold for inclusion.Through a completed Delphi consensus exercise we present the SCARE 2023 guidelines. This will provide surgeons with a comprehensive and up-to-date tool for documenting and reporting their surgical cases while highlighting the importance of patient-centred care.
Part 1. Theory and Methods. 1. The Delphi Method and its Contribution to Decision-Making, Erio Ziglio. 2. Theoretical, Methodological and Practical Issues Arising out of the Delphi Method, Armando Rotondi 
 Part 1. Theory and Methods. 1. The Delphi Method and its Contribution to Decision-Making, Erio Ziglio. 2. Theoretical, Methodological and Practical Issues Arising out of the Delphi Method, Armando Rotondi and David Gustafson. 3. Computer-Based Delphi Processes, Murray Turoff and Starr Roxanne Hiltz. Part 2. Applications. 4. A Comprehensive Study of the Ethical, Legal and Social Implications of Advances in Biochemical and Behavioural Research and Technology, Peter Goldschmidt. 5. The Use of the Delphi Method in Construdcting Scenarios on the Future of Mental Health and Mental Health Care, Rob Bijl. 6. Delphi Techniques and Planning of Social Services: The Prevention of Dependency Among the Old, Giovanni Bertin. 7. Alternative Approaches to the Computerisation of Social Security: Reflections on a Delphi Exercise, Michael Adler and Roy Sainsbury. 8. The Use of the Delphi Method in Forecasting Accidents in the Year 2000, Ed van Beeck. 9. Delphi Esitamates on Clients' Perceptions of Family Planning Services, Mauro Niero and Alex Robertson. 10. Concluding Remarks, Michael Adler and Erio Ziglio. List of Contributors. Subject Index. Author Index.
Objectives This study aims to address the status of children’s and caregivers’ participation in the development of paediatric core outcome sets (COS). Methods We included all paediatric COS from a 
 Objectives This study aims to address the status of children’s and caregivers’ participation in the development of paediatric core outcome sets (COS). Methods We included all paediatric COS from a previous systematic review and searched the Core Outcome Measures in Effectiveness Trials database to 26 February 2024 for recent paediatric COS. We used descriptive and thematic analysis methods to present the characteristics of the included COS and to describe children’s and caregivers’ participation in the development, including any facilitators and barriers. We assessed the degree of participation of children and caregivers in two steps: by rating whether their views were considered in forming the outcome list (yes/no) and then whether their views were integrated in determining the most important outcomes (fully integrated/partially integrated/not integrated). Results A total of 114 paediatric COS were included. 60 (53%) COS involved children and caregivers in the development process. 29 (48%) of the 60 COS considered children’s and caregivers’ views in forming the initial outcome list, which was most often conducted by interview (n=12 of 29, 41%). Regarding determining the most important outcomes, 35 (58%) of the 60 COS fully integrated children’s and caregivers’ views, and the most common method was the Delphi survey with consensus meeting (n=29 of 35, 83%); the youngest child participants were aged 7 years. The most frequently mentioned facilitator of children’s and caregivers’ participation was the engagement of patient groups or organisations. Conclusion and relevance We evaluated the degree of children’s and caregivers’ participation in the development of COS and found that strategies to promote children’s and caregivers’ participation should be constructed.
Co-ordinated approaches to supporting veterinary practitioners in relation to adverse events are needed to mitigate associated practitioner stress and to prevent future occurrence. The overarching aim of this study was 
 Co-ordinated approaches to supporting veterinary practitioners in relation to adverse events are needed to mitigate associated practitioner stress and to prevent future occurrence. The overarching aim of this study was to develop a framework that could be used profession wide within the veterinary sector to support practitioners in relation adverse events (the Stressful Adverse Veterinary Events Support Framework; SAVES Framework). A three-round e-Delphi consensus approach was taken. The study used an a priori determined panel of 50 stakeholders (50% veterinary practitioners – veterinary surgeons and veterinary nurses registered in the United Kingdom, 28% individuals employed within UK organisations supporting veterinary practitioners and 22% other veterinary care stakeholders). An a priori determined consensus agreement level of ≄75% was set. Forty-six recommendations entering the first round were formulated by reviewing two sources (i) The human and veterinary healthcare literature pertaining to the provision of support for practitioners who are involved in adverse events, and (ii) Transcripts from a study by the authors that explored veterinary practitioners’ experiences of and responses to adverse events. Both sources were used to identify recommendations that may be useful to veterinary practitioners and/or highlighted gaps in the current provision of such support. Recommendations were refined by the primary researcher, through discussion with the core research group and with a wider group of stakeholders via a pretesting and pilot phase before being shared with e-Delphi panellists. Panellists were asked to indicate the degree to which they agreed with each recommendation (Likert Scale; 1 = Very strongly disagree, 7 = Very strongly agree) and were informed that indications of 6 or 7 would be considered agreement and indications of 1 or 2 would be considered disagreement. In rounds one and two, panel members were asked to provide feedback regarding the recommendations, which was (i) Used to modify the recommendations or to formulate additional recommendations, and (ii) Qualitatively analysed to generate themes of factors that may influence implementation of support for veterinary practitioners in relation to adverse events. Twenty-nine of the 46 initial recommendations (63%) reached consensus. Feasibility, a multifaceted and flexible approach and the influence of human thought and behaviour were identified as factors participants thought would influence the implementation of such support. The recommendations provide the first evidence-based guidance for specifically supporting veterinary practitioners in relation to adverse events; future work should focus on assessing their implementation and impact.
Mellar P. Davis | Supportive Care in Cancer
Manish Garg | International Journal of Oral and Maxillofacial Surgery
Objective: To identify Australian research priorities for clinical trials in child mental health (0−12 years). Methods: A Delphi consensus study across three rounds was carried out with child mental health 
 Objective: To identify Australian research priorities for clinical trials in child mental health (0−12 years). Methods: A Delphi consensus study across three rounds was carried out with child mental health professional and lived experience experts. Potential research priorities for rating by the experts were identified from a rapid review; content analysis of government strategies and targeted calls for research; and panellists’ suggestions. The highest rated priorities were then reduced to a smaller number of top priorities using a resource allocation exercise. Results: A total of 391 potential priorities were rated by 66 panellists. Panellists endorsed 75 priorities for trials covering a range of mental health interventions (promotion, prevention, assessment, and treatment), as well as overarching priorities applicable to all types of trials. The final resource allocation exercise refined these further to 12 top research priorities, including two promotion trial priorities, seven prevention and assessment trial priorities, and four treatment trial priorities. Conclusion: Results will aid the Growing Minds Australia Clinical Trials Network’s review, prioritisation, and endorsement of future clinical trials in child mental health. The findings can also be used to inform key stakeholders in child mental health on where clinical trial research efforts have focused in the past and what should be considered a priority in the future.
<title>Abstract</title> Importance: The Gaylord Occupational Therapy Cognitive Screen (GOT-Cog©) is a novel screen developed to better inform inpatient occupational therapy treatment planning. Previous studies have shown that GOT-Cog has excellent 
 <title>Abstract</title> Importance: The Gaylord Occupational Therapy Cognitive Screen (GOT-Cog©) is a novel screen developed to better inform inpatient occupational therapy treatment planning. Previous studies have shown that GOT-Cog has excellent content, construct, and criterion validity, and good internal consistency. Objective To assess the rater reliability and responsiveness of the GOT-Cog. Design: Convergent parallel mixed methods research design. Setting: Long-term acute care hospital (LTACH). Participants: Participants were recruited from inpatients admitted with an order for occupational therapy services. Intervention: Participants were given GOT-Cog three times, twice at admission over two consecutive days, and again at discharge. When the first two assessments were collected by different investigators, interrater reliability was tested; when collected by the same investigator, intrarater reliability was tested. The first and final GOT-Cog scores were used to assess effect size and responsiveness. Outcomes and Measures: Primary outcome measure was the GOT-Cog total score. Rater reliability was evaluated using interclass correlation coefficients (ICCs), while responsiveness was calculated using effect size and score change. Results Interrater reliability of GOT-Cog was found to be moderate-to-good [ICC<sub>2,1</sub> (95% CI) = 0.80 (0.71, 0.87), r = 0.81, n = 87], and intrarater reliability was good-to-excellent [ICC<sub>2,1</sub> (95% CI) = 0.84 (0.76, 0.90), r = 0.86, n = 89]. GOT-Cog demonstrated a small effect size from admission to discharge (d = 0.37, n = 149) over a mean (95% CI) length of stay of 24.06 (20.70, 27.41, n = 192) days. Conclusions This work supports our previously published works, which indicate GOT-Cog has the necessary validity and reliability needed to support its use in the LTACH setting with a mixed medically complex inpatient population. Plain-Language Summary: This publication summarizes the measures' overall reliability and responsiveness by reporting on the intrarater and interrater reliability in addition to the responsiveness of the Gaylord Occupational Therapy Cognitive screen.
Chinese older adults with chronic diseases often require long-term medication use. While medication safety education can improve health outcomes and mitigate risks, existing programs lack systematic and comprehensive frameworks. This 
 Chinese older adults with chronic diseases often require long-term medication use. While medication safety education can improve health outcomes and mitigate risks, existing programs lack systematic and comprehensive frameworks. This study aimed to develop Delphi-based consensus content to enhance home-based medication safety education for this population. A two-round Delphi study was conducted from June to August 2022 with 16 experts in clinical medicine and pharmacy (87.50% holding senior professional titles). Expertise levels included four experts with >10 years, five with >20 years, and seven with >30 years of experience. Using the WHO's 5 Moments for Medication Safety framework, a three-part questionnaire was designed: (a) sociodemographics; (b) expert familiarity and importance ratings of indicators; (c) evaluation form for home-based medication safety education. Key metrics included response rates, expert authority coefficient (Cr), coefficient of variation (CV), and Kendall's W for consensus. Response rates were 80.00% (Round 1) and 100% (Round 2), meeting validity thresholds. High expert authority was demonstrated (Cr: 0.917 and 0.933). Consensus improved across rounds (CV: 0.22 and 0.13; Kendall's W: 0.354 and 0.257, both p < 0.001). After iterative revisions and panel discussions, a finalized system comprising five first-level and 22 second-level items was established. We specially designed a content system for medication safety education for older adults. Future researchers could focus on implementing this content system to provide medication safety education for patients.
ABSTRACT This study utilized expert consensus to develop counseling competencies for rural practicing counselors, acknowledging the unique challenges of rural counseling. Employing the Delphi method, the study engaged 15 expert 
 ABSTRACT This study utilized expert consensus to develop counseling competencies for rural practicing counselors, acknowledging the unique challenges of rural counseling. Employing the Delphi method, the study engaged 15 expert panelists across three rounds to identify and refine essential knowledge, skills, and attitudes and beliefs necessary for effective practice in rural settings. The initial round gathered qualitative input on necessary competencies, which informed the development of 96 competency statements evaluated for their essentialness in subsequent rounds. The consensus reached on these statements highlights key competencies crucial for rural counseling practice. The findings offer valuable insights for counselor educators, clinicians, and supervisors, providing a foundation for improving counselor preparation and practice in rural areas. The article concludes with discussions on limitations and recommendations for future research to further enhance rural counseling practices.
| Journal of Thoracic and Cardiovascular Surgery
ABSTRACT Recent climatic events, such as coastal erosion, floods, and elevated temperatures, threaten the planet's sustainability and the well‐being of European coastal cities. These events are expected to increase significantly, 
 ABSTRACT Recent climatic events, such as coastal erosion, floods, and elevated temperatures, threaten the planet's sustainability and the well‐being of European coastal cities. These events are expected to increase significantly, emphasizing the urgent need for careful analysis to inform policy development and prevent dystopian scenarios. In the Futures Studies (FS) context, the development of future scenarios is essential for depicting long‐term outcomes and facilitating effective planning, which can be achieved using various methods, including the Real‐Time Spatial Delphi. This paper applies to the Delphi‐based spatial scenario (DBSS), adopting a novel web‐based open platform, to obtain spatial convergence of opinions among a panel of experts using spatial analysis and statistical indicators. The DBSS method was applied to 10 European coastal areas in seven different countries, involving 167 experts to assess climate impacts in 2050. This paper introduces for the first time, the concept of Asymptotic Theoretical Consensus to obtain a deeper understanding of the dynamic process, including duration, smoothness of convergence, and stability. The identified scenarios validate the proposed method and provide significant benefits to stakeholders, policymakers, local authorities, and governmental bodies in formulating efficacious strategies and confronting the challenges presented by climate change.
Background In Chile, despite high obstetric coverage and consolidated registration systems, there has been a stagnation in the reduction of maternal mortality, reflecting the need to identify social factors and 
 Background In Chile, despite high obstetric coverage and consolidated registration systems, there has been a stagnation in the reduction of maternal mortality, reflecting the need to identify social factors and determinants. These are often overlooked by traditional surveillance systems. Objective To adapt and validate, through expert consensus, a verbal autopsy instrument based on the three delays model, with a gender and intercultural approach. Methods Expert validation study using the Delphi method in three phases, carried out between June and October 2024. Forty experts in maternal health, epidemiological surveillance, gender, and interculturality participated. Seven criteria were evaluated: clarity, relevance, cultural relevance, socio-health relevance, regulatory relevance, and the incorporation of gender and intercultural approaches. The process sought to reach consensus to ensure the methodological and contextual quality of the instrument. Results The final instrument includes 95 items organized into six thematic blocks. An overall consensus of 85% was achieved on the evaluated criteria. The adaptation incorporated variables such as mental health, gender-based violence, ethnic identity, and perceived quality of care. Operational validation identified implementation, logistical, and ethical challenges, leading to a gradual implementation plan in regulatory, pilot, and national expansion phases. Conclusions The instrument adapted and validated by experts offers a complementary tool for monitoring maternal mortality in Chile. Its comprehensive approach would allow identifying social and structural factors associated with maternal deaths, favoring more equitable and culturally relevant interventions aimed at preventing avoidable maternal deaths. Field validation is essential to assess the impact of its application.
Introduction: Necrotising soft tissue infections (NSTI) are serious infections associated with considerable morbidity and mortality. Heterogeneity of outcome reporting in the NSTI literature precludes the synthesis of high-quality evidence. There 
 Introduction: Necrotising soft tissue infections (NSTI) are serious infections associated with considerable morbidity and mortality. Heterogeneity of outcome reporting in the NSTI literature precludes the synthesis of high-quality evidence. There is substantial interest in studying the efficacy of hyperbaric oxygen treatment as an adjunctive treatment in NSTI. The aim of this study was to develop a set of core outcome measures for future trials evaluating interventions for NSTI. Methods: A modified Delphi consensus method was used to conduct a three-round survey of a diverse panel of clinicians and researchers with expertise in NSTI, and patients with lived experience of NSTI. Participants rated the preliminary list of outcomes using a 9-point scale from 1 (least important) to 9 (most critical). The a priori definition of consensus required outcomes to be rated critical (score &amp;#x02265; 7) by &amp;#x02265; 70% of participants, and not important (score &amp;#x02264; 3) by &amp;#x02264; 15% of participants. After meeting consensus, outcomes were removed from subsequent rounds. Outcomes that did not meet consensus were included in subsequent rounds. Results: Ninety-eight participants from 14 countries registered and 86%, 69% and 57% responded for each round, respectively. Outcome measures quantifying five core areas achieved consensus: Death, surgical procedures of debridements and amputations, functional outcome among survivors, measures of sepsis, including septic shock and organ dysfunction and resource use measured through length of hospital and intensive care unit stay. Conclusions: This initial core set of outcome measures will be evaluated and optimised and can harmonise outcome measurements for investigations among patients with NSTI.
Introduction Although frequently seen in clinical services, there are few interventions which have been developed specifically to meet the needs of pre-school children with co-occurring features of a phonological speech 
 Introduction Although frequently seen in clinical services, there are few interventions which have been developed specifically to meet the needs of pre-school children with co-occurring features of a phonological speech sound disorder (P-SSD) and developmental language disorder (DLD). This study aims to achieve consensus on the core elements of a novel intervention for pre-school children with co-occurring features of P-SSD and DLD (“SWanS”- S upporting W ords an d S ounds), where expressive vocabulary and speech comprehensibility are joint outcomes of interest. Methods Forty-seven potential core intervention elements, based on a priori findings and the wider literature, were generated by a diverse steering group of professionals and people with lived experience within a systematic co-design process. This was followed by a modified, two round, e-Delphi with expert Speech and Language Therapists (SLTs) to achieve consensus on the elements. Consensus was defined as over 75% of participants (minimum 30 SLTs) rating the elements as either appropriate or very appropriate on a Likert of 1–5, with an inter-quartile range of one or below. If consensus was not achieved in round 1, free text comments were used to generate amended statements for the second round. Results Consensus was achieved on 42/47 statements in round 1. During the revision process, one statement was discarded; six statements which did not achieve consensus were re-worded; two statements which required further clarity had examples added; four statements were merged into two statements. Consensus was reached on 8/8 statements presented in round 2, resulting in 44 final statements achieving consensus in total. Conclusions Core elements of a novel intervention have been identified through co-design with a diverse group of stakeholders followed by consensus with expert SLTs. Additional flexibility was required within some core elements in order to achieve consensus. Implications for future implementation are discussed.
Menopause defines a transition in women's lives; it can cause physical, psychological and cognitive symptoms that require adaptation. Research shows that menopause-related symptoms can have a negative impact on women's 
 Menopause defines a transition in women's lives; it can cause physical, psychological and cognitive symptoms that require adaptation. Research shows that menopause-related symptoms can have a negative impact on women's self-rated productivity and work ability. The work environment can both promote and hinder the individual's ability to do their work. In a Swedish context, knowledge is lacking on how women experience factors in the work environment that affect work ability. Investigating women's experiences can contribute to new knowledge focusing on increasing the working capacity of the group. To investigate what women in menopause experience as supporting and hindering factors in the work environment. A qualitative method with an inductive approach; through semi structured interviews (N = 6) and qualitative content analysis. Two main categories were identified: The necessity for enhanced awareness and education regarding menopause and Adaptations and recovery opportunities in the work environment. Individual adaptation is crucial due to the personalised impact of the work environment. Awareness and knowledge about menopause and an open and flexible organisational culture facilitate necessary adjustments. Recognising the social environment as a supportive factor is essential. Occupational therapy interventions considering the individual in relation to the workplace environment can contribute to sustainable changes.
Background Outcome measure choice and definition can determine the result of the study. We describe outcome measures and their definitions for cardiovascular studies in highly cited medical journals. Methods Cardiovascular 
 Background Outcome measure choice and definition can determine the result of the study. We describe outcome measures and their definitions for cardiovascular studies in highly cited medical journals. Methods Cardiovascular phase III or IV randomised clinical trials (RCTs) or multicentre observational studies published in the New England Journal of Medicine , Lancet or Journal of the American Medical Association between 1 January 2013 and 6 June 2024 from Embase and Ovid Medline were included. Two independent reviewers selected the studies and extracted the primary and secondary outcome measures from each publication. Results 386 studies (83% RCTs; 17% observational) representing 10 699 147 participants were included. Studies investigated coronary heart disease (51%), cardiomyopathy/heart failure (22%), heart rhythm disease (15%), valvular heart disease (11%) and ‘other’ cardiovascular diseases (1%), with 45% investigating a device and 48% funded by industry. The most frequently reported primary outcome measure was a composite (63%), the most frequent component of which was myocardial infarction (58%). The use of a composite for the primary outcome measure increased from 49% of studies in 2013 to a peak of 85% in 2018. From 2013 to 2023, the median number of secondary outcome measures per study increased for RCTs (3–8) and observational studies (0–7). Definitions for cardiovascular mortality, myocardial infarction and stroke varied across the studies. Conclusions For cardiovascular studies published in highly cited journals, there has been an expansion in the use of primary composite outcome measures and secondary outcome measures, with heterogeneity in the definition of primary outcome measures. A standardised approach to the use of cardiovascular outcomes measures is required.
In the dynamically evolving field of medicine, mentorship is crucial for educating students, and Artificial Intelligence (AI) potentially revolutionizes this process through automated and data-enhanced guidance. This study aims to 
 In the dynamically evolving field of medicine, mentorship is crucial for educating students, and Artificial Intelligence (AI) potentially revolutionizes this process through automated and data-enhanced guidance. This study aims to investigate AI's potential in mentoring medical students by collecting expert opinions, assessing its potential benefits and limitations, and developing a consensus-driven framework for the effective integration of AI-based mentorship into medical education. Specifically, it addresses ethical concerns such as data security, algorithmic bias, and the potential for reduced human interaction. Using a structured online Delphi technique, this interdisciplinary research involved 27 experts in medical education and AI to investigate the intersection of AI with medical mentorship. The study employed both qualitative (e.g., expert interviews) and quantitative (e.g., survey data) research methods, with consensus measured via descriptive and inferential statistics, including Fleiss' kappa and the Intraclass Correlation Coefficient (ICC). Detailed methodological steps, including the selection criteria for experts and the iterative feedback process across the four Delphi rounds, were meticulously followed to ensure robust consensus building. Conducted over four rounds, the Delphi technique achieved substantial consensus among panelists regarding the AI mentors' capabilities and the critical aspects requiring attention, with a kappa value of .79 ([.73-.85]) and high reliability (ICC=.873). The study also compared traditional mentorship roles with those enhanced by AI, highlighting areas where AI can complement and extend human mentorship rather than replace it. Panelists recognized AI mentors' potential to enhance learning processes, while also identifying limitations in areas requiring deep human judgment, emphasizing the need for careful application. AI mentors can significantly guide students across various aspects of medical training, from career planning to achieving academic goals, through personalized learning experiences. They hold promise for improving clinical skills and decision-making abilities through real-time feedback and adaptive learning modules. However, their limitations and the potential risks of overreliance necessitate balanced and cautious application. Ethical considerations, such as ensuring data integrity and preventing bias, are paramount in the deployment of AI mentors. These insights advocate the strategic implementation of AI mentors in medical education, suggesting phased integration and interdisciplinary oversight to harness their full educational potential while mitigating possible drawbacks. Furthermore, the study proposes a hybrid mentorship model that combines AI-driven insights with human empathy and ethical oversight to create a more comprehensive and effective mentorship framework. This study lays the groundwork for future research into the optimal integration of AI in medical mentorship, ensuring ethical standards and maximizing educational benefits, thereby fostering a more effective and humane educational environment.
Background Consolidated, multidisciplinary care for children with cleft palates and craniofacial conditions is ideal, but no-shows and same-day-cancellations hinder such clinics. Solution Additional appointment reminders were ineffective, so we have 
 Background Consolidated, multidisciplinary care for children with cleft palates and craniofacial conditions is ideal, but no-shows and same-day-cancellations hinder such clinics. Solution Additional appointment reminders were ineffective, so we have initiated discussions with our hospital system and electronic medical record provider to implement a predictive risk model for patient non-attendance. What I/we did that is new Our innovative approach focuses on evaluating factors related to clinic non-attendance and engaging stakeholders in designing interventions aimed at increasing patient attendance and clinic utilization.
| Learning Disabilities Research and Practice
Sayan Chatterjee | International Journal of Education Modern Management Applied Science & Social Science
This paper is based on data analysis by python programming language code provided by ChatGPT executed on google collaborator platform, model used as neural network, to understand the trend of 
 This paper is based on data analysis by python programming language code provided by ChatGPT executed on google collaborator platform, model used as neural network, to understand the trend of special weather phenomena for the period March to May, to check the occurrence of special weather event like lightning, thunderstorm, rain, drizzle, squall, during this period, called as Nor ‘wester season and also as pre-monsoon period. Analysis has been done with data starting from the historical period since 1969, as recorded from observation for the station Alipore (42807) and thus with the help of this historical data, predicted the trend of the occurrence of special weather phenomena for the next five years. Analysis has been done with the help of ChatGPT, the chat-bot of artificial intelligence and machine learning. Also, the prediction by ARIMA, code provided by ChatGPT, has been done in addition to compare the result. The source of data is online data supply platform ‘INDIA METEOROLOGICAL DEPARTMENT, PUNE’ and the online site ‘OGIMET’ .The surface data for Alipore (42807) with all relevant weather parameters as available there has been collected in csv file format, since 1969 till 2025,for this season, as available, then uploading the csv file in google collaborator platform ,executed analysis by python neural network model to find the trend of special weather events during the Nor ’wester season (March to May). During this period, the sudden, intense storm usually occur in the afternoon, or evening, which can bring gale-speed winds, localized torrential rains, occasionally accompanied by hailstorms, followed by uprooting trees and waterlogging roads and also brings cooling effect in atmosphere. This phenomenon is called in different name in different region of India, ‘Kal-baisakhi’ in Bengal. In this research, this was the aim, to determine, whether due to global warming, the frequency of this Nor ‘wester is changing or not. So, with the help of data analysis, analysis of big historical data by LSTM, neural network model, the future trend of this weather pattern has been tested to study the nature of change if there is any, and it has been observed as decreasing
Arthrogryposis Multiplex Congenita (AMC) is a rare, non-progressive condition marked by congenital joint contractures and varying degrees of neuromuscular impairment. Its clinical heterogeneity poses significant challenges for physiotherapists in designing 
 Arthrogryposis Multiplex Congenita (AMC) is a rare, non-progressive condition marked by congenital joint contractures and varying degrees of neuromuscular impairment. Its clinical heterogeneity poses significant challenges for physiotherapists in designing effective, consistent rehabilitation pathways. A recent systematic review highlighted the fragmented nature of existing interventions and the urgent need for structured yet adaptable treatment models. This article proposes a shared and modular physiotherapy protocol for individuals with AMC, grounded in multidimensional functional assessment. The approach integrates key domains such as joint mobility, muscle strength, posture, respiratory function, daily living activities, and psychosocial context. By segmenting rehabilitation into age- and severity-specific modules, the proposed model enables clinicians to tailor interventions while maintaining coherence across care settings. Techniques including kinesitherapy, hydrotherapy, respiratory training, orthotic support, and occupational therapy are incorporated within flexible modules. Clinical goals are defined through SMART criteria, fostering measurable outcomes and patient-centered progression. A consensus-building process, such as Delphi methodology, is suggested to validate the model among experts. Expected benefits include enhanced treatment efficacy, reduced clinical variability, improved adherence, and greater caregiver engagement. The model aims to transform AMC rehabilitation from a case-by-case challenge into a replicable and scalable practice. Future research directions include pilot implementation studies, multicentric validations, and the integration of digital monitoring tools. This article marks a transition from evidence synthesis to operational design, offering a practical framework for standardized, personalized care in AMC physiotherapy.
Abstract Background: The consequences of environmental pollution in oncology are well known and should be addressed. Clinical trials in breast cancer typically compare different therapeutic strategies regarding their effect on 
 Abstract Background: The consequences of environmental pollution in oncology are well known and should be addressed. Clinical trials in breast cancer typically compare different therapeutic strategies regarding their effect on survival endpoints such as overall survival, disease-free survival, or patient-reported outcomes like quality of life (QoL). Both endpoints relate to the patients' quantitative (time) and qualitative (QoL) benefits, but they do not reflect the patients' time burden caused by the treatment and the associated environmental burden that can ultimately negatively affect the achieved benefit. Methods: In the ongoing MyTime study (DRKS00033577) during the neoadjuvant treatment of early breast cancer and the PADMA trial (NCT03355157) in the metastatic setting, an enviro-logistical analysis is included to evaluate the logistical burden on the patient and the consequent ecological burden on the environment. Therefore, we propose the clinically relevant key principles of carbon footprint and enviro-logistical analysis that could be incorporated in future breast cancer trials. Results: First, according to different treatment schemes, the necessary number of contacts with the healthcare system should be recorded as a primary variable. Its relevance lies in the logistical analysis of the patients' burden from the treatment. The related parameters to the number of contacts include the time spent on necessary contacts (time burden of the patient due to the therapy) and the climate impact in CO2 equivalents caused by the means of transport. Second, a material evaluation based on the material and energy consumption necessary for the application of the therapy should be assessed using carbon footprinting or streamlined life-cycle assessment methodology. Consequently, the additional therapy-triggered CO2 equivalents are included, and the carbon footprinting is completed. By including the time burden on patients and the consequent environmental burden from transport, materials, and energy consumed, beneficial information for comparing treatment options holistically can be acquired. Conclusions: In summary, while the primary goals will remain survival and QoL, for treatment options with equivalent effectiveness, the enviro-logistically optimal one could be selected to reduce patients' burden and environmental pollution, thereby avoiding secondary negative factors affecting outcomes. Therefore, the enviro-logistical approach should be included in clinical trials. Citation Format: Stefan Lukac, Michael Hiete, Wolfgang Janni, Sibylle Loibl, Visnja Fink, Elena Leinert, Kristina Veselinovic, Henning SchÀffler, Davut Dayan, Sabine Heublein, Florian Ebner. The relevance of carbon footprint in enviro-logistical analysis in breast cancer trials [abstract]. In: Proceedings of the San Antonio Breast Cancer Symposium 2024; 2024 Dec 10-13; San Antonio, TX. Philadelphia (PA): AACR; Clin Cancer Res 2025;31(12 Suppl):Abstract nr P1-06-14.
| Journal of Composite Materials
Abstract Background Point‐of‐care ultrasound (POCUS) is a bedside diagnostic modality that depends on technical, operator‐specific, patient‐specific, and clinical context factors. Existing research reporting guidelines do not explicitly address these considerations 
 Abstract Background Point‐of‐care ultrasound (POCUS) is a bedside diagnostic modality that depends on technical, operator‐specific, patient‐specific, and clinical context factors. Existing research reporting guidelines do not explicitly address these considerations as they pertain to replicability and generalizability of POCUS studies. The objective of this study was to create a framework to assist investigators, reviewers, and clinicians in reporting and evaluating the quality of POCUS research. Methods We applied a two‐stage consensus‐building approach. First, a steering committee reviewed available literature and existing guidelines to generate a novel list of items and explanatory subitems relevant to POCUS research. We vetted the list by soliciting public comments from individuals affiliated with POCUS‐oriented professional organizations. Second, a consensus panel of experts, defined as POCUS researchers with a minimum of three first or senior author, POCUS‐relevant publications completed a three‐round Delphi survey. Consensus was defined as agreement by ≄80% of the panel. Items that did not reach consensus after three rounds were excluded. Results Twenty POCUS experts participated in the study, completing all three survey rounds. The panel reached consensus to include 19/21 items and 62/119 subitems. The resulting instrument addresses variables related to technical hardware and settings (three items), specifics of the POCUS examination (two items), participant characteristics (two items), operator characteristics (five items), data analysis and interpretation (three items), and study‐specific considerations (four items). Conclusions The Standards for Point‐of‐Care Ultrasound Research Reporting (SPUR) can aid researchers, reviewers, and clinicians in the design, dissemination, and critical appraisal of POCUS research.
Introduction The conjunction of physical frailty and cognitive impairment without dementia is described as Cognitive Frailty (CF). Indications that CF is potentially reversible have led to proposals that risk factors, 
 Introduction The conjunction of physical frailty and cognitive impairment without dementia is described as Cognitive Frailty (CF). Indications that CF is potentially reversible have led to proposals that risk factors, symptoms or mechanisms of CF would be appropriate targets for interventions for prevention, delay or reversal. However, no study has brought experts together across sectors to determine targets, content or mode of interventions, and most resources on interventions are from the perspective of academic or clinical researchers only. This international Delphi consensus study brings together experts from academic and clinical research, lay people with lived experience of CF, informal carers, and professional care practitioners/clinicians. Methods Three rounds of Delphi study were held to discern which factors and statements were agreed upon by the whole sample and which generated different views in those with differing expertise. A scoping review and Round 1 (29 participants) were used to gather initial statements. In Round 2, 58 people responded to statements and open text items, comprising 7 lab-based researchers, 27 researchers working with people, 14 people with lived experience or informal family carers, and 10 professional carers/clinicians. Percent agreement and qualitative responses were analyzed to provide a final set of statements which were checked by 38 respondents in Round 3. Results Analysis of Round 2 quantitative data provided 74 statements on which there was at least 70% agreement and qualitative data produced a further 24 statements. These were combined to provide 90 statements for Round 3. There was Consensus for 89 of the statements. A few differences between the groups were observed at both stages. Discussion and conclusion The consensus for statements associated with CF interventions provides a useful first step in defining health promotion activities and interventions. Given the prevalence and potential disability caused by CF in older populations, the consensus statements represent expert opinion that is inter-sectoral and will inform public health policies to support implementation of evidence-based prevention and intervention plans. This study is an important step toward changing current approaches, by including all stakeholders from the outset. Outcomes can be used to feed into co-creation of interventions for cognitive frailty.