PRE-ANNUAL MEETING WORKSHOPS DAY 1: SATURDAY, JUNE 15
Full Day Sessions from 08:30 to 16:30
WS01 – Introduction To Ethics In Health Technology Assessment
In this full day workshop delivered in two, same day sessions (morning and afternoon), participants will learn and apply methods that can be used to explore potential ethical implications of health technology. After the workshop, participants will be able to explain and acknowledge the role of ethical issues in HTA; recognize potential ethical issues in HTA and formulate appropriate research questions; know about and use methods for analysing ethical issues; know how to find and critically approach literature used when identifying ethical implications of health care technologies; and describe different ways of synthesizing and communicating the results of an ethics analysis.
WS02 – HTA Approaches For Performance Based Financing in LMIC: An Evidence Implementation Approach
This workshop will include a presentation on the results from a malaria project and the experience with management of uncomplicated malaria in children under five years of age in Cameroon, and will build on lessons learned from HTAi 2018 and the 2018 Setting Priorities Fairly Conference in Accra. It will build capacity in participants to use HTA to inform and update list of services and devices covered by governments in PBF and to assess research evidence from primary research, systematic reviews and clinical practice guidelines in LMIC.At the end, it will develop a comprehensive tool for evidence implementation that can be used in LMIC and made available on the GIN database. Benefits and takeaways for participants will include knowledge and skills on evidence assessment and getting research into practice using an innovative approach and tools for evidence assessment.
WS03 – Health Economics 101: Everyone’s An Economist, They Just Don’t Know It
The workshop consists of five sessions: 1) Resource Scarcity and Opportunity Cost; 2) Principles of Cost Effectiveness Analysis; 3) Affordability and Sustainability; 4) Uncertainty in Decision Making; and 5) Ethics and Equity. By the end of the workshop, participants will understand the key concepts of opportunity cost, value and equity and how current HTA decision-making frameworks apply these concepts to guide health care resource allocation decisions.
WS04 – Listen, Exactly What Do We Each Want from Social Engagement in Health Technology Assessments?
Workshop facilitators will outline the background and key issues for three stakeholder groups. Patient representatives will explain their goals in providing input to HTA processes, reveal some of the strategies they believe are effective and why, and what they could do to increase the value of their input, including using citizen science methods. Representatives of HTA agencies, will reflect on trends in patient input for the different technology types, how they can seek broader social input, as well as from a range of clinicians, and set out to utilize numerical datasets with measurable clinical outcomes to inform overall benefits. Independent researchers, industry representatives and other stakeholders will share observations on patterns related to intentions, processes and outcomes of patient and social engagement in HTA. New tools are being developed for citizen science initiatives that aim to not only collect numerical data and measurable clinical outcomes but also translate them into meaningful life experiences.
Morning Sessions from 08:30 to 12:00
WS05 – Using The GRADE Approach To Assess The Certainty Of Evidence In HTA
This is a hands-on workshop with a mix of interactive presentations and time for participants topractice using GRADE to assess the evidence and to practice using the GRADEpro software. In this workshop, participants will understand how the GRADE approach fits into the overall process of HTA; learn about the GRADE approach to assess the certainty of evidence from a synthesis of randomised or non-randomised studies, including the domains of risk of bias, inconsistency,indirectness, imprecision, publication bias, large effects, dose response and opposing residual confounding; apply this knowledge during hands-on exercises using examples; and create evidence tables using the GRADEpro software (tool co-developed and endorsed by the GRADE Working Group).
WS06 – An Introduction To Early Health Technology Assessment
In this workshop participants will learn the principles of early HTA and apply them in their own case studies. Participants will familiarize themselves with the early HTA approach; the background and theory of evaluation of innovation and concepts such as Collingridge’s dilemma of control; and participatory approaches (e.g. needs assessment among stakeholders) for early HTA and health economic modeling for early HTA. At the end of the workshop, participants will understand what early HTA is, and why and how it can be used in innovative healthcare technologies and how it can steer the development and research of these technologies, and will have gained a basic understanding of the methodologies that can be used for early HTA.
WS07 – Cutting Corners Not Rigor: Using Rapid Review Techniques In Guideline Development
Facilitated by experienced HTA researchers and guideline developers from Australia, Belgium and Canada, the workshop will provide an interactive forum for learning how to rapidly produce a guideline using acceptable shortcuts, and share experiences on fast-track processes, particularly their limitations and where each fit within the efficiency-validity continuum.
The workshop will provide methodologically innovative tools, information and examples of how to keep guideline development processes timely, systematic and methodologically rigorous when faced with such challenges as: avoiding scope creep; accurately representing evidence sources for recommendations constructed from disparate evidence types; using “anchor” guidelines as a baseline; and creating recommendations categories when GRADE is infeasible.At the end of the workshop participants will be able to differentiate between the various guideline development methods; have a clear understanding of the advantages and limitations of using “fast-track” guideline processes; receive a set of practical tools and instruments for adapting and developing guidelines; and have contributed to HTA capacity building by creating new connections with colleagues engaged in guideline development worldwide.
WS08 – A Primer In Regulatory Interactions And Conditional Coverage
This half-day workshop is structured in three sessions of interactive training including presentations, dialogue and debate, simulation and role-play. Participants will be briefed on the HTAi RICC Interest Group and will be provided with an overview of regulatory and HTA interactions in the EU as compared to North America, as well as an introduction to the conditional coverage process and value-based evaluations and differences between the approach for drugs and devices. Upon completion of the workshop, participants will have an improved awareness and knowledge about regulatory interactions and conditional coverage.
Afternoon Sessions from 13:00 to 16:30
WS09 – Rapid Reviews: Providing Timely Evidence For Decision-Makers
This session will be a mix of presentations and small group exercises. Participants will be introduced to rapid review methodology as a mode of knowledge synthesis and provided with an overview of the current rapid review landscape. They will have the opportunity to review and critique completed rapid reviews, debate the strengths and limitations of this assessment approach and evaluate examples for format, suitability for decision making, and perceived utility for relevant stakeholders. The overall goal is for participants to understand issues involved in the conduct of rapid reviews to inform urgent public health decisions and understand how rapid reviews fit into the spectrum of knowledge synthesis review methods.Participants will gain an understanding of a) the concept of rapid reviews; b) the need for, and utility of, rapid reviews as an HTA product; c) methodological approaches that differentiate rapid reviews from traditional systematic reviews; and d) practical issues that have emerged from experiences in providing rapid review products as a decision-making tool.
WS10 – Towards Best Practice: Enhancing The Assessment Process Of Medical Devices
This half-day workshop consists of six pre-defined topic-specific sessions, focusing on key issues of the assessment process, such as how to select medical devices for HTA, timing and purpose of the assessment, how to define the intervention and the research question, use of submission file and manufacturer involvement, and involvement of patients and clinical experts. Each session involves short five-minute presentations from member organizations of EUnetHTA, HTAsiaLink and RedETSA, followed by discussions with the audience, reflecting on and comparing the presentations and adding experience from their own organizations.During this interactive, awareness-raising and capacity building workshop, participants will gain or improve their knowledge about challenges related to assessment of medical devices, hear how other HTA organizations assess medical devices and discuss issues relevant to their own practices. Through presentations, discussions and experience exchange, this workshop aims to contribute to enhanced assessment processes of medical devices across organizations.
WS11 – A Multi-Criteria Decision Process For Value Based Decision Making In Emerging Markets
After an introduction to the principles of simple scoring multi-criteria decision analysis (MCDA), participants will learn about the key elements to consider when developing such a tool in a specific decision context and how these principles have been implemented in the form of a standard spreadsheet tool and will mimic the local implementation process, which is used to tailor the tool to the local decision context in collaboration with all important local decision stakeholders. This workshop aims to describe an option for developing a process for basing pharmaceutical policy decisions in emerging markets on value by adapting and applying a MCDA tool in the local decision context.The participants will learn the key principles of MCDA and how these can be applied in the emerging market decision context through a set of adaptable tools and a standard process involving the important local stakeholders. At the end of the workshop, the participants will receive the spreadsheet-based tool and a checklist for planning the local implementation.
WS12 – Best Practices For Leveraging Artificial Intelligence In The Systematic Literature Review Process
Participants of this workshop will receive a brief overview to provide them with a theoretical baseline for AI, NLP and classifiers in the literature review context, available research on the subject, focusing on the practical implications of the technology, and available technologies and tools that researchers can experiment with as they explore the potential of AI for use in their own literature review process.The workshop will include an interactive portion that will allow participants to experiment, using a sample project, with different applications of AI technology, as well as different parameters, in the review process. The DistillerSR platform will be used as the training tool for this session. Attendees will experiment with different parameters to train an AI to perform screening; use an AI to rank references in order of likeliness for inclusion; use an AI to assist with screening; and, use an AI review screened references for false exclusions. The learning objectives of this workshop are to develop practical knowledge of AI and NLP in the context of reference screening and data extraction in the systematic review process; understand the general consensus on where AI fits in the systematic review process; understand the current limitations of AI and NLP in literature reviews; become familiar with the various NLP-based tools available to assist with reference screening and data extraction; and provide an opportunity to practice using AI in different aspects the review process and to explore the various parameters for its use.
WS13 – Assessing Certainty Of Evidence From Models In HTA And Health Care Recommendations
This workshop will include an introduction to and discussion of types of models being used in various modelling areas in health care; a presentation of the GRADE approach to assessing certainty of evidence; a presentation and discussion of the GRADE framework for assessing the certainty of evidence from models; and group work on an example of the model(s) used for deciding about a screening program. Participants will discuss the question using a real-life guideline examples for testing interventions, assessing the downstream consequences (patient-important outcomes) using modelling estimations, the types of evidence that are required, the types of models and the approaches to assess the certainty of the evidence for the models and the overall certainty of the evidence supporting the final recommendation or decision. Participants will be familiar with the general GRADE approach and the suggested way to incorporate evidence from modelling, assessment and rating of the certainty of evidence from modelling studies used to estimate the downstream outcomes for a test strategy following the GRADE approach and formulating a recommendation for the use of diagnostic tests.
PRE-ANNUAL MEETING WORKSHOPS DAY 2: SUNDAY, JUNE 16
Full Day sessions from 08:30 to 16:30
WS14 – Editors’ Secrets For Authors: How To Get Your Manuscript Accepted
This interactive workshop, arranged by editors of the International Journal of Technology Assessment in Health Care (IJTAHC), will guide authors in structuring and presenting their manuscripts well. Participants will learn the elements of a good scientific paper, how to submit a paper, abstract requirements, what peer-reviewers look at and technical tricks such as timelines for revision, copyright and conflict of interest statements. After the workshop, participants will have an overview of how manuscripts are submitted, evaluated and revised. They will also know about typical reasons for rejection and will be more knowledgeable about the requirements for revision.
WS15 – Advancing Information Retrieval For The New Decade: Automation Tools, CSRs, Search Efficiencies And DTA Studies
Covering four distinct areas, this workshop will 1) introduce a range of automation tools for searching and screening of citations, mapping and describing research studies, conducting evidence surveillance and achieving living systematic reviews; 2) explore the reasons for using CSR’s, the basic structure and content of a CSR and an overview of which sources can be searched to identify CSRs; 3) share exploratory research on whether to search both Medline (via OvidSP) and PubMed in HTA and delve into the reasoning behind why we might search both databases; and 4) share challenges encountered and lessons learned in diagnostic test accuracy (DTA) studies.
WS16 – HTA 102: Hospital-Based HTA In 2020: Facing The Challenge Of Digital Technology
Structured in two parts, this workshop will first provide a series of presentations and discussions on the following topics: 1) The principles of health care management and the role of HTA ; 2) The basics of HB-HTA and its role in the HTA ecosystem; 3) Integrating HTA and procurement processes at hospital level; 4) Assessing digital technologies in hospitals: an HB-HTA approach and 5) Procurement and HTA: an industry’s perspective. Participants will have the opportunity to contribute to overall learning and strategies adopted during case simulations and explore current and future opportunities for improving HTA ecosystem interactivity to support HTA impact at the local level. This workshop aims to explore the main features of health care organizational management and the rationale for HB-HTA, describe HTA and HB-HTA application models and linkages with procurement process and provide an overview of HB-HTA methods, tools and case studies of successful local HTA impact considering the challenges posed by digital medical technologies.
WS17 – Appraising Treatments For Rare Diseases
The workshop will consist of a mix of presentations from researchers, HTA bodies, patient experts and industry. Small group discussion will explore issues and a Nominal Group Technique will be undertaken to do an initial selection of additional criterial for appraisal of treatments for rare diseases beyond those in traditional cost-effectiveness based HTA. The role of Outcome-Based Managed Entry Agreements will be explored, focussing on practical issues of implementing multi-stakeholder agreements in an environment where strict confidentiality must be maintained.The objective of this workshop is to share results emerging from international research on appraisal of rare disease treatments and facilitate multi-stakeholder discussion about what approaches could be practical to implement in collaborative HTAs in future, taking cognizance of the burden on all stakeholders. Outcomes of the workshop will include shared learning on issues related to appraisal of treatments for rare diseases and initial steps in developing consensus on criteria for an HTA appraisal framework for rare disease treatments that will be appropriate beyond 2020.
Morning sessions from 08:30 to 12:00
WS18 – When, Why And How To Conduct An Overview Of Systematic Reviews
This half-day workshop will be divided into two sections, each comprising presentations, published examples, small group interactive activities and time for questions and general discussion.In the first section, participants will be introduced to the concept and purpose of overviews and will learn about important considerations when determining whether and when it is appropriate to conduct an overviews. In small groups, participants will work through different scenarios to determine if an overview is an appropriate evidence synthesis approach to inform decision making.
In the second section, participants will learn the key steps involved in conducting overviews, including common methodological challenges and potential solutions. In small groups, participants will work through one common challenge: determining whether and how to include multiple systematic reviews that examine similar research questions and contain some, but not all, of the same primary studies.Participants can expect to leave this workshop equipped with the knowledge and skills to recognize situations in which overviews represent an appropriate evidence synthesis methodology. Participants will be able to describe the key steps and existing guidance on conducting overviews, appreciate challenges involved when conducting overviews and identify potential solutions to key challenges. They will also be able to appreciate areas of future work for overviews.
WS19 – The GRADE Approach To Evaluating The Certainty Of Evidence Within Health Technology Assessment
This workshop will deepen understanding and gain practical experience in how the GRADE approach can help in harmonizing health technology assessment and enhance collaboration between HTA units and systematic review authors. Specific objectives of the workshop are to introduce the GRADE approach on how to assess the certainty of evidence in health technology assessment, apply the GRADE approach to two examples from health technology assessments that include pharmaceuticals and medical devices and discuss experiences and perspectives about the GRADE approach.
WS20 – Discretely-Integrated Condition Event (DICE) Simulation For HTA
Based on learnings from the initial year of IMPACT HTA work including implementation of DICE at several EU HTA agencies, the workshop will involve interactive work with participants to explain the DICE components and implement a full example using Excel. The implementation will cover a survival partition model, a Markov model and a discrete event simulation. Participants should bring a laptop with Windows MS Excel installed (no other software is required). The attendees are expected to be reasonably familiar with Excel and have a basic understanding of modeling for health care decision making.After attending this workshop, participants should be able to understand its main concepts and their application, explain DICE and how it can be used for HTA, including its advantages and limitations, design and build a DICE model using Excel and review a DICE model built by someone else.
WS21 – Adaptation Of HTA Reports: Case Studies, Tools And Contextualization Issues
This workshop will share experiences using local case studies and cover issues such as scoping for adaptation; processes in place to enable re-use and thus contextualization of HTA reports produced elsewhere; use of a framework to thematically group contextual factors; and the implication of the analysis and the contextualization on the decision-makers. It will include a brief presentation about how agencies are using EUnetHTA assessments and the information being added to support contextualization and a summary of the literature.Participants will discuss different frameworks to tackle bottlenecks in the use of previously conducted HTAs and explore different processes and methods to contextualize evidence using examples of two or three case studies. Participants will gain an understanding of why and when to use other HTA reports and the methods and processes necessary to contextualize them to their health systems and will contribute towards a joint publication.
Afternoon sessions from 13:00 to 16:30
WS22 – How To Make Better Decisions In Healthcare? Use Of GRADE Evidence To Decision Frameworks
This is an interactive workshop that will provide participants the opportunity to acquire the necessary skills to use GRADE’s official app GRADEpro in the HTA/guideline development process, particularly for outcome selection and prioritisation, involving different stakeholders, such as patients, prior to performing the evidence search and using evidence to decision frameworks in order to reach a transparent decision. The outcomes of the workshop will be insight into how the HTA/guidelines decision-making process can be carried out and presented in a more structured manner that is transparent for all stakeholders involved, and to incorporate into the HTA/guidelines decision-making process the added value of participation of different stakeholders
WS23 – Value Framework For HTA In LMIC: The Use Of Evidence-Informed Deliberative Processes
The aim of this workshop is for participants to learn to apply EDPs to optimize HTA processes in LMIC and improve the understanding among participants on the available choices in these processes, based on the theoretical framework of EDPs and best practices of HTA agencies around the world. The components of the workshop will include the use of evidence-informed-deliberative processes, an introduction on the steps of EDPs, an overview of best practices of HTA organizations using EDPs around the world, application of EDPs in practice such as the case of Indonesia and a panel discussion on the practical application of EDPs using one or more cases from the participants.
WS24 – Disinvestment. What, How And By Whom. Lessons Learnt from the Disinvestment Toolkit
The workshop will run along the different sections of the toolkit from the identification of topics, including the sources to be used or considered, to the dissemination of the information obtained. Practical exercises will be done by using existing tools for topic filtration and prioritisation. Interaction with participants will be required for discussions around stakeholder involvement and ethical aspects to bear in mind. The use and utility and interaction with other specialties will be also defined covering the value of Clinical Practice Guidelines to identify topics and the use of variability in practise as a metric to prioritise actions for reassessment.The main outcome of the session is that participants acquire the knowledge and skills to start disinvestment activities. This outcome will be achieved by showing the attendees the different phases of the disinvestment-reassessment process from the identification of topics to the dissemination of the information and the possible measure of the impact. It will also discuss with participants the ethical and organisational implications of the process and the possible ways of engaging stakeholders.
WS25 – HTA 101: Introduction To Health Technology Assessment
HTA 101 will provide a fundamental understanding of HTA for those who are new to the field, a refresher/update content for those with some HTA experience and greater ability to engage in and gain from the scientific program and other aspects of the 2019 Annual Meeting.
WS26 – Can HTAi Support Shift to Value-Based Health-Care Through New Approaches For HTA of Medical Devices
The main objective of this workshop is to gather different stakeholders in a lively discussion platform in order to outline current landscape for the MD and HTA field, to explore how we can improve value based health care through improving HTA methods and approaches for MDs, and to receive feedback on the new HTAi initiative of establishing an HTAi Interest Group on HTA for MDs, including ideas for projects and activities.