The Health Technology Assessment International (HTAi) 2023 Annual Meeting included a novel “fishbowl” session intended to 1) probe the role of HTA in the emergence of generative pretrained transformer (GPT) large language models (LLMs) into health care and 2) demonstrate the semistructured, interactive fishbowl process applied to an emerging “hot topic” by diverse international participants.

The fishbowl process is a format for conducting medium-to-large group discussions. Participants are separated into an inner group and an outer group on the periphery. The inner group responds to a set of questions, whereas the outer group listens actively. During the session, participants voluntarily enter and leave the inner group. The questions for this fishbowl were: What are current and potential future applications of GPT LLMs in health care? How can HTA assess intended and unintended impacts of GPT LLM applications in health care? How might GPT be used to improve HTA methodology?

Participants offered approximately sixty responses across the three questions. Among the prominent themes were: improving operational efficiency, terminology and language, training and education, evidence synthesis, detecting and minimizing biases, stakeholder engagement, and recognizing and accounting for ethical, legal, and social implications.

The interactive fishbowl format enabled the sharing of real-time input on how GPT LLMs and related disruptive technologies will influence what technologies will be assessed, how they will be assessed, and how they might be used to improve HTA. It offers novel perspectives from the HTA community and aligns with certain aspects of ongoing HTA and evidence framework development.

Peer review of searches is a process whereby both the search strategies and the search process description are reviewed, ideally using an evidence-based checklist.

As the search strategy underpins any well-conducted evidence synthesis, its quality could affect the final result. Evidence shows, however, that search strategies are prone to error.

There is increasing awareness and use of the PRESS Evidence-Based Checklist and peer review of search strategies, at the outset of evidence syntheses, prior to the searches being run, and this is now recommended by a number of evidence synthesis organizations.

Searches for evidence syntheses should be peer reviewed by a suitably qualified and experienced librarian or information specialist after being designed, ideally, by another suitably qualified and experienced librarian or information specialist. Peer review of searches should take place at two important stages in the evidence synthesis process; at the outset of the project prior to the searches being run and at the prepublication stage. There is little empirical evidence, however, to support the effectiveness of peer review of searches. Further research is required to assess this. Those wishing to stay up to date with the latest developments in information retrieval, including peer review of searches, should consult the SuRe Info resource (http://www.sure-info.org), which seeks to help information specialists and others by providing easy access to the findings from current information retrieval methods research and thus support more research-based information retrieval practice.

Evidence syntheses of all types have their foundation in literature searches. Literature searching is developing in line with the growing use of evidence synthesis and is also informed, as a field of work, by the spirit of being evidence-based. Increasing numbers of research papers about information retrieval are being published, and keeping up to date with the latest developments in this ever more wide-ranging field is demanding.

Summarized Research in Information Retrieval for HTA (SuRe Info) is a Web site (http://www.sure-info.org) that summarizes research-based information on effective and efficient evidence identification for the different aspects of health technology assessment (HTA) and evidence synthesis. This paper describes the rationale, processes, and challenges of producing SuRe Info and insights into the pace of development in the field of evidence-based information retrieval. The paper also provides scenarios suggesting how SuRe Info can help searchers in their daily work and with specific questions.

SuRe Info currently comprises seventeen chapters, falling into two categories: (i) chapters about general search methods relating to all types of research and (ii) chapters summarizing the methods to use when searching for specific aspects of HTA (as defined in the HTA Core Model® by the European Network for Health Technology Assessment (EUnetHTA)).

SuRe Info is not a substitute for methods handbooks, but by providing an overview of current research evidence for major issues in information retrieval in HTA, it helps searchers in this field to keep abreast of the latest research.

The adoption of evidence-based practice is fundamental to good medical care; it ensures that intervention is clinically effective and safe. In a world of limited healthcare resources, consideration of cost-effectiveness must, unfortunately, restrict clinicians' choice. The National Institute for Health and Clinical Excellence has, for over 10 years, developed guidance to achieve a national consensus on best practice.

This review describes the Institute's methodology, examines guidance relevant to otolaryngology and presents more recent research to update the evidence.