Tuesday 10 March 2026 | 13:30-14:30 \u00a0<\/p> \u00a0<\/p> Part 1 – How to weigh an elephant: the art and science of evaluating large scale improvement programmes through a realist lens<\/span><\/strong><\/p> This interactive session will provide intermediate or advanced level improvement practitioners with insights into how context-component-mechanisms-outcomes frameworks (a realist approach) can ensure rigour in the design and evaluation of large-scale improvement programmes. Delegates will hear about how this approach was applied by HSCQI, the health and social care hub for Northern Ireland, in the evaluation of the Timely Access to Safe Care Scale and Spread Programme, which aimed to bring about system-wide improvement by reducing delays and improving equity of access to care across a range of services and pathways. Participants will learn about how the rigorous evaluation of the programme generated a set of practical recommendations for large-scale improvement programmes. They will have an opportunity to reflect on the learning from this study and its implications for the design of large-scale improvement programmes, and how they could utilise a similar, robust approach to evaluation in their own contexts.<\/span><\/span><\/p> \u00a0<\/p> After this session, participants will be able to:<\/span><\/span><\/p> Anita Rowe<\/a><\/strong> HSCQI; Northern Ireland \u00a0<\/p> Evaluation is a critical component of quality improvement (QI) initiatives, yet existing efforts show heterogeneity in approach and rigor. Many emphasize outcome measurement or process fidelity, but few assess the dynamic, adaptive, and context-dependent nature of QI work. Several established Theories, Models, and Frameworks (TMFs) from implementation science (IS) offer valuable components for assisting in evaluation of QI projects. The way IS frameworks are being used to evaluate QI efforts has not been characterized. As Improvement Scientists and practitioners seek to evaluate causal pathways, learning mechanisms, and adaptation processes within complex interventions, understanding the role of IS TMFs in QI evaluation studies becomes increasingly important. This session presents the results from a scoping review mapping the IS TMFs guiding evaluation and causal explanation of QI initiatives. The findings help to identify design elements, methodological strategies, and practical features that can be of value to the Improvement Science community.<\/span> \u00a0<\/p> After this session, participants will be able to:<\/span><\/p> \u00a0<\/p> Pierre Barker<\/a><\/strong>\u00a0Institute for Healthcare Improvement (IHI); USA<\/span><\/span><\/p> \u00a0<\/p> Self-report surveys are pervasive in healthcare and can yield powerful insights for improvers. However, many suffer from bad design and poor response rates, creating confusion among respondents and results that can\u2019t be trusted. In this interactive session, we\u2019ll address common pitfalls and explore some lesser-known design techniques that are helpful for evaluating the impact of quality improvement interventions. We\u2019ll also review the benefits and risks of using generative artificial intelligence to write surveys. Tips for generating high response rates like incentives, marketing, leadership support, etc. will also be included. Lastly, our session will cover approaches for analysing and utilizing survey results, how they can augment other data sources, articulate impact, and be used to drive change. Whether you\u2019re the seasoned psychometric expert or the casual user, our session should provide you with some helpful tips to best use surveys in your improvement work.<\/span><\/p> \u00a0<\/p> After this session, participants will be able to:<\/span><\/p> \u00a0<\/p> Jonathan Burlison<\/a> <\/strong>Improvement Science, St Jude Children’s Research Hospital; USA \u00a0<\/p> \u00a0<\/p> <\/p> Tuesday 10 March 2026 | 13:30-14:30Stream: ScienceSession format: Presentation\u00a0\u00a0Part 1 – How to weigh an elephant: the art and science of evaluating large scale improvement programmes through a realist lensThis interactive session will provide intermediate or advanced level improvement practitioners with insights into how context-component-mechanisms-outcomes frameworks (a realist approach) can ensure rigour in the design […]<\/p>\n","protected":false},"author":32,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1148","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/posts\/1148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/comments?post=1148"}],"version-history":[{"count":0,"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/posts\/1148\/revisions"}],"wp:attachment":[{"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/media?parent=1148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/categories?post=1148"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/internationalforum.bmj.com\/oslo\/wp-json\/wp\/v2\/tags?post=1148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
Stream: Science
Session format: Presentation
<\/strong><\/em><\/span><\/p>
<\/ul>
<\/span><\/p>
<\/span>Part 2 – Current state: how is implementation science being used to support QI evaluation?<\/strong><\/span><\/p>
<\/span><\/p>
<\/ul>
Part 3 – Yes, the world does need another survey: best practice in design, administration and analysis<\/strong><\/span><\/p>
<\/span><\/li>
<\/ul>
Amar Shah<\/a><\/strong>\u00a0NHS England; UK
<\/span><\/p>
","protected":false},"excerpt":{"rendered":"