PhD Proposal

Name of applicant: Austin Plunkett

Host institution: Queen Mary University London

Title of research proposal: Quality improvement by Distribution Of Computer-AssisTed Evidence Synopses

Short title: Quality aDvOCATES

Abstract

Musculoskeletal (MSK) conditions are the largest contributor to the burden of disability in the UK, but uptake of evidence by manual therapists who see patients with these conditions remains limited. Policy makers in government and professional bodies, as well as patient representatives, expect these professions to demonstrate evidence-informed practice. However, tight budgetary constraints, diverse working practices, and the complexity of primary care make it challenging to improve the uptake of evidence in these professions.

This demands innovative solutions in the production and dissemination of research evidence to reduce this well-recognised "research-to-practice gap" and to streamline the research-to-practice pipeline. To do this we propose a PhD project to:

  1. Explore, through reviewing the literature, clinician beliefs and attitudes towards evidence to understand barriers and enhancers to receipt and application of information (scoping review).
  2. Explore new and novel ways of encouraging the adoption of evidence informed practice in particular reference to behaviour change theories (scoping review).
  3. Develop IT solutions (including machine learning approaches) to target and source information relevant to osteopathic practice and care.
  4. Based on 1) and 2) develop and devise materials and strategies suited to, and acceptable for, dissemination and uptake by clinicians (feasibility study).
  5. Evaluate, with a sample of osteopaths: receipt and application to practice and impact on patient care (prospective cohort study).

This project has the following aims:

  1. to understand the value that manual therapists and their patients place on priority research topics;
  2. to design, implement and evaluate a programme to increase this perceived value through dissemination via peer advocates;
  3. to overcome bottlenecks in the discovery of relevant research and production of evidence synopses that are agreeable to clinicians.

Ultimately, this will streamline the research-to-practice pipeline and increase the evidential component in interventions delivered by manual therapists, thereby improving patient care and patient perceived benefit.

This project will establish a growing database of evidence synopses on priority clinical topics, and a network of evidence advocates within the osteopathic profession.

Introduction

Background and overview of the literature

The 'research-to-practice gap' describes the well-recognised struggle to put evidence into effective practice. Glasziou and Haynes (2005) use a 'pipeline' analogy and describe evidence 'leaking' at all stages along this pipeline. An estimated 85% of research is squandered (Chalmers and Glasziou 2009) making 'research waste' a priority problem (Chalmers et al 2014). Although the clinical encounter is complex and dynamic (Lau et al 2015) the pipeline model enables identification of 'leakage points' that may be targeted. Specifically, the student will target the following:

  • the 'bottleneck' of summarising evidence (Tsafnat et al 2014)
  • clinician awareness of evidence (Vogel et al 2013; daSilva et al 2015)
  • the beliefs and attitudes of key influencers and their peers (Meats et al 2007; Aarons et al 2016).
Bottlenecks

The pace at which primary research is generated outstrips the capacity for reviewers to summarise it (Tsafnat et al 2014; Olah and Carter 2017). It is recognised that reviews need to be prioritised and streamlined if health-care professionals are to maintain an up-to-date evidence base (Bastian, Glasziou and Chalmers 2010). Despite this, reviews are often out of date due to the resources required to produce them and the high associated cost (Lau et al 2015). Innovation is required to overcome these issues (Bastian, Glasziou and Chalmers 2010).

Computers can increase the efficiency of processing papers for review (Chalmers et al 2014); specifically, machine learning may accelerate the discovery and categorisation of relevant evidence (Tsafnat et al 2014; O'Mara-Eves et al 2015; Mo, Kontonatsios and Ananiadou 2015). Searching databases, "sifting" abstracts, organising papers into topics, and deduplicating papers may all be accelerated, thereby helping to address this bottleneck.

Using machine learning to enable behaviour change strategies is a novel approach in the Allied Health domain. However, the approach of combining human and machine efforts into efficient workflows is being spearheaded by several authorities (Michie et al 2018; Michie et al 2017; Thomas et al 2017). The student will explore whether the time and resources required to review literature for a behaviour change intervention can be significantly reduced.

Clinician awareness: impact and implementation

"[A]ctionable, accessible, and trustworthy information" can help clinicians bring research into their decision making processes (NIHR Dissemination Centre 2016). However, passive dissemination alone has only minimal influence on professional behaviour (Feder et al 1999; Côté et al 2009). Instead, influencing leaders within a profession and professional organisations may be one key to impacting on practitioner beliefs (Aarons et al 2016; McCaughan et al 2002; Kasiri-Martino and Bright 2015; Dannapfel, Peolsson and Nilsen 2013). Identification and recruitment of advocates can increase the incorporation of evidence into clinical practise (Stevans et al 2015) through improved "social validation" i.e. acceptance of change within a peer group (Glasziou and Haynes 2005) and strong "social congruence" i.e. similarity of experiences and practices (Lockspeiser et al 2008). Recognition of clinician involvement in research activities encourages a positive attitude towards learning, and the development of a research culture (Royal College of Physicians 2017).

Any attempt to bridge the gap between evidence-based care and clinician practises should measure impact and reference appropriate theoretical justification (Vachon et al 2013).

Clinician beliefs and attitudes towards evidence

While primary care may be improved by clinicians' reading of evidence summaries (Schneider et al 2015), clinician attitudes are key to successful introduction (Côté et al 2009). Manual therapists may not follow advice in summaries or guidelines for various reasons, including:

  • the size and complexity of research (Haynes and Haines 1998)
  • practical issues including time (Bussières et al 2016)
  • individual and cultural attitudes towards research (Dannapfel, Peolsson and Nilsen 2013)
  • beliefs around professional identity (Evans 2007, 2013; Kasiri-Martino and Bright 2015)
  • misalignment of research with clinician priorities and routines (Bauer et al 2015)
  • reluctance or perceived inability to find and interpret research (Schneider et al 2015, Greenhalgh et al 2002)

Presentation of research in a format that clinicians find agreeable can help overcome these barriers (Wallace, Byrne and Clarke 2014, McCaughan et al 2002) and brief overviews may be more palatable than lengthier formats (Grimshaw et al 2012). There are numerous potential candidate formats, since summary formats and rapid methodologies are under development by many organisations (Tricco et al 2015). Consequently the student will conduct a systematic narrative review of the evidence to determine which methodology may address clinician-related barriers. Systematic narrative reviews combine a systematic search with a narrative critical analysis, aiming to mitigate bias in the selection of papers while permitting a narrative approach for producing insights and recommendations (Weed 2005, Snilstveit, Oliver and Vojtkova 2012).

Role of musculoskeletal therapists and the burden of musculoskeletal disease

People with musculoskeletal (MSK) conditions seek treatment from manual therapists including physiotherapists and osteopaths, who are state-regulated Allied Health professionals. MSK conditions are the largest contributor to the burden of disability in the UK (Arthritis Research UK 2016) costing the UK economy an annual 8.9 million lost work days (Health and Safety Executive 2016) estimated at £7.4 billion per year (Chartered Society of Physiotherapy 2012). MSK disease may be the second most common cause of GP visits, accounting for over 20% of their workload (Arthritis Research UK 2009).

This burden emphasises the importance of finding efficiencies in the evidence-to-practice pipeline, particularly regarding manual therapies.

Method and design

This will be a mixed methods project combining systematic scoping reviews to inform the design, modelling and testing of a complex intervention (a prototype tool for improving database searches, using machine learning techniques with a dissemination strategy) to promote evidence informed practice.

Phase I: Investigation

  1. Explore, through reviewing the literature, clinician beliefs and attitudes towards evidence to understand barriers and enhancers to receipt and application of information (Scoping review).

  2. Explore new and novel ways of encouraging the adoption of evidence informed practice in particular reference to behaviour change theories (scoping review).

Phase II: Development

  1. Develop IT solutions (including machine learning approaches) to target and source information relevant to osteopathic practice and care. This will probably take the form of a pilot system for conducting semi-automated literature searches and topic analysis. This will feature elements of machine learning, including query expansion techniques using word2vec (a neural network that maps words from a given corpus into a numerical 'vector space') and unsupervised topic allocation using latent Dirichlet allocation (a Bayesian approach to modelling the probability that any topic represents a given document), or similar approaches.

Phase III: Model and finalise complex intervention

  1. Develop conceptual models based on phase I and II for potential strategies for dissemination and utilisation of research in practice.

  2. Develop and devise material and strategies suitable and acceptable for dissemination and uptake by clinicians (feasibility study).

Phase IV: Implement and evaluate the intervention

  1. Evaluate, on a sample of osteopaths: receipt and application to practice and impact on patient care (prospective cohort study).

  2. Assess the impact of intervention on clinical practice, through reassessment of clinician attitudes towards evidence based practice and analysis of patient experience and care.

Final output

This research project will take a pragmatic approach, and some elements will be put into immediate practice. The information collected will enable the manual therapy Allied Health Professions to identify mismatches between the expectations of researchers, clinicians and patients regarding evidence-informed practice. This will provide valuable detail for regulators, policy makers and health care commissioners who aim to improve the rate at which evidence is adopted into practice. It will also highlight areas where further research would be beneficial.

It is hoped that this project will provide a template for others who are aiming to improve the efficiency of secondary research, and the impact of research on clinical practice.

Ultimately, this approach will enable the student to create a library of regularly updated synopses for manual therapy Allied Health Professions, and a growing network of clinicians who will advocate within their professions. This approach will be readily adaptable for use by other health-care professions, and generalisable across other practice settings including NHS and private clinics.

Student learning requirements

The student's learning requirements are summarised here:

Methodologies

  • Systematic narrative review methodology.
  • Critical literature review methodology.
  • Qualitative analysis methodology skills, such as thematic analysis.
  • Interview techniques.

Machine learning

  • Query expansion techniques, using word2vec or similar.
  • Methods for unsupervised topic classification, using latent Dirichlet allocation or similar.
  • Statistical methods for evaluating performance of the topic classifier.

QI programme development

  • Basic QI programme development skills.
  • Group leadership and management skills.
  • Group coordination and motivation skills.

Research management

The student will be based within the Complex Intervention and Social Practice in Health Care (CISPHC) Unit located in the Centre for Primary care and Public Health (CPCPH). CPCPH is multidisciplinary, bringing together academics from a range of backgrounds including general practice, medical ethics, nursing, statistics, public health, sociology and psychology, and involved in research, teaching and service development. The Centre was rated fourth in the UK in health services research in the most recent research assessment exercise, with a high proportion of research output rated as internationally leading or of internationally excellent quality. The student would have the benefit of working in this highly specialised team who come from different backgrounds with many areas of expertise.

Within this vibrant and growing Centre, the student will have an exciting and supportive environment for learning and conducting research. There is an active weekly seminar programme where students are encouraged to present, and we have available a range of academic experts and clinicians with experience of dealing with chronic pain who will be able to advise and help the student. We have an established relationship with the Persistent Pain Service at Mile End Hospital and have worked with them closely for the past 4 years. Over the past 3 the Blizard Institute where the Centre for Primary Care and Public Health is based, has established a Graduate Studies Programme and support system with informal PhD student lunches and seminars to ensure high standards of supervision and encourage student interaction and mutual learning.

Timeframe

Start: June 2018

Finish: May 2021

9 month review: March 2019

18 month M Phil upgrade viva: December 2019

30 month viva: December 2020

Governance

Supervisors will comply with national and School of Medicine and Dentistry policies for best practice regarding supervision, feedback, assessment, student representation, progress and review.

Ethical considerations

Ethics approval requirements have been assessed by the Queen Mary University of London (QMUL) Research Ethics team and using the Medical Research Council Health Research Authority study research decision tool (Medical Research Council 2017). NHS Research Ethics Committee approval is not required. The following ethical considerations are noted:

  • This proposal will recruit from private practitioners, not from NHS practitioners.
  • Demographic data will not allow identification of any participants, since questions will be few and very broad.
  • k-anonymity and l-diversity calculations can be conducted to ensure demographic data collected is non-identifiable.
  • Participants are free to cease involvement at any time, and will not be bound by any form of contract.
  • Commitment and distress levels among participants will be monitored.
  • The quality of summaries will be carefully monitored, and they will be edited by the student.

Despite participants being self-selecting, there is a small risk that poor clinical practise might be identified among participants. As part of the programme, all participants will be encouraged to reflect upon their practice and will be supported through regular meetings, existing professional support materials including regulatory guidance. Participants will also be encouraged to present their synopses to their peer-groups. Due to the anonymisation measures described above, it will not be possible to identify clinicians who demonstrate poor practises. However, through the repeated use of the attitude survey described in Phase IV, changes in attitudes towards evidence-informed practice will be evident. This information will be fed back to the profession, including to the regulator, the professional members' organisation, and the educational institutions.

The student will retain editorial control of all summaries. Only summaries that are deemed of acceptable quality will be made public by the student. Advocate participants may be encouraged to publicise their involvement, but formal outputs will only be made public after this review process.

The advocate handbook produced in Phase III will help ensure the process is well-controlled.

Supervisor meetings

A schedule of meetings will be drawn up by the supervisors and student. Following medical school policy, the student and their principal supervisor will meet at least monthly but in the first year of the studentship we plan weekly hour-long meetings between the student and supervisors. The student and supervisors will keep written, agreed, records of all meetings. Supervisors will be available between meetings by e-mail, and for informal meetings as necessary. The student can expect to receive feedback on short written pieces of work within a week and feedback on longer pieces of work (e.g. thesis chapters) within two weeks.

Training and development

The principal supervisor will be responsible for discussing training needs with the student at regular intervals throughout the project and drawing up a training plan together with the student which ensures that they complete the 70 hours per annum transferable skills training recommended by QMUL's training guide, and as part of the QMUL skills-based points system (Researcher Development Department 2018). The principal supervisor will also take responsibility for identifying suitable training. Training will include the induction programme run by the School of Medicine and Dentistry, informal training within CPCPH and formal training inside and outside the School.

QMUL has a strong reputation for innovation through inter-disciplinary and cross-faculty collaboration. The Research Excellence Framework 2014 rated QMUL 5th in the UK for "world-leading or internationally excellent" research outputs, and HEFCE 2013 noted that QMUL has the highest rate for timely PhD completion of any UK university.

Research methods

The CPCPH has expertise in qualitative research methods which are taught in seminars and as part of bachelor- and masters-level courses (School of Medicine and Dentistry 2018). The student could attend modules from these courses to re-familiarise themselves with research approaches and gain new knowledge. This will prepare the student for mixed-methods approaches and for qualitative data analysis including thematic analysis.

Statistical training

Statistical training will be given on the Research methods course but where necessary we will provide specialist training with one or two of our own statisticians from the centre for health sciences. Additionally the Royal Statistical Society run a variety of training courses throughout the year that may be of use.

Systematic narrative and critical literature reviewing

Within CPCPH we have considerable expertise in different aspects of conducting reviews of methodology, including search strategies, data extraction, issues with identifying methodology from papers, and presenting results. The student will receive appropriate training from CPCPH staff and if staff are unavailable we will organise attendance on one of the many courses available in this field.

Machine learning and computational training

The Faculty of Science and Engineering provides expertise and teaching in machine learning and related fields, and The Blizard Institute, where the CPCPH is based, has relationships with this faculty through the programmes including Queen Mary Innovation and the "CANBUILD - deconstructing cancer" project. The student will be able to access modules relating to the computational element of this PhD, contributing to the existing reputation the Blizard Institute has for interdisciplinary research.

General training

The university runs excellent courses for the software applications they will need to be proficient in, for example Endnote, Microsoft Word and PowerPoint. We can also include the PhD student in our M.Sc. for Global Health and Innovation modules such as: introductions to the library and searching electronic data bases. Additionally, there are excellent short course in using statistical software packages. This will also help foster a working team spirit within the CPCPH.

Monitoring progress

The School of Medicine and Dentistry policy will be followed, with a formal progress report and oral examination at 9 months (student progress and plans and a short critical appraisal assessed by supervisors and the Graduate Studies Committee) and transfer from MPhil to PhD within 18 months (via 10,000 word report and viva by two assessors, one external to the Centre). There will be a further report to supervisors at 30 months. Transfer to writing-up status will occur at 36 months. It will be made clear that the student should aim to submit their thesis at about 39 months to enable their PhD award within 4 years of commencing their studentship. At each milestone the student’s personal development plan will be monitored to ensure that they have received the recommended 70 hours per annum transferable skills training.

Finances and funding

Projected costs

Item cost
PhD fees (total for 3 years) £15,000
Computing resource for machine learning £2,500
Website and data hosting £2,000
TOTAL £19,500

Supervision

Supervisor 1: Dr Dawn Carnes [email protected]

Supervisor 2: Dr Carol Fawkes [email protected]

Supervisor 3: Dr Anthony Constantinou [email protected]

References

A Côté, Durand, M., Tousignant, M., & Poitras, S. (2009). Physiotherapists and use of low back pain guidelines: a qualitative study of the barriers and facilitators. Journal of Occupational Rehabilitation, 19(1), 94–105. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/19219536

A O’Mara-Eves, Thomas, J., J McNaught, & Miwa, M. (2015). Using text mining for study identification in systematic reviews: a systematic review of current approaches. Systematic Reviews, 4(5). Retrieved from https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/2046-4053-4-5

Aarons, G. (2004). Mental Health Provider Attitudes Toward Adoption of Evidence-Based Practice: The Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res, 6(2), 61–74. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/15224451

Aarons, G., Green, A., Trott, E., Willging, C., Torres, E., Ehrhart, M., & Roesch, S. (2016). The Roles of System and Organizational Leadership in System-Wide Evidence-Based Intervention Sustainment: A Mixed-Method Study. Administration and Policy in Mental Health and Mental Health Services Research, 1–8. https://doi.org/10.1007/s10488-016-0751-4

American Association for the Advancement of Science. (2014). Information for Authors. Science Translation Medicine. Retrieved from http://www.sciencemag.org/authors/science-translational-medicine-information-authors

André E. Bussières, Zoubi, F. A., Stuber, K., French, S. D., Boruff, J., Corrigan, J., & Thomas, A. (2016). Evidence-based practice, research utilization, and knowledge translation in chiropractic: a scoping review. BMC Complementary and Alternative Medicine, 16(216). https://doi.org/10.1186/s12906-016-1175-0

Andrew Arruda. (2016). ROSS Intelligence announces partnership with BakerHostetler. Retrieved from http://www.prnewswire.com/news-releases/ross-intelligence-announces-partnership-with-bakerhostetler-300264039.html

Arthritis Research UK. (2009). Musculoskeletal Matters: what do general practitioners see? Musculoskeletal Matters Bulletin (Vol. 1, pp. 1–2). Keele University (Arthritis Research UK National Primary Care Centre). Retrieved from http://www.keele.ac.uk/media/keeleuniversity/ri/primarycare/bulletins/MusculoskeletalMatters1.pdf

Arthritis Research UK. (2016). Representation to HM Treasury ahead of the Budget 2016. Retrieved from http://www.arthritisresearchuk.org/ /media/Files/Policy files/2016/Arthritis Research UK representation to HMTreasury ahead of the Budget 2016 Jan 2016.ashx?la=en

Bastian, H., Glasziou, P., & Chalmers, I. (2010). Seventy-Five Trials and Eleven Systematic Reviews a Day: How Will We Ever Keep Up? PLoS Med, 7(9), e1000326. https://doi.org/10.1371/journal.pmed.1000326

Bauer, M., Damschroder, L., Hagerdorn, H., Smith, J., & Kilbourne, A. (2015). An introduction to implementation science for the non-specialist. BMC Psychology, 3(1), 32. https://doi.org/10.1186/s40359-015-0089-9

Borntrager, C., Chorpita, B., Charmaine Higa-McMillan, & Weisz, J. (2009). Provider Attitudes Toward Evidence-Based Practices: Are the Concerns With the Evidence or With the Manuals? Psychiatric Service, 60(5), 677–681. https://doi.org/10.1176/ps.2009.60.5.677

Center for Research in Implementation Science and Prevention. (2013). Dissemination and Implementation in Health: Training Guide and Workbook (1st ed.). University of Colorado. Retrieved from http://www.crispebooks.org/National

Chalmers, I., Bracke, M., Djulbegovic, B., Garattini, S., Grant, J., Gulmezoglu, A., … Oliver, S. (2014). How to increase value and reduce research waste when research priorities are set. The Lancet, 383(9912), 156–165. https://doi.org/10.1016/S0140-6736(13)62229-1

Chalmers, I., & Glasziou, P. (2009). Avoidable waste in the production and reporting of research evidence. The Lancet, 374(9683), 86–89. https://doi.org/10.1016/S0140-6736(09)60329-9

Chandramouli, A., Reddy, A. S., Kudrolli, F., & Fitter, D. (2014). Research as a Service: Ripe and Ready for Prime Time. Cognizant. Retrieved from https://www.cognizant.com/InsightsWhitepapers/Research-as-a-Service-Ripe-and-Ready-for-Prime-Time.pdf

Chartered Society of Physiotherapy. (2012). Health and Social Care Bill – Lords Report Stage briefing: Impact of NHS reforms on musculoskeletal physiotherapy. Chartered Society of Physiotherapy. Retrieved from http://www.csp.org.uk/sites/files/csp/secure/msk_focused_hscbill_lords_briefing_feb2012.pdf

Dannapfel, P., Peolsson, A., & Nilsen, P. (2013). What supports physiotherapists’ use of research in clinical practice? A qualitative study in Sweden. Implementation Science, 8(31). https://doi.org/10.1186/1748-5908-8-31

Dorothy McCaughan, Thompson, C., Cullum, N., Sheldon, T., & Thompson, D. (2002). Acute care nurses’ perceptions of barriers to using research information in clinical decision-making. Journal of Advanced Nursing, 39(1), 46–60. https://doi.org/10.1046/j.1365-2648.2002.02241.x

Evans, D. (2007). Changing the practice of osteopaths, chiropractors and musculoskeletal physiotherapists, in relation to the management of low back pain. Keele University. Retrieved from http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.484899

Evans, D. (2013). Osteopathic principles: more harm than good? International Journal of Osteopathic Medicine, 16(1), 46–53. Retrieved from http://bit.ly/osteopathic-principles

Feder, G., Eccles, M., Grol, R., Griffiths, C., & Grimshaw, J. (1999). Using clinical guidelines. BMJ, 317, 728. Retrieved from http://www.bmj.com/content/318/7185/728.full

Glasziou, P., & Haynes, B. (2005). The paths from research to improved health outcomes. Evidence Based Nursing, 8, 36–38. https://doi.org/10.1136/ebn.8.2.36

Grant, J., Pollitt, A., Potoglou, D., Patil, S., Burge, P., Guthrie, S., … Wooding, S. (2016). Understanding the relative valuation of research impact: a best-worst scaling experiment of the general public and biomedical and health researchers. BMJ Open, 6, e010916. https://doi.org/doi:10.1136/bmjopen-2015-010916

Greenhalgh, T., Hughes, J., Humphrey, C., Rogers, S., Swinglehurst, D., & Martin, P. (2002). A comparative case study of two models of a clinical informaticist service. The BMJ, 324(524). https://doi.org/10.1136/bmj.324.7336.524

Greenhalgh, T., Raferty, J., Hanney, S., & Glover, M. (2016). Research impact: a narrative review. BMC Medicine, 14, 78. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4876557/

Grimshaw, J., Eccles, M., Lavis, J., Hill, S., & Squires, J. (2012). Knowledge translation of research findings. Implementation Science, 7(50). https://doi.org/10.1186/1748-5908-7-50

Haynes, B., & Haines, A. (1998). Barriers and bridges to evidence based clinical practice. BMJ, 317(7153), 273–276. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1113594/

Health and Safety Executive. (2016). Working days lost. Health and Safety Executive. Retrieved from http://www.hse.gov.uk/statistics/dayslost.htm

Kaplan, H., Brady, P., Dritz, M., Hooper, D., Linam, W., Froehle, C., & Margolis, P. (2010). The Influence of Context on Quality Improvement Success in Health Care: A Systematic Review of the Literature. Milbank Quarterly, 88(4), 500–559. https://doi.org/10.1111/j.1468-0009.2010.00611.x

Kasiri-Martino, H., & Bright, P. (2015). Osteopathic educators’ attitudes towards osteopathic principles and their application in clinical practice: A qualitative inquiry. Manual Therapy, 21, 233–240. https://doi.org/10.1016/j.math.2015.09.003

Keyser, D., Harrington, D., & Ahn, H. (2016). A confirmatory factor analysis of the evidence-based practice attitudes scale in child welfare. Children and Youth Services Review, 69, 158–165. https://doi.org/10.1016/j.childyouth.2016.08.005

Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., … Murray, E. (2015). Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews. BMJ Open, 5(e009993). https://doi.org/10.1136/bmjopen-2015-009993

Leach, M., & Gillham, D. (2008). Evaluation of the Evidence-Based practice Attitude and utilization SurvEy for complementary and alternative medicine practitioners. Evaluation in Clinical Practice, 14(5), 792–798. https://doi.org/10.1111/j.1365-2753.2008.01046.x

Liu, P. (2016). Text summarization with TensorFlow. Google Brain Team. Retrieved from https://research.googleblog.com/2016/08/text-summarization-with-tensorflow.html?m=1

Lockspeiser, T., Patricia O’Sullivan, Teherani, A., & Muller, J. (2008). Understanding the experience of being taught by peers: the value of social and cognitive congruence. Advances in Health Science Education, 13, 361–372. https://doi.org/10.1007/s10459-006-9049-8

Meats, E., Brassey, J., Heneghan, C., & Glasziou, P. (2007). Using the Turning Research Into Practice (TRIP) database: how do clinicians really search? Journal of the Medical Library Association, 156–63. https://doi.org/10.3163/1536-5050.95.2.156

Medical Research Council. (2017). Do I need NHS REC approval? An online tool to help decide whether a study requires approval from an NHS Research Ethics Committee. NHS Health Research Authority. Retrieved from http://www.hra-decisiontools.org.uk/research/

Michie, S., Thomas, J., Johnston, M., Aonghusa, P. M., Shawe-Taylor, J., Kelly, M., … West, R. (2017). The Human Behaviour-Change Project: harnessing the power of artificial intelligence and machine learning for evidence synthesis and interpretation. Implementation Science, 12. https://doi.org/10.1186/s13012-017-0641-5

Michie, S., West, R., Johnston, M., Thomas, J., Pol MacAonghusa, Kelly, M., & Shawe-Taylor, J. (2018). The Human Behaviour-Change Project: harnessing computer science to advance behavioural science. University College London. Retrieved from https://osf.io/4msfn/

Mickan, S., Burls, A., & Glasziou, P. (2011). Patterns of “leakage” in the utilisation of clinical guidelines: a systematic review. Postgraduate Medicine Journal. https://doi.org/10.1136/pgmj.2010.116012

Mo, Y., Kontonatsios, G., & Ananiadou, S. (2015). Supporting systematic reviews using LDA-based document representations. Systematic Reviews, 4(172). Retrieved from https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-015-0117-0

Morelli, M. (2016). Using the Plan, Do, Study, Act Model to Implement a Quality Improvement Program in Your Practice. American Journal of Gastroenterology, 111, 1220–1222. https://doi.org/10.1038/ajg.2016.321

National Academy of Sciences. (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. https://doi.org/10.17226/10027

Neta, G., Glasgow, R., Carpenter, C., Grimshaw, J., Rabin, B., Fernandez, M., & Brownson, R. (2015). A Framework for Enhancing the Value of Research for Dissemination and Implementation. American Journal of Public Health, 105(1), 49–57. https://doi.org/10.2105/AJPH.2014.302206

NHS Institute for Innovation and Improvement. (2008). Quality Improvement: Theory and Practice in Healthcare. NHS Institute for Innovation and Improvement. Retrieved from http://www.nhsiq.nhs.uk/media/2441157/quality_improvement-theory_and_practice_in_healthcare.pdf

NIHR Dissemination Centre. (2016). About the NIHR Dissemination Centre. National Institute for Health Research. Retrieved from http://www.dc.nihr.ac.uk/about/

Nykvist, H. (2015). The Vienna Principles. Retrieved from http://ebrnetwork.org/the-vienna-principles/

Ogrinc, G., Davies, L., Goodman, D., Batalden, P., Davidoff, F., & Stevens, D. (2015). SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process. BMJ Quality & Safety, Sep(14). https://doi.org/10.1136/bmjqs-2015-004411

Olah, C., & Carter, S. (2017). Research Debt. Distill. https://doi.org/10.23915/distill.00005

Pincus, T., Foster, N., Vogel, S., Santos, R., Breen, A., & Underwood, M. (2007). Attitudes to back pain amongst musculoskeletal practitioners: A comparison of professional groups and practice settings using the ABS-mp. Manual Therapy, 12(2), 167–175. Retrieved from http://www.sciencedirect.com/science/article/pii/S1356689X06000828

Proctor, E., Powell, B., & J McMillen. (2013). Implementation strategies: recommendations for specifying and reporting. Implementation Science, 8, 139. https://doi.org/doi: 10.1186/1748-5908-8-139

Rankin, G., Rushton, A., Olver, P., & Moore, A. (2012). Chartered Society of Physiotherapy’s identification of national research priorities for physiotherapy using a modified Delphi technique. Physiotherapy, 98(3), 260–272. https://doi.org/10.1016/j.physio.2012.03.002

Renedo, A., Marston, C., Spyridonidis, D., & Barlow, J. (2014). Patient and Public Involvement in Healthcare Quality Improvement: How organizations can help patients and professionals to collaborate. Public Management Review, 17(1), 17–34. https://doi.org/10.1080/14719037.2014.881535

Researcher Development Department. (2018). Development and training for postgraduate research (PhD) students. Queen Mary University of London. Retrieved from https://academicdevelopment.qmul.ac.uk/researcher-development/postgraduate-research-students/

Royal College of Physicians. (2017). Research for all. Sharing good practice in research management. NHS Research and Development Forum. Retrieved from https://www.rcplondon.ac.uk/projects/outputs/research-all-sharing-good-practice-research-management

Rushton, A., Fawkes, C., Carnes, D., & Moore, A. (2014). A modified Delphi consensus study to identify UK osteopathic profession research priorities. Manual Therapy, 19(5), 445–452. https://doi.org/10.1016/j.math.2014.04.013

Schneider, M., Evans, R., Haas, M., Leach, M., Hawk, C., Long, C., … Terhorst, L. (2015). US chiropractors’ attitudes, skills and use of evidence-based practice: A cross-sectional national survey. Chiropractic and Manual Therapies, 23(16). https://doi.org/10.1186/s12998-015-0060-0

School of Medicine and Dentistry. (2018). Intercalated BSc in Medical Education. Queen Mary University of London. Retrieved from http://www.smd.qmul.ac.uk/undergraduate/courses/intercalated-degrees/medical-education/

Snilstveit, B., Oliver, S., & Vojtkova, M. (2012). narrative approaches to systematic review and synthesis of evidence for international developmental policy and practice. Journal of Developmental Effectiveness, 4(3), 409–429. https://doi.org/10.1080/19439342.2012.710641

Stevans, J., Bise, C., John McGee, Miller, D., Rockar, P., & Delitto, A. (2015). Evidence-Based Practice Implementation: Case Report of the Evolution of a Quality Improvement Program in a Multicenter Physical Therapy Organization. Physical Therapy, 95(4), 1–12. https://doi.org/10.2522/ptj.20130541

T daSilva, Costa, L. M., Garcia, A., & Costa, L. P. (2015). What do physical therapists think about evidence-based practice? A systematic review. Manual Therapy, 20(3), 388–401. Retrieved from http://www.sciencedirect.com/science/article/pii/S1356689X1400191X

Taylor, M., Chris McNicholas, Nicolay, C., Darzai, A., Bell, D., & Reed, J. (2013). Systematic review of the application of the plan-do-study-act method to improve quality in healthcare. BMJ Quality & Safety, 23, 290–298. https://doi.org/10.1136/bmjqs-2013-001862

The Evidence Based Research Network. (n.d.). The Vienna Principles. Retrieved from http://ebrnetwork.org/

Thomas, J., Noel-Storr, A., Marshall, I., Wallace, B., Steven McDonald, Mavergames, C., … Elliott, J. (2017). Living systematic reviews: 2. Combining human and machine effort. Journal of Clinical Epidemiology, 91, 31–37. https://doi.org/10.1016/j.jclinepi.2017.08.011

Tricco, A., Zarin, W., Antony, J., Hutton, B., Moher, D., Sherifali, D., & Straus, S. E. (2015). An international survey and modified Delphi approach revealed numerous rapid review methods. Journal of Clinical Epidemiology, 70, 61–67. https://doi.org/10.1016/j.jclinepi.2015.08.012

Tsafnat, G., Dunn, A., Glasziou, P., & Coiera, E. (2014). The automation of systematic reviews. British Medical Journal, 346(f139). https://doi.org/10.1136/bmj.f139

Tsafnat, G., Glasziou, P., Choong, M., Dunn, A., Galgani, F., & Coiera, E. (2014). Systematic review automation technologies. Systematic Reviews, 3(74). https://doi.org/10.1186/2046-4053-3-74

Vachon, B., Bruno Désorcy, Camirand, M., Rodrigue, J., Quesnel, L., Guimond, C., … Grimshaw, J. (2013). Engaging primary care practitioners in quality improvement: making explicit the program theory of an interprofessional education intervention. BMC Health Services Research, 13(106). https://doi.org/10.1186/1472-6963-13-106

Vogel, S., Mars, T., & Barton, T. (2016). It’s hard gaining consent – A qualitative interview study with osteopaths. Manual Therapy. https://doi.org/10.1016/j.math.2016.05.029

Vogel, S., Mars, T., Keeping, S., Barton, T., Marlin, N., Froud, R., … Pincus, T. (2013). Clinical Risk Osteopathy and Management Scientific Report. Retrieved from http://bit.ly/croam-report

Wallace, B., Lau, T. T. J., Brodley, C., & Schmid, C. (2010). Semi-automated screening of biomedical citations for systematic reviews. BMC Bioinformatics, 11(55). https://doi.org/10.1186/1471-2105-11-55

Wallace, J. (2013). Lost in translation: transferring knowledge from research to clinical practice. BJPsych Advances, 19(4), 250–258. https://doi.org/10.1192/apt.bp.112.010389

Wallace, J., Byrne, C., & Clarke, M. (2014). Improving the uptake of systematic reviews: a systematic review of intervention effectiveness and relevance. The BMJ, 4, e005834. https://doi.org/10.1136/bmjopen-2014-005834

Weed, D. (2005). Weight of Evidence: A Review of Concept and Methods. Risk Analysis, 25(6), 1545–1557. https://doi.org/10.1111/j.1539-6924.2005.00699.x

Westhorp, G., Stevens, K., & Rogers, P. (2016). Using realist action research for service redesign. Evaluation, 22(3), 361–379. Retrieved from http://evi.sagepub.com/content/22/3/361

Executive summary

Title of research proposal Quality improvement by DistributiOn of Computer-AssisTed Evidence Synopses

Short title Quality aDvOCATES

Background

Musculoskeletal (MSK) conditions are the largest contributor to the burden of disability in the UK. State regulated Allied Health professions including osteopathy and physiotherapy are predominantly sought by people with MSK conditions. Policy makers, professional bodies, and patient representatives expect these professions to demonstrate evidence-informed practice. However, uptake of evidence by these therapists remains limited due to the complexity of clinical practice and cultural contexts.

This problem is mirrored by the need for research institutions to demonstrate impact while reducing costs. This demands innovative solutions in the production and dissemination of research.

The well-recognised "research-to-practice gap" indicates the persistence of these twin challenges.

Aims and objectives

This project has the following aims:

  1. to understand the value that manual therapists and their patients place on priority research topics;
  2. to design, implement and evaluate a programme to increase this perceived value through dissemintaion via peer advocates;
  3. to overcome bottlenecks in the discovery of relevant research and production of evidence synopses that are agreeable to clinicians.

The objectives are: to investigate factors influencing the value placed on research, and to pilot computer-assisted streamlining of evidence synopsis production. Ultimately, this will increase the evidential component in interventions delivered by manual therapists, thereby improving patient care and patient perceived benefit.

This project will establish a growing database of evidence synopses on priority clinical topics, and a network of evidence advocates within an Allied Health profession.

The student will target the following points at which evidence 'leaks' en route to the patient:

  • the bottleneck of finding and summarising current evidence;
  • clinician awareness of this evidence;
  • negative beliefs among clinicians e.g. they lack the time or skills to understand research.

The student will explore whether:

  • computer assistance can significantly reduce the time and resources required to find and summarise research;
  • peer-group advocates within the osteopathic profession can raise awareness of current research more effectively than passive dissemination;
  • synopses can be produced in a format that is palatable to clinicians.

Method and design

This will be a mixed methods project based on the 'plan, do, study, act' (PDSA) approach. The student will be required to learn the methodologies for, and to conduct, a systematic narrative review, a critical literature review, and a thematic analysis. The student will also be required to implement a prototype tool for improving database searches, using machine learning techniques, a novel approach in the Allied Health domain.

Phase I

Coordinate an expert panel to generate an initial list of priority research topics, building on a previously published Delphi consensus study.

Critical literature review of best-practices in quality improvement (QI) and impact assessment. This will be used to determine the specific approach outlined in Phase IV.

Phase II

Systematic narrative review of "short-form" evidence synopsis methodologies. State-of-the-art literature review of behaviour-change models. These will influence management of volunteers and interpretation of their attitudes towards evidence-informed practice.

Implement and run a pilot system for conducting semi-automated literature searches and topic analysis. This will feature elements of machine learning, including query expansion techniques using word2vec (a neural network that maps words from a given corpus into a numerical "vector space") and unsupervised topic allocation using latent Dirichlet allocation (a Bayesian approach to modelling the probability that any topic represents a given document), or similar approaches.

Phase III

Recruit volunteer advocates and assess their current attitudes to research through one or more of the following: validated survey tool; reflective diaries and interviews; focus group discussions; interviews.

For practical reasons the total number of advocates per cycle will be no more than 10. Recruitment of advocates is a common first step in a PDSA approach.

Phase IV

Guide the advocates in the production of evidence synopses. Upon completion, reassess their attitudes and practises.

Phase V

Repeat cycle of advocate recruitment, synopsis production, and impact assessment from phases III and IV. PDSA is iterative by design, requiring a minimum of two cycles.

After the second iteration the student will produce a thematic analysis of the changes in advocates' attitudes and practises.

Final output

The information collected will enable Allied Health regulators, commissioners and policy makers understand the value that clinicians and patients place on research, thereby identifying hindrances that slow the adoption of evidence into practice. It will also highlight areas where further research would be beneficial.

The student will create a library of regularly-updated evidence synopses for manual therapists, and a growing network of clinicians who will advocate within their profession. It is hoped that this project will provide a template for others who are aiming to improve the efficiency of secondary research, and its impact on clinical practice.

results matching ""

    No results matching ""