Peer-led surgical coaching programmes are recognized increasingly as a performance-enhancing tool for surgeons. In contrast to the established application of video technology in the coaching of elite sportspeople, the use of video analysis within healthcare environments remains limited1. Audiovisual recording has been integrated successfully into multiple exploratory surgical coaching studies with reported benefit to participants, predominantly in the USA2,3. The primary aim of this study was to use a modified e-Delphi technique to establish consensus on essential elements of design, implementation, and outcome measurement to inform the development of an audiovisual technology enhanced coaching programme for consultant surgeons in the UK4,5. The study’s three objectives were to establish the priorities when developing an audiovisually (AV) enhanced surgical coaching programme; gain consensus on essential elements; and rank coaching elements by order of importance to facilitate successful implementation.

A modified e-Delphi study was designed with three sequential rounds utilizing cross-sectional survey design, distributed using REDCap software. (See Supplementary Material S1.) Invited panellists reflected broad and diverse expertise, with those with academic or practical experience of coaching in healthcare, leaders within surgery, medical governance, educationalists, psychologists, and fully qualified general surgeons invited to participate. Purposive sampling was used to promote inclusivity and diversity in recruitment. To mitigate against selection bias, panellists were also identified from research output. Survey statements were rated on level of importance for inclusion in a coaching programme using a 7-point Likert scale (1 = extremely unimportant, 7 = extremely important). Consensus criteria were defined as 70% of participants rating a given statement at 6 or 7. Data were collected between October 2022 and February 2023.

The aim of round 1 was to generate the statements that would be rated in rounds 2 and 3 by establishing panellist perspectives on surgical coaching and the use of audiovisual technology through free-text responses (Supplementary Data S2). Responses were analysed by one researcher (E.G.) and recurring themes identified which were cross checked by a second researcher (S.Y.). Themes were used to generate statements that represented the necessary elements to create and implement a successful surgical coaching programme enhanced by audiovisual recording in the UK. Of the 71 who were invited, 59 experts participated. Ninety-two survey statements were generated regarding surgical coaching and categorized within eight domains: audiovisual technology, programme, formation of coaching pairs, infrastructure, coaching session components, coaching outcome criteria, coaches, and coachees (Supplementary Data S3).

Of the 92 statements considered in Round 2, consensus was reached on 22 statements. Thirty-eight statements were discarded as they were rated a score 6 or a 7 by less than 50% of panellists. The remaining 32 statements were put forward for reconsideration by the panellists in Round 3. Of these statements consensus was found on a further five statements. The 27 consensus statements are displayed in Table 1. The number of statements where consensus was established within their respective domains were Infrastructure: 3, Coaching Session Components: 5, Audiovisual Technology: 4, Programme: 8, Coaches: 5, and Coachees: 2. Notably, consensus was not reached on any of the statements within the Formation of Coaching Pairs or the Coaching Outcome Criteria domains.

Table 1

Final consensus statement

 Median% Score 6/7Interquartile range
Category: coaching programme design strategy
Domain: infrastructure
  Institutional buy-in and promotion of the programme681.21
  Prior consultation and education on the programme with potential participants675.51.9
  Institutional-approved dedicated time to the programme673.52
Domain: coaching programme components
  Goal Setting/Pre-Session Learning Goal Agreement788.71
  Feedback788.71
  Initial Start of Programme Coach–Coachee Meeting786.81
  Future Goals679.21
  Review of Session—Bidirectional Feedback677.41
Domain: audiovisual technology
  Assurance that video will not be used punitively786.81
  Clarification on potential medico-legal issues679.21
  Clear consent process for participants, patients, theatre staff775.51
  Allocated time for video recording review and coaching process673.62
Category: coaching implementation tactics
Domain: programme
  Clear and formal training for coaches prior to participating790.11
  Clear coaching structure which is intuitive to follow681.11
  Clear objectives for the programme779.21
  Structured coaching process that is realistic and easy to follow677.50
  Flexible structure that accommodates variable job plans and on-call commitments675.51
  Programme feedback mechanism675.52
  Programme designed with emphasis on psychological safety and surgeon improvement673.62
  Allocated time within a surgeon job plans/contract671.21
Category: coach–coachee dynamics
Domain: coaches
  Be good communicators790.61
  Be good listeners788.71
  Be able to generate psychological safety786.81
  Be non-judgemental781.11
  Should be able to challenge the coachee constructively677.41
Domain: coachees
  Be given time to reflect on their own performance681.61
  Feel comfortable in a coaching environment to enable professional development680.81
 Median% Score 6/7Interquartile range
Category: coaching programme design strategy
Domain: infrastructure
  Institutional buy-in and promotion of the programme681.21
  Prior consultation and education on the programme with potential participants675.51.9
  Institutional-approved dedicated time to the programme673.52
Domain: coaching programme components
  Goal Setting/Pre-Session Learning Goal Agreement788.71
  Feedback788.71
  Initial Start of Programme Coach–Coachee Meeting786.81
  Future Goals679.21
  Review of Session—Bidirectional Feedback677.41
Domain: audiovisual technology
  Assurance that video will not be used punitively786.81
  Clarification on potential medico-legal issues679.21
  Clear consent process for participants, patients, theatre staff775.51
  Allocated time for video recording review and coaching process673.62
Category: coaching implementation tactics
Domain: programme
  Clear and formal training for coaches prior to participating790.11
  Clear coaching structure which is intuitive to follow681.11
  Clear objectives for the programme779.21
  Structured coaching process that is realistic and easy to follow677.50
  Flexible structure that accommodates variable job plans and on-call commitments675.51
  Programme feedback mechanism675.52
  Programme designed with emphasis on psychological safety and surgeon improvement673.62
  Allocated time within a surgeon job plans/contract671.21
Category: coach–coachee dynamics
Domain: coaches
  Be good communicators790.61
  Be good listeners788.71
  Be able to generate psychological safety786.81
  Be non-judgemental781.11
  Should be able to challenge the coachee constructively677.41
Domain: coachees
  Be given time to reflect on their own performance681.61
  Feel comfortable in a coaching environment to enable professional development680.81
Table 1

Final consensus statement

 Median% Score 6/7Interquartile range
Category: coaching programme design strategy
Domain: infrastructure
  Institutional buy-in and promotion of the programme681.21
  Prior consultation and education on the programme with potential participants675.51.9
  Institutional-approved dedicated time to the programme673.52
Domain: coaching programme components
  Goal Setting/Pre-Session Learning Goal Agreement788.71
  Feedback788.71
  Initial Start of Programme Coach–Coachee Meeting786.81
  Future Goals679.21
  Review of Session—Bidirectional Feedback677.41
Domain: audiovisual technology
  Assurance that video will not be used punitively786.81
  Clarification on potential medico-legal issues679.21
  Clear consent process for participants, patients, theatre staff775.51
  Allocated time for video recording review and coaching process673.62
Category: coaching implementation tactics
Domain: programme
  Clear and formal training for coaches prior to participating790.11
  Clear coaching structure which is intuitive to follow681.11
  Clear objectives for the programme779.21
  Structured coaching process that is realistic and easy to follow677.50
  Flexible structure that accommodates variable job plans and on-call commitments675.51
  Programme feedback mechanism675.52
  Programme designed with emphasis on psychological safety and surgeon improvement673.62
  Allocated time within a surgeon job plans/contract671.21
Category: coach–coachee dynamics
Domain: coaches
  Be good communicators790.61
  Be good listeners788.71
  Be able to generate psychological safety786.81
  Be non-judgemental781.11
  Should be able to challenge the coachee constructively677.41
Domain: coachees
  Be given time to reflect on their own performance681.61
  Feel comfortable in a coaching environment to enable professional development680.81
 Median% Score 6/7Interquartile range
Category: coaching programme design strategy
Domain: infrastructure
  Institutional buy-in and promotion of the programme681.21
  Prior consultation and education on the programme with potential participants675.51.9
  Institutional-approved dedicated time to the programme673.52
Domain: coaching programme components
  Goal Setting/Pre-Session Learning Goal Agreement788.71
  Feedback788.71
  Initial Start of Programme Coach–Coachee Meeting786.81
  Future Goals679.21
  Review of Session—Bidirectional Feedback677.41
Domain: audiovisual technology
  Assurance that video will not be used punitively786.81
  Clarification on potential medico-legal issues679.21
  Clear consent process for participants, patients, theatre staff775.51
  Allocated time for video recording review and coaching process673.62
Category: coaching implementation tactics
Domain: programme
  Clear and formal training for coaches prior to participating790.11
  Clear coaching structure which is intuitive to follow681.11
  Clear objectives for the programme779.21
  Structured coaching process that is realistic and easy to follow677.50
  Flexible structure that accommodates variable job plans and on-call commitments675.51
  Programme feedback mechanism675.52
  Programme designed with emphasis on psychological safety and surgeon improvement673.62
  Allocated time within a surgeon job plans/contract671.21
Category: coach–coachee dynamics
Domain: coaches
  Be good communicators790.61
  Be good listeners788.71
  Be able to generate psychological safety786.81
  Be non-judgemental781.11
  Should be able to challenge the coachee constructively677.41
Domain: coachees
  Be given time to reflect on their own performance681.61
  Feel comfortable in a coaching environment to enable professional development680.81

The five highest rated statements were: Coaches should be good communicators (90.6%), Clear and formal training for coaches prior to participating (90.1%), Coaches should be good listeners (88.7%), Programme Component: Feedback (88.7%), and Programme Component: Goal Setting/Pre-Session Learning Goal Agreement (88.7%).

This study identified 27 essential elements for a video-based UK surgical coaching programme according to a consensus of leading subject matter experts. These findings can inform user-centred design of a video-based coaching for surgeons.

Funding

Not applicable as no external funding, additional payments or support received.

Disclosures

S.Y. reports research grants from the National Institutes for Health, Canadian Department of National Defence, National Aeronautics and Space Association, Melville Trust for Care and Cure of Cancer, Royal College of Surgeons of Edinburgh, Johnson & Johnson, and is a recent past member of the Global Education Council at the Johnson & Johnson Institute, outside the submitted work. No other authors have anything to disclose.

Supplementary material

Supplementary material is available at BJS Open online.

Data availability

Results data can be made available upon reasonable request.

Author contributions

Eilidh Gunn (Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Visualization, Writing—original draft), Adam Johnson (Data curation, Methodology, Writing—review & editing), Riinu Pius (Data curation, Formal analysis, Methodology, Visualization), Douglas Smink (Conceptualization, Supervision, Writing—review & editing), Andrew Tambyraja (Conceptualization, Methodology, Supervision, Writing—review & editing), and Steven Yule (Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing—review & editing)

References

1

Yule
 
S
,
Janda
 
A
,
Likosky
 
DS
.
Surgical sabermetrics: applying athletics data science to enhance operative performance
.
Ann Surg Open
 
2021
;
2
:
e054

2

Gunn
 
EGM
,
Ambler
 
OC
,
Nallapati
 
SC
,
Smink
 
DS
,
Tambyraja
 
AL
,
Yule
 
S
.
Coaching with audiovisual technology in acute-care hospital settings: systematic review
.
BJS Open
 
2023
;
7
:
zrad017

3

Augestad
 
KM
,
Butt
 
K
,
Ignjatovic
 
D
,
Keller
 
DS
,
Kiran
 
R
.
Video-based coaching in surgical education: a systematic review and meta-analysis
.
Surg Endosc
 
2020
;
34
:
521
535

4

Hasson
 
F
,
Keeney
 
S
,
McKenna
 
H
.
Research guidelines for the Delphi survey technique
.
J Adv Nurs
 
2000
;
32
:
1008
1015

5

Fitch
 
K
,
Bernstein
 
SJ
,
Aguilar
 
MD
,
Aguilar
 
MS
,
Burnand
 
B
,
Lazaro
 
P
 et al.  
The Rand/UCLA Appropriateness Method User’s Manual
. Santa Monica, CA:
Rand
,
2001

Author notes

Previously presented at the Association of Surgeons of Great Britain and Ireland (ASGBI) Congress 2023 and published in abstract form as BJS 2023;110, doi: https://doi.org/10.1093/bjs/znad241.268

This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact [email protected] for reprints and translation rights for reprints. All other permissions can be obtained through our RightsLink service via the Permissions link on the article page on our site—for further information please contact [email protected].

Supplementary data