Abstract

Objectives

The Australian Commission on Safety and Quality in Health Care released recommendations for antimicrobial stewardship programmes to be established within all Australian healthcare facilities. However, implementation practices are not well defined. The aim of this study was to gain an understanding of factors affecting implementation of antimicrobial stewardship programmes within Australian regional and rural hospitals.

Methods

This study was designed whereby a preliminary quantitative process was used to contribute to a principally qualitative study. Site visits to regional and rural hospitals in Queensland, New South Wales, Victoria and South Australia were planned to assess factors impacting on implementation of antimicrobial stewardship. Subsequently researchers identified issues requiring further exploration with specific key informant interviews and focus group discussions. Data were collected between May and October 2012 and entered into Nvivo10, openly coded and analysed according to mixed methods data analysis principles.

Results

Regional and rural hospitals were not conducting many of the recommended activities and seven major themes emerged. The key barriers were perceived to be lack of access to education, resources and specialist support. The enablers were a flatter governance structure, greater sense of pride, desire for success and good internet and tele-health access.

Conclusions

This study helps us to identify where efforts should be focused to facilitate the establishment of antimicrobial stewardship programmes in regional and rural hospitals, by describing the gaps and limitations of current programmes and the major issues currently being faced, providing recommendations to better guide activities that support regional and rural hospitals.

Introduction

Antimicrobial stewardship (AMS) programmes are being established in hospitals worldwide, improving clinical outcomes for patients, while limiting the emergence and spread of antimicrobial resistance.1–4 In 2011, the Australian Commission on Safety and Quality in Health Care (ACSQHC) recommended AMS programmes to be established in all Australian hospitals5 and in 2013 AMS became an accreditation standard for all hospitals, including regional and rural facilties.6 It is uncertain whether the ACSQHC recommendations, which are modelled on experience at metropolitan hospitals, can be implemented in the 569 facilities (76%) of Australian public hospitals that are classified as regional or rural.7

International studies describing AMS may not directly compare to the Australian context, in terms of population density, geographical spread and limited infrastructure. Previous studies into AMS within Australia demonstrated wide differences in resources and activities performed between hospitals,8–10 principally in policy development, approval systems, prescription review and auditing,9 which is consistent with international studies.11 These hospitals will need to develop strategies for AMS that are innovative and appropriate to their size, available staff and accessible resources.12 This study aimed to gain an in-depth and corroborated understanding of factors that impact on AMS in Australian regional and rural hospitals.

Methods

This study used mixed methods, whereby a preliminary quantitative process contributed to a principally qualitative study,13–15 allowing researchers to study specific aspects of AMS with exploration of original themes from a range of healthcare professionals and facilities, while triangulating the findings to ensure consistency.

Sampling and recruitment

Purposeful sampling was used to recruit hospitals from the most populous states—Queensland, New South Wales, Victoria and South Australia—including public hospitals of varying size, geographic remoteness and resources. Site visits were arranged to assess different factors that might impact implementation of AMS. Subsequent to the site visits, researchers identified additional issues requiring in-depth exploration with specific key informant interviews and focus group discussions. Participants for the key informant interviews were purposefully selected and invitations for the focus group discussions were circulated through an infectious diseases pharmacist email list.

Data collection

Site visits

A Needs Assessment Survey (NAS) was completed before site visits to collect quantitative information on hospital characteristics, including governance structure, work practices and available resources, and analysed before each visit to guide the selection of participants and the issues to explore. The two South Australian sites did not complete the NAS due to time restraints and the required information was ascertained during the site visit.

Between May and September 2012, researchers consisting of at least one clinical microbiologist and one senior hospital pharmacist (R. J., S. L. and M. A.), conducted the site visits to all participating hospitals, except for one of the South Australian sites where the interviews were conducted by teleconference due to the remoteness of the hospital. Site visits required between 3 and 7 h to complete and consisted of: (i) semi-structured interviews; (ii) focus group discussions; (iii) observational tour; and (iv) document review.

The interviews and focus group discussions were designed to explore the workflow within facilities and examine attitudes, perceived barriers and the acceptability of proposed components of AMS programmes. They were semi-structured with a set of pre-determined key topics to be explored and open-ended questions designed to encourage discussion and the generation of themes. Participants were recruited from three major groupings: For the observational tour, researchers were accompanied by a staff member to areas including the emergency department, ICU, general wards and the pharmacy dispensary. Items including medication charts, imprest stock, restriction lists, in-house guidelines and antimicrobial policies and procedures were viewed to verify information provided in the NAS and offered by participants.

  • executive group—chief executive officers, chief medical officers, hospital administrators, directors of pharmacy and nurse unit managers;

  • clinical champion group—infectious diseases physicians, clinical microbiologists, senior clinicians, AMS pharmacists; and

  • grass roots clinician group—junior doctors, ward pharmacists, infection control practitioners (ICPs) and nurses.

Key informant interviews and focus group discussions

Between June and October 2012 a series of additional key informant interviews and pharmacist focus group discussions were performed to purposefully supplement data collected during the site visits. Interviews were conducted by teleconference using semi-structured interview techniques with a set of pre-determined topics similar to those from the site visits.

Data analysis

All interviews and discussions were audio-recorded while observations and documents reviewed were documented using a checklist and individual field notes. Quantitative and qualitative data from the NAS, site visits and additional key informant interviews and focus group discussions were transcribed and entered into NVivo version 10 (QSR International), openly coded and analysed by two researchers (R. J. and S. L.) according to qualitative data analysis principles.16–20 Quantitative data from the NAS were analysed descriptively both as aggregate data and integrated with qualitative data using a mixed-methods matrix to develop meta inferences for the findings.21,22 The code structure was developed using both an inductive and a deductive approach. To ensure consistency and reliability, both researchers read the transcripts and field notes and met weekly to peer debrief and discuss any inconsistencies in the codes and agree on the themes generated. The major themes developed were compared with those generated through analysis by the NVivo software.

Ethics

Ethics approval was granted by the Human Research Ethics Committees from Melbourne Health, The University of Wollongong, The Prince Charles Hospital and Country Health South Australia.

Results

Hospitals were recruited until there was a diverse range of size and remoteness classification as per the Australian Institute of Health and Welfare (AIHW)7 and saturation was achieved on thematic analysis. The additional key informant interviews and focus group discussions recruited participants from every state and territory (except the Australian Capital Territory, which does not have any regional or rural hospitals). Thirteen hospitals were recruited for site visits with a median of 58 beds (range 10–233), with a wide range of distance from a specialist infectious disease or microbiology service, median 215 km, (range: 0–900 km). The demographics and data obtained by the NAS are summarized in Table 1.

Table 1.

Demographics and staffing of the hospitals participating in the site visits

HospitalDemographics
Staffing
bed numberAIHW peer group classificationremoteness classificationdistance from infectious diseases/microbiology (km)general practitionersstaff specialistsvisiting medical officerscontracted infectious diseases support
onsite clinical pharmacyAMS pharmacist
onsiteoffsite
1233principal referralinner regional160>20>20>20yes
279large regional and remoteinner regional215>2011–20>20yes
3a58rehabilitationmajor city106–101–5yesyesyes
4a169principal referralinner regional01–56–10>20yesyesyes
5a25medium group 2inner regional606–10yesyesyes
620small regional acuteinner regional11011–206–10
710multipurpose serviceouter regional35011–206–10yes
875medium group 1inner regional29011–206–106–10yes
950small remote acuteremote39511–2011–20
1025small non-acuteouter regional2156–106–10
11163principal referralinner regional3901–5>20>20yes
1283large regional and remoteremote9001–56–1011–20yes
1352small regional acuteouter regional4751–51–51–5yes
HospitalDemographics
Staffing
bed numberAIHW peer group classificationremoteness classificationdistance from infectious diseases/microbiology (km)general practitionersstaff specialistsvisiting medical officerscontracted infectious diseases support
onsite clinical pharmacyAMS pharmacist
onsiteoffsite
1233principal referralinner regional160>20>20>20yes
279large regional and remoteinner regional215>2011–20>20yes
3a58rehabilitationmajor city106–101–5yesyesyes
4a169principal referralinner regional01–56–10>20yesyesyes
5a25medium group 2inner regional606–10yesyesyes
620small regional acuteinner regional11011–206–10
710multipurpose serviceouter regional35011–206–10yes
875medium group 1inner regional29011–206–106–10yes
950small remote acuteremote39511–2011–20
1025small non-acuteouter regional2156–106–10
11163principal referralinner regional3901–5>20>20yes
1283large regional and remoteremote9001–56–1011–20yes
1352small regional acuteouter regional4751–51–51–5yes

aNetwork.

Table 1.

Demographics and staffing of the hospitals participating in the site visits

HospitalDemographics
Staffing
bed numberAIHW peer group classificationremoteness classificationdistance from infectious diseases/microbiology (km)general practitionersstaff specialistsvisiting medical officerscontracted infectious diseases support
onsite clinical pharmacyAMS pharmacist
onsiteoffsite
1233principal referralinner regional160>20>20>20yes
279large regional and remoteinner regional215>2011–20>20yes
3a58rehabilitationmajor city106–101–5yesyesyes
4a169principal referralinner regional01–56–10>20yesyesyes
5a25medium group 2inner regional606–10yesyesyes
620small regional acuteinner regional11011–206–10
710multipurpose serviceouter regional35011–206–10yes
875medium group 1inner regional29011–206–106–10yes
950small remote acuteremote39511–2011–20
1025small non-acuteouter regional2156–106–10
11163principal referralinner regional3901–5>20>20yes
1283large regional and remoteremote9001–56–1011–20yes
1352small regional acuteouter regional4751–51–51–5yes
HospitalDemographics
Staffing
bed numberAIHW peer group classificationremoteness classificationdistance from infectious diseases/microbiology (km)general practitionersstaff specialistsvisiting medical officerscontracted infectious diseases support
onsite clinical pharmacyAMS pharmacist
onsiteoffsite
1233principal referralinner regional160>20>20>20yes
279large regional and remoteinner regional215>2011–20>20yes
3a58rehabilitationmajor city106–101–5yesyesyes
4a169principal referralinner regional01–56–10>20yesyesyes
5a25medium group 2inner regional606–10yesyesyes
620small regional acuteinner regional11011–206–10
710multipurpose serviceouter regional35011–206–10yes
875medium group 1inner regional29011–206–106–10yes
950small remote acuteremote39511–2011–20
1025small non-acuteouter regional2156–106–10
11163principal referralinner regional3901–5>20>20yes
1283large regional and remoteremote9001–56–1011–20yes
1352small regional acuteouter regional4751–51–51–5yes

aNetwork.

Relevant quantitative data and a summary of the perceived barriers to AMS implementation from the NAS are displayed in Table 2. Of those with an approval system for restricted antimicrobials, five out of the six required infectious diseases or microbiology support from an offsite facility. Further barriers to effective AMS implementation included lack of expertise within organizations, difficulty in attracting qualified clinicians to act as champions for AMS and lack of financial support.

Table 2.

Summary of data obtained from the NAS

Quantitative data(n = 11a)
Hospitals with an antimicrobial management committee436%
Hospitals with an antimicrobial management policy in place655%
Hospitals where the national antibiotic prescribing guidelines were available11100%
Hospitals with an antimicrobial formulary655%
Hospitals with an antimicrobial approval system in place655%
Hospitals that provide education on antimicrobial prescribing764%
Hospitals performing audits on antimicrobial prescribing764%
Perceived barriers to AMS implementation(n = 11a)
Lack of infectious diseases or microbiology services1091%
Lack of training and education982%
Lack of pharmacy resources982%
Lack of leadership764%
Lack of willingness to change655%
Lack of senior clinician support545%
High level of transient staff545%
Lack of enforcement436%
Quantitative data(n = 11a)
Hospitals with an antimicrobial management committee436%
Hospitals with an antimicrobial management policy in place655%
Hospitals where the national antibiotic prescribing guidelines were available11100%
Hospitals with an antimicrobial formulary655%
Hospitals with an antimicrobial approval system in place655%
Hospitals that provide education on antimicrobial prescribing764%
Hospitals performing audits on antimicrobial prescribing764%
Perceived barriers to AMS implementation(n = 11a)
Lack of infectious diseases or microbiology services1091%
Lack of training and education982%
Lack of pharmacy resources982%
Lack of leadership764%
Lack of willingness to change655%
Lack of senior clinician support545%
High level of transient staff545%
Lack of enforcement436%

aOnly 11 of the 13 hospitals completed the NAS.

Table 2.

Summary of data obtained from the NAS

Quantitative data(n = 11a)
Hospitals with an antimicrobial management committee436%
Hospitals with an antimicrobial management policy in place655%
Hospitals where the national antibiotic prescribing guidelines were available11100%
Hospitals with an antimicrobial formulary655%
Hospitals with an antimicrobial approval system in place655%
Hospitals that provide education on antimicrobial prescribing764%
Hospitals performing audits on antimicrobial prescribing764%
Perceived barriers to AMS implementation(n = 11a)
Lack of infectious diseases or microbiology services1091%
Lack of training and education982%
Lack of pharmacy resources982%
Lack of leadership764%
Lack of willingness to change655%
Lack of senior clinician support545%
High level of transient staff545%
Lack of enforcement436%
Quantitative data(n = 11a)
Hospitals with an antimicrobial management committee436%
Hospitals with an antimicrobial management policy in place655%
Hospitals where the national antibiotic prescribing guidelines were available11100%
Hospitals with an antimicrobial formulary655%
Hospitals with an antimicrobial approval system in place655%
Hospitals that provide education on antimicrobial prescribing764%
Hospitals performing audits on antimicrobial prescribing764%
Perceived barriers to AMS implementation(n = 11a)
Lack of infectious diseases or microbiology services1091%
Lack of training and education982%
Lack of pharmacy resources982%
Lack of leadership764%
Lack of willingness to change655%
Lack of senior clinician support545%
High level of transient staff545%
Lack of enforcement436%

aOnly 11 of the 13 hospitals completed the NAS.

The semi-structured interviews and focus group discussions lasted between 30 and 60 min; information on the participants recruited for these are presented in Table S1 (available as Supplementary data at JAC Online). Following this thematic analysis, there was found to be equivalence between the themes generated by the researchers and the NVivo software. Of the seven major themes that emerged from the data, five of these were consistent between the site visits, key informant interviews and focus group discussions. Relevant quotes from participants pertaining to each major theme developed are presented in Supplementary Data.

Key themes identified

AMS perception refers to what the participants understood by the term ‘Antimicrobial Stewardship’ and its importance within their hospital. There was a wide diversity in the understanding of these concepts5 with staff from larger hospitals, those with impending accreditation and with a clinical pharmacy service having a better understanding.

AMS process refers to the components of an AMS programme, such having endorsed guidelines, a restricted formulary, performing point-of-care intervention with feedback to prescribers and auditing of antimicrobial prescribing practices. There was a wide variation in the processes currently being performed; three of the hospitals performed one out of the five essential AMS components recommended by the ACSQHC6 and five hospitals reported performing all five components.

Access to advice refers to having an arrangement to access infectious diseases physicians, clinical microbiologists or other expert advisory services. Few hospitals had formalized agreements or network-wide specialist resources. Hospitals often had to contact non-affiliated metropolitan hospitals through junior doctors and perceived advice to be inconsistent and sometimes inadequate.

Workforce capacity refers to having an adequate and stable staffing level to effectively manage an AMS programme. There were chronic understaffing and high turnover in many facilities, most noticeably in pharmacy, with difficulty in attracting senior or experienced clinicians. High turnover also prevented consistency and therefore compliance with programmes and did not allow for succession planning.

Education included teaching the basics of antimicrobial prescribing and use, through to specialized training in the implementation and management of AMS. There was a lack of education available, which was seen as the main barrier to AMS implementation.

Governance structure refers to both the overarching governing style of each state with regard to hospital network structure and funding and the management style of the individual facility.

Proposed models of care represent a variety of potential models for AMS that were suggested by participants and discussed within the focus groups and key informant interviews.

Discussion

From the NAS review, staffing and resource allocation varied widely amongst facilities. There was often a lack of specific onsite personnel, including infectious diseases, clinical microbiology and pharmacy, which are seen as essential key resources for any successful AMS programme.23 This is a common finding that has been reported in an international survey of AMS programmes.11 There were limited processes for post-prescription review or auditing, mainly due to the lack of pharmacy services. ICPs often found themselves responsible for AMS, but did not feel they had adequate time, support or expertise.24

Lack of access to education was a major barrier; strategies to address this include developing online modules, credentialing packages or training courses25,26 that remain up to date and are tailored to address local issues. Although there has been a recent move to utilize eLearning technology,27 this has been accepted by nurses and pharmacists better than doctors, and face-to-face and peer-to-peer education was preferred.

The governance structures were highly variable between states and would influence the types of programmes that could be established. Some had clear lines of accountability and support, whereas others reported less clear structures. Programmes would need to be flexible enough to work within these overarching constraints.28 Flatter governance structures with better ‘buy-in’ from the staff and a sense of pride and community with a desire to see their facility succeed were seen as an important enablers.

The strength of this study was that mixed methods were used to triangulate and verify data, allowing staff from many disciplines to be interviewed, gaining different perspectives and the ability to look for consistency in opinions. The observational tours enabled the researchers to independently verify the findings and provide a greater understanding of how AMS may be implemented. Overall, mixed methods research not only led to corroboration, but also increased the breadth of the findings in this study by allowing exploration of unexpected issues. The major limitations of this study were the skill set of the researchers involved and the time available. As participants were recruited on a voluntary basis, there may have been bias towards those that had an interest in AMS. The fact that sampling was diverse and similar findings were obtained from multiple participants meant that it is likely that generalization of these results to other regional and rural hospitals within Australia and internationally is reasonable.

As AMS is now a national standard for Australian hospitals, there is the potential to provide national assistance to hospitals, especially regional and rural hospitals, in implementation and evaluation of their programmes. This may be as a suite of policies and interventions that can be implemented depending on need, resources and available specialists, being customizable to fit into the infrastructure of the hospital.12 There have been few concerted national programmes to assist with AMS implementation; one such model has shown some success in Vietnam.29

Strong buy-in from senior leaders and the administration is imperative, as well as having a local champion who can provide stimulus and initiative to the programme.12,30 These champions may need to be non-specialist staff and include local clinicians and nurses, especially ICPs.11 The role of the nurse in AMS is ever expanding and recent publications have discussed the need for their input, especially in less well-resourced hospitals.29,31,32

Previous studies have shown the benefit of consultation with an infectious diseases service in improving outcome measures.33 A strongly held view was that metropolitan infectious diseases services should provide outreach and oversight to regional and rural facilities. Although these have been previously accessed in an informal manner, participants wanted the arrangements formalized through contracts, with remuneration to encourage long-term relationship building and accountability.8 This has been shown to be an effective model in providing services to facilities with no on-site specialists,34–37 or in finding novel ways to fund such positions.38,39 Microbiology laboratories were also thought to be able to assist with supporting AMS, as these links were much stronger due to historical ties. This has been previously suggested for provision of specialist services.11

In conclusion, this study provides insight into the barriers and enablers for AMS in Australian regional and rural hospitals (Table 3) and provides some recommendations that may support them in implementing or improving AMS programmes (Table 4).

Table 3.

Summary of major barriers and enablers for implementing AMS programmes in regional and rural hospitals

Major barriersMajor enablers
Access to formalized infectious diseases or clinical microbiology supportflat hierarchical structure of governance within small hospitals
Lack of access to education and trainingpride in their local healthcare facilities
Lack of internal expertise within healthcare facilities, namely pharmacists with AMS skillsaccess to national antibiotic prescribing guidelines, freely available to all public healthcare facilities throughout Australia
Difficulty in attracting and retaining qualified clinicians to regional and rural areaslow use of broad-spectrum antimicrobials
Differing governance structures amongst the states and territories and individual facilitiesgood tele-health and internet access
Major barriersMajor enablers
Access to formalized infectious diseases or clinical microbiology supportflat hierarchical structure of governance within small hospitals
Lack of access to education and trainingpride in their local healthcare facilities
Lack of internal expertise within healthcare facilities, namely pharmacists with AMS skillsaccess to national antibiotic prescribing guidelines, freely available to all public healthcare facilities throughout Australia
Difficulty in attracting and retaining qualified clinicians to regional and rural areaslow use of broad-spectrum antimicrobials
Differing governance structures amongst the states and territories and individual facilitiesgood tele-health and internet access
Table 3.

Summary of major barriers and enablers for implementing AMS programmes in regional and rural hospitals

Major barriersMajor enablers
Access to formalized infectious diseases or clinical microbiology supportflat hierarchical structure of governance within small hospitals
Lack of access to education and trainingpride in their local healthcare facilities
Lack of internal expertise within healthcare facilities, namely pharmacists with AMS skillsaccess to national antibiotic prescribing guidelines, freely available to all public healthcare facilities throughout Australia
Difficulty in attracting and retaining qualified clinicians to regional and rural areaslow use of broad-spectrum antimicrobials
Differing governance structures amongst the states and territories and individual facilitiesgood tele-health and internet access
Major barriersMajor enablers
Access to formalized infectious diseases or clinical microbiology supportflat hierarchical structure of governance within small hospitals
Lack of access to education and trainingpride in their local healthcare facilities
Lack of internal expertise within healthcare facilities, namely pharmacists with AMS skillsaccess to national antibiotic prescribing guidelines, freely available to all public healthcare facilities throughout Australia
Difficulty in attracting and retaining qualified clinicians to regional and rural areaslow use of broad-spectrum antimicrobials
Differing governance structures amongst the states and territories and individual facilitiesgood tele-health and internet access
Table 4.

Summary of recommendations to facilitate the establishment of AMS programmes in regional and rural hospitals

Observed gapRecommendations
Access to infectious diseases and clinical microbiology advice and supportdefine clear lines of accountability and responsibility for dedicated specialist service to provide advice and AMS oversight
encourage private pathology companies to participate in AMS activities as part of their provision of service
Education and trainingprovide courses and training on AMS processes and procedures to upskill staff overseeing AMS programmes
develop online education resources designed to suit general hospital staff including nurses, pharmacists and doctors (may be used for credentialing)
Resourcesdevelop incentives to help support and retain staff in regional and rural areas, including capability for career progression
make available examples and templates for policy and procedures, antimicrobial formularies and antimicrobial approval systems
develop a suite of tools that have been validated and endorsed to allow hospitals to assess, benchmark and improve their performance
Observed gapRecommendations
Access to infectious diseases and clinical microbiology advice and supportdefine clear lines of accountability and responsibility for dedicated specialist service to provide advice and AMS oversight
encourage private pathology companies to participate in AMS activities as part of their provision of service
Education and trainingprovide courses and training on AMS processes and procedures to upskill staff overseeing AMS programmes
develop online education resources designed to suit general hospital staff including nurses, pharmacists and doctors (may be used for credentialing)
Resourcesdevelop incentives to help support and retain staff in regional and rural areas, including capability for career progression
make available examples and templates for policy and procedures, antimicrobial formularies and antimicrobial approval systems
develop a suite of tools that have been validated and endorsed to allow hospitals to assess, benchmark and improve their performance
Table 4.

Summary of recommendations to facilitate the establishment of AMS programmes in regional and rural hospitals

Observed gapRecommendations
Access to infectious diseases and clinical microbiology advice and supportdefine clear lines of accountability and responsibility for dedicated specialist service to provide advice and AMS oversight
encourage private pathology companies to participate in AMS activities as part of their provision of service
Education and trainingprovide courses and training on AMS processes and procedures to upskill staff overseeing AMS programmes
develop online education resources designed to suit general hospital staff including nurses, pharmacists and doctors (may be used for credentialing)
Resourcesdevelop incentives to help support and retain staff in regional and rural areas, including capability for career progression
make available examples and templates for policy and procedures, antimicrobial formularies and antimicrobial approval systems
develop a suite of tools that have been validated and endorsed to allow hospitals to assess, benchmark and improve their performance
Observed gapRecommendations
Access to infectious diseases and clinical microbiology advice and supportdefine clear lines of accountability and responsibility for dedicated specialist service to provide advice and AMS oversight
encourage private pathology companies to participate in AMS activities as part of their provision of service
Education and trainingprovide courses and training on AMS processes and procedures to upskill staff overseeing AMS programmes
develop online education resources designed to suit general hospital staff including nurses, pharmacists and doctors (may be used for credentialing)
Resourcesdevelop incentives to help support and retain staff in regional and rural areas, including capability for career progression
make available examples and templates for policy and procedures, antimicrobial formularies and antimicrobial approval systems
develop a suite of tools that have been validated and endorsed to allow hospitals to assess, benchmark and improve their performance

Funding

This work was supported by the National Health and Medical Research Council (grant number APP1013746).

Transparency declarations

None to declare.

Acknowledgements

Poster presentation: Australian Society of Antimicrobials conference, Sydney, 2013 (PO1.8).

Poster presentation: European Congress of Clinical Microbiology and Infectious Diseases, Berlin, 2013 (P868).

We would like to thank all the participants, especially the site coordinators, for completing the NAS and organizing the site visits.

References

1

Carlet
J
,
Jarlier
V
,
Harbarth
S
et al. .
Ready for a world without antibiotics? The Pensières Antibiotic Resistance Call to Action
.
Antimicrob Resist Infect Control
2012
;
1
:
11
.

2

Spellberg
B
,
Bartlett
JG
,
Gilbert
DN
.
The future of antibiotics and resistance
.
New Engl J Med
2013
;
368
:
299
302
.

3

Bartlett
JG
.
A call to arms: the imperative for antimicrobial stewardship
.
Clin Infect Dis
2011
;
53
Suppl 1
:
S4
7
.

4

WHO
.
WHO Global Strategy for Containment of Antimicrobial Resistance 2001. http://www.who.int/drugresistance/WHO_Global_Strategy_English.pdf
.

6

Australian Commission on Safety and Quality in Health Care
.
National Safety and Quality Health Service Standards
.
Sydney
:
ACSQHC
,
2011
. .

7

Australian Institute of Health and Welfare
.
Australian Hospital Statistics 2011–12
.
Canberra
:
AIHW
,
2013
. .

8

Chen
AWJ
,
Khumra
S
,
Eaton
V
et al. .
Snapshot of antimicrobial stewardship in Australian hospitals
.
J Pharm Pract Res
2010
;
40
:
19
25
.

9

James
R
,
McIntosh
K
,
Luu
S
et al. .
Antimicrobial stewardship in Victorian hospitals : a statewide survey to identify current gaps
.
Med J Aust
2013
;
199
:
10
3
.

10

Avent
ML
,
Hall
L
,
Davis
L
et al. .
Antimicrobial stewardship activities: a survey of Queensland hospitals
.
Aust Health Rev
2014
;
38
:
557
63
.

11

Howard
P
,
Pulcini
C
,
Levy Hara
G
et al. .
An international cross-sectional survey of antimicrobial stewardship programmes in hospitals
.
J Antimicrob Chemother
2015
;
70
:
1245
55
.

12

Septimus
EJ
,
Owens
RCJ
.
Need and potential of antimicrobial stewardship in community hospitals
.
Clin Infect Dis
2011
;
53
Suppl 1
:
S8
14
.

13

Morgan
DL
.
Practical strategies for combining qualitative and quantitative methods: applications to health research
.
Qual Health Res
1998
;
8
:
362
76
.

14

Morse
JM
.
Approaches to qualitative-quantitative methodological triangulation
.
Nurs Res
1991
;
40
:
120
3
.

15

Teddlie
C
,
Tashakkori
A
.
Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences
.
Thousand Oaks, CA
:
Sage
,
2009
.

16

Minichiello
V
,
Aroni
R
,
Timewell
E
et al. .
Analysing the data and writing it up
. In:
In Depth Interviewing: Principles, Techniques and Analysis
.
Melbourne
:
Longman Cheshire
,
1995
;
247
81
.

17

Liamputtong
P
.
Making sense of qualitative data: the analysis process
. In:
Qualitative Research Methods
. 3rd edn.
Melbourne
:
Oxford University Press
,
2009
;
277
96
.

18

Morse
J
.
‘Emerging from the data’: the cognitive processes of analysis in qualitative inquiry
. In:
Issues in Qualitative Research Methods
.
Thousand Oaks, CA
:
Sage
,
1994
;
23
43
.

19

Bradley
E
,
Curry
LA
,
Devers
KJ
.
Qualitative data analysis for health services research: developing taxonomy, themes and theory
.
Health Serv Res
2007
;
42
:
1758
72
.

20

Pope
C
,
Ziebland
S
,
Mays
N
.
Qualitative research in health care. Analysing qualitative data
.
BMJ
2000
;
320
:
114
6
.

21

O'Cathain
A
,
Murphy
E
,
Nicholl
J
.
Three techniques for integrating data in mixed methods studies
.
BMJ
2010
;
341
:
1147
50
.

22

Wendler
M
.
Triangulation using a meta matrix
.
J Adv Nurs
2001
;
35
:
521
5
.

23

Ohl
C
,
Dodds
AES
.
Antimicrobial stewardship programs in community hospitals: the evidence base and case studies
.
Clin Infect Dis
2011
;
53
Suppl 1
:
S23
8
.

24

Wright
SB
,
Ostrowsky
B
,
Fishman
N
et al. .
Expanding roles of healthcare epidemiology and infection control in spite of limited resources and compensation
.
Infect Control Hosp Epidemiol
2010
;
31
:
127
32
.

25

Pulcini
C
,
Gyssens
IC
.
How to educate prescribers in antimicrobial stewardship practices
.
Virulence
2013
;
4
:
192
202
.

26

Marwick
C
,
Nathwani
D
.
Improving antimicrobial prescribing through knowledge and skills
.
J Antimicrob Chemother
2007
;
59
:
819
20
.

27

Wentzel
J
,
van Velsen
L
,
van Limburg
M
et al. .
Participatory eHealth development to support nurses in antimicrobial stewardship
.
BMC Med Inform Decis Mak
2014
;
14
:
45
.

28

Murray
E
,
Holmes
A
.
Addressing healthcare-associated infections and antimicrobial resistance from an organizational perspective: progress and challenges
.
J Antimicrob Chemother
2012
;
67
Suppl 1
:
i29
36
.

29

Wertheim
HFL
,
Chandra
A
,
Vu
PD
et al. .
Providing impetus, tools, and guidance to strengthen national capacity for antimicrobial stewardship in Viet Nam
.
PLoS Med
2013
;
10
:
e1001429
.

30

Gillespie
E
,
Rodrigues
A
,
Wright
L
et al. .
Improving antibiotic stewardship by involving nurses
.
Am J Inf Cont
2013
;
41
:
365
7
.

31

Edwards
R
,
Drumright
LN
,
Kiernan
M
et al. .
Covering more territory to fight resistance: considering nurses' role in antimicrobial stewardship
.
J Infect Prev
2011
;
12
:
6
10
.

32

Charani
E
,
Holmes
AH
.
Antimicrobial stewardship programmes: the need for wider engagement
.
BMJ Qual Saf
2013
;
22
:
885
7
.

33

Schmitt
S
,
McQuillen
DP
,
Nahass
R
et al. .
Infectious diseases specialty intervention is associated with decreased mortality and lower healthcare costs
.
Clin Infect Dis
2014
;
58
:
22
8
.

34

Andersen
SE
,
Knudsen
JD
.
A managed multidisciplinary programme on multi-resistant Klebsiella pneumoniae in a Danish university hospital
.
BMJ Qual Saf
2013
;
22
:
907
15
.

35

Yam
P
,
Fales
D
,
Jemison
J
et al. .
Implementation of an antimicrobial stewardship program in a rural hospital
.
Am Health Syst-Pharm
2012
;
69
:
1142
8
.

36

Leung
V
,
Gill
S
,
Sauve
J
et al. .
Growing a ‘positive culture’ of antimicrobial stewardship in a community hospital
.
Can J Hosp Pharm
2011
;
64
:
314
20
.

37

Malani
AN
,
Richards
PG
,
Kapila
S
et al. .
Clinical and economic outcomes from a community hospital's antimicrobial stewardship program
.
Am J Infect Control
2013
;
41
:
145
8
.

38

Storey
DF
,
Pate
PG
,
Nguyen
AT
et al. .
Implementation of an antimicrobial stewardship program on the medical-surgical service of a 100 bed community hospital
.
Antimicrob Resist Infect Control
2012
;
1
:
32
.

39

LaRocco
A
.
Concurrent antibiotic review programs–a role for infectious diseases specialists at small community hospitals
.
Clin Infect Dis
2003
;
37
:
742
3
.

Supplementary data