Abstract

Topoisomerases are essential cellular enzymes that maintain the appropriate topological status of DNA and are the targets of several antibiotic and chemotherapeutic agents. High-throughput (HT) analysis is desirable to identify new topoisomerase inhibitors, but standard in vitro assays for DNA topology, such as gel electrophoresis, are time-consuming and are not amenable to HT analysis. We have exploited the observation that closed-circular DNA containing an inverted repeat can release the free energy stored in negatively supercoiled DNA by extruding the repeat as a cruciform. We inserted an inverted repeat containing a fluorophore-quencher pair into a plasmid to enable real-time monitoring of plasmid supercoiling by a bacterial topoisomerase, Escherichia coli gyrase. This substrate produces a fluorescent signal caused by the extrusion of the cruciform and separation of the labels as gyrase progressively underwinds the DNA. Subsequent relaxation by a eukaryotic topoisomerase, human topo IIα, causes reintegration of the cruciform and quenching of fluorescence. We used this approach to develop a HT screen for inhibitors of gyrase supercoiling. This work demonstrates that fluorescently labeled cruciforms are useful as general real-time indicators of changes in DNA topology that can be used to monitor the activity of DNA-dependent motor proteins.

INTRODUCTION

Emerging resistance to available antibacterial agents, along with the undesirable side effects of many existing antitumor agents, underscore an urgent need for therapeutic compounds that have novel chemical properties (1,2). Success in developing new compounds is expected to be facilitated by the availability of proven drug targets and robust high-throughput (HT) screening methods (3). DNA topoisomerases have proven to be a particularly useful family of targets for small-molecule inhibitors (4–6). Among these inhibitors are the fluoroquinolones (7,8), which are leading antibacterial agents, and the popular anticancer compounds camptothecin, doxyrubicin and etoposide (9–11,5).

Topoisomerases are divided by their mechanism of action into two classes, type I and type II, and categorized further by specific subtypes (12,13). Type II topoisomerases use the energy of ATP hydrolysis to drive DNA cleavage and strand passage that allow a variety of activities such as introduction or removal of supercoils, removal of knots and disentangling of catenated DNA. Gyrase, a bacterial type II topoisomerase, has the unique ability to introduce negative supercoils into DNA (14). Gyrase is a proven drug target that can either be converted to a poison by small molecules (e.g. fluoroquinolones) that stabilize the DNA cleavage state, or be catalytically inhibited by other small molecules (e.g. aminocoumarins) that inhibit the ATPase reaction and block strand passage (15,16). Both poisons and catalytic inhibitors block the introduction of supercoils (16–18), which makes inhibition of supercoiling the most general assay for antigyrase agents. Notably, limited cross-reactivity exists between many types of inhibitors of prokaryotic and eukaryotic type II topoisomerases, and inhibitors of human and bacterial topoisomerases have become successful disease-specific therapeutic agents. For example, bacterial topoisomerase inhibitors (fluoroquinolones) are among the most prescribed antimicrobials in the USA, while human topo II inhibitors, such as doxorubicin and etoposide, are commonly prescribed antitumor agents. Unfortunately, resistance is eroding the utility of quinolone-type compounds (19), whereas the antitumor agents exhibit general toxicity as well as therapeutic benefit (20). Thus, there is an imperative to develop new classes of type II topoisomerase inhibitors (21,22).

In a standard gyrase supercoiling assay, relaxed and supercoiled DNA species produced by the enzyme are resolved on agarose gels. Gel electrophoresis is both time-consuming and labor intensive, making it unsuitable for large-scale inhibition studies. HT assays for supercoiling do exist but rely on indirect reporters [e.g. ethidium bromide intercalation (23), or DNA triplex formation (24)]. The ethidium bromide intercalation assay suffers from a low signal-to-noise ratio, while the triplex formation assay undergoes a drift in signal that has been attributed to either slow binding of the oligonucleotide to the supercoiled plasmid or damage to the supercoiled product; both assays are end point assays and require quenching of the reaction before readout. To overcome these bottlenecks, we developed a robust HT assay for DNA supercoiling that is suitable for the discovery of new classes of topoisomerase inhibitors. Our assay takes advantage of the fact that DNA cruciform extrusion and reintegration accompany changes in DNA supercoiling (25,26). In the substrate reported here, cruciform extrusion results in separation of a fluorophore and quencher, allowing detection of a fluorescent signal produced by a negatively supercoiled plasmid (Figure 1A). We show that this reaction generates a stable product with excellent resolution of relaxed and supercoiled species that can be monitored in a high-density format in real time.

(A) Schematic representation of cruciform extrusion due to negative supercoiling. Plasmid pAT42C contains a 42-bp AT repeat (red and blue) labeled on opposing strands with a fluorophore (fluorescein) and quencher (dabsyl). Treatment with gyrase introduces negative supercoiling, which extrudes the repeat as a cruciform. The separation of fluorescein and dabsyl by cruciform formation allows detection of a fluorescent signal. Topo II can remove supercoils, causing an extruded and fluorescent cruciform to reintegrate. (B) The sequence of the inserted repeat; the sites of fluorophore and quencher modification are indicated by stars as in (A).
Figure 1.

(A) Schematic representation of cruciform extrusion due to negative supercoiling. Plasmid pAT42C contains a 42-bp AT repeat (red and blue) labeled on opposing strands with a fluorophore (fluorescein) and quencher (dabsyl). Treatment with gyrase introduces negative supercoiling, which extrudes the repeat as a cruciform. The separation of fluorescein and dabsyl by cruciform formation allows detection of a fluorescent signal. Topo II can remove supercoils, causing an extruded and fluorescent cruciform to reintegrate. (B) The sequence of the inserted repeat; the sites of fluorophore and quencher modification are indicated by stars as in (A).

MATERIALS AND METHODS

Preparation of the cruciform-forming plasmid

Plasmid pUC19AB was prepared by introducing two point mutations into pUC19 by QuickChange mutagenesis (Agilent, Santa Clara, CA) using the primers GAATTCGGGCTCGGTACTCGGGGATCCTCTAGAG, CTCTAGAGGATCCCCGAGTACCGAGCCCGAATTC, CCAGTGAATTCGGGCTCGGTACCCG and CGGGTACCGAGCCCGAATTCACTGG (Integrated DNA Technologies, San Diego, CA). The nucleotide sequence was confirmed by UC Berkeley DNA Sequencing Facility. pUC19AB was prepared using a Nucleobond PC 10000 kit (Macherey-Nagel, Bethleham, PA) and linearized by digestion with BanII and AvaI (New England Biolabs, Ipswich, MA; 1.6 units/µg DNA) for 6 h at 37°C. The linearized DNA was repurified by chromatography on a Poros HQ column in 0.5 M NaCl, 50 mM Tris, pH 7.9, and 5 mM EDTA and eluted with 1 M NaCl.

5′-phosphorylated cruciform-forming oligonucleotides 5′-CCGACAGCACGAGCCCATATATATATATATATATATA[Dabcyl-dT]ATATATATATATATATATATGGGCCAACCAACCAGCC-3′ and 5′-GGTTGGTTGGCCCATATATATATATATATATA[Fluorescein-dT]ATATATATATATATATATATATGGGCTCGTGCTG-3′ (Midland Certified Reagent Company, Midland, TX) were purified by polyacrylamide gel electrophoresis, lyophilized and dissolved in 10 mM Tris, pH 7.5, 5 mM MgCl2, 1 mM EDTA. The oligonucleotides were annealed by slow cooling from 95 to 16°C over 80 min in a thermocycler (Eppendorf, Hauppauge, NY). Plasmid pAT42C was prepared by ligation of the annealed oligonucleotides into linearized pUC19AB. pUC19AB (7.5 ng/µl) was mixed with equimolar annealed oligonucleotides in 50 mM Tris, pH 7.5, 10 mM MgCl2, 10 mM dithiothreitol (DTT) and 1 mM ATP and ligated by incubation with T4 DNA ligase (New England Biolabs; 62.5 U/µg DNA) for 40 h at room temperature. The ligation reaction was stopped by heating to 65°C for 20 min and then was concentrated by diafiltration using Centricon Plus-70 centrifugal filter units (EMD Millipore, Billerica, MA). Circularized relaxed pAT42C was purified by preparative agarose gel electrophoresis in a Prep Cell (Bio-Rad, Hercules, CA) using 1.2% agarose in Tris-acetate-EDTA buffer containing 1 µg/ml chloroquine. Fractions containing circularized DNA were concentrated by diafiltration. Typical yields of circularized plasmid after purification were 10–15%.

Preparation of topoisomer distributions for 2D gels

To prepare topoisomer distributions of pUC19AB and pAT42C, the plasmids were nicked with Nt.BspQI (New England Biolabs). The plasmids were religated for 75 min at room temperature in the presence of 0–9 µg/ml ethidium bromide. Ethidium bromide was removed by phenol:chloroform extraction, followed by ethanol precipitation in the presence of ammonium acetate. The supercoiling density at which cruciform extrusion occurs was calculated as formula, where Lk is the linking number at which a discontinuity was observed in the 2D gel and Lk0 = 264 for the 2747 base pair pAT42C plasmid.

Protein purification

Escherichia coli GyrA and GyrB were purified separately as described (27). Briefly, the histidine-tagged proteins were expressed in E.coli BL21-CodonPlus(DE3)-RIL cells (Agilent). After initial purification using a Ni-NTA column (GE Life Sciences, Pittsburg, PA), the histidine tags were cleaved by digestion with tobacco etch virus protease, and the proteins were repurified on a Ni-NTA column. After size exclusion chromatography using an S200 column (GE Life Sciences), the proteins in 500 mM KCl, 30% (v/v) glycerol, 1 mM DTT, 1 mM EDTA, 50 mM Tris, pH 7.5, were flash frozen in liquid N2.

Human topo IIα was expressed in BCY123 yeast cells transformed with pCM1 FlhTopoIIα (28). Cells were lysed by mechanical grinding under liquid N2, and lysates were then resuspended in buffer L (25 mM KCl, 50 mM Tris, pH 7.7, 10% (v/v) glycerol, 1 mM EDTA, 1 mM EGTA, 1 mM 2-mercaptoethanol, 1 mM phenylmethanesulfonyl fluoride, 1 µg/ml leupeptin and 1 µM pepstatin A). Resuspension and subsequent purification steps were performed at 4°C. The lysate was centrifuged for 30 min at 25 000g. Polyethyleneimine pH 7.5 was added dropwise to the supernatant from a 10% (w/v) stock to 0.2% final concentration while stirring. The suspension was centrifuged for 10 min at 12 000g, the pellet was resuspended in buffer L1000 (L + 1 M KCl), and the lysate was centrifuged again.

While stirring, ammonium sulfate was added to the supernatant to 35% (w/v) final concentration. The suspension was centrifuged for 25 min at 25 000g, and additional ammonium sulfate was added to the supernatant to 65% (w/v) final concentration. The suspension was centrifuged again, and the pellet was dissolved in buffer L. The solution was injected onto a Poros HS column (Life Technologies, Grand Island, NY) and eluted with a gradient to 100% buffer L1000. Peaks containing topo IIα were identified by sodium dodecyl sulphate–polyacrylamide gel electrophoresis, concentrated and dialyzed overnight against buffer L.

After dialysis, sufficient buffer L1000 was added to the protein to increase [KCl] to 125 mM. The protein was purified using a HiTrap Q HP column (GE Life Sciences) and eluted with a gradient to 100% buffer L1000. Fractions containing topo IIα were concentrated and purified using a Sephacryl S300 column (GE Life Sciences) equilibrated with buffer GFT2 (500 mM potassium acetate, 50 mM Tris, pH 7.9, 1 mM EDTA, 1 mM EGTA, 10% (v/v) glycerol, 1 mM DTT). Pure human topo IIα was concentrated to 34 µM and then diluted with an equal volume of storage buffer (GFT2 + 70% (v/v) glycerol). Aliquots were flash frozen in liquid nitrogen.

Preparation of supercoiled pAT42C

Supercoils were introduced into pAT42C (10 µg/ml) at 37°C in supercoiling buffer (10 mM Tris, pH 7.9, 5 mM HEPES, pH 7.5, 70 mM KCl, 0.1 mg/ml bovine serum albumin, 6 mM MgCl2, 0.6 mM DTT, 13% (v/v) glycerol, 1 mM ATP) for 30 min in the presence of 3 nM E.coli gyrase holoenzyme. The reaction was stopped by the addition of SDS to 1% (w/v) and EDTA to 25 mM. Precipitated potassium dodecyl sulfate was removed by centrifugation, and the supercoiled plasmid was purified using a NucleoSpin Extract II kit (Macherey-Nagel).

HT assay replicate-experiment study

All HT liquid handling operations were performed using a Biomek 3000 liquid handling robot (Beckman Coulter, Brea, CA). Inhibitors listed in Table 1 were purchased from Sigma Aldrich (St. Louis, MO) except for gemifloxacin and moxifloxacin (OChem, Des Plains, IL), and serial dilutions were prepared as 4× stock concentrations in 4% (v/v) dimethyl sulfoxide (DMSO). Supercoiling reactions were performed in Corning 3820 384-well microplates (Corning, Tewksbury, MA) in buffer HT (supercoiling buffer with 5% (v/v) glycerol, 0.1% (v/v) Tween-20) with inhibitors at 1× concentration or 1% DMSO, 0.92 ng/µl relaxed pAT42C and 0.6 nM gyrase. Master mix (16 µl/well) containing enzyme and substrate was dispensed to the microplates, followed by 4× stocks of inhibitors or DMSO (8 µl/well). Reactions were started by addition of ATP to 1 mM (8 µl/well) in 32 µl and were incubated at 37° for 30 min before the plates were read in a Victor 3 V plate reader (Perkin Elmer, Waltham, MA). Water (8 µl) was added to negative control reactions in the place of ATP. Fluorescence for each titration series was normalized to the range of the positive (no inhibitor) and negative (no ATP) control reactions. This experiment was repeated after on 2 separate days. To determine the potency of each inhibitor, inhibition isotherms were fit to the equation formula, where F is normalized fluorescence, Fmax = 1, Fmin = 0, [I] is the inhibitor concentration and γ is a slope parameter. For each inhibitor, the difference in log potencies measured on 2 days was calculated as formula with mean difference formula and standard deviation sd. The mean ratio (MR) for the two-day replicate experiment was calculated as formula. The smallest statistically significant potency ratio between two compounds was calculated as formula. Limits of Agreement were calculated as formula. For each compound, the geometric mean potency ratio (formula) was calculated. The Z’ factor for the assay was calculated as formula, where µ+ and µ are the mean values of the positive and negative controls, and σ+ and σ are the standard deviations of the positive and negative controls. In a typical trial of the replicate-experiment study, µ+ = 2588, σ+ = 119, µ = 10 391, and σ = 356

Table 1.

IC50s determined in replicate cruciform extrusion experiments and in gel-based assay

InhibitorAbbreviationIC50, day 1 (µM)IC50, day 2 (µM)IC50, gel (µM)
Pipemidic acidPipe8074n.d.
Nalidixic acidNal210200n.d.
Oxolinic acidOxo14280n.d.
EnoxacinEnox5.64.8n.d.
NorfloxacinNor3.32.9n.d.
CiprofloxacinCipro1.41.31.2
LevofloxacinLevo2.52.2n.d.
PazufloxacinPazu4.03.3n.d.
SparfloxacinSpar2.01.6n.d.
TrovafloxacinTrova1.91.8n.d.
GemifloxacinGemi1.01.1n.d.
PrulifloxacinPruli1.71.4n.d.
MoxifloxacinMoxi2.82.44.6
NovobiocinNovo2.82.6n.d.
Pipemidic acid 2Pipe27558n.d.
Enoxacin 2Enox26.15.1n.d.
Norfloxacin 2Nor22.82.7n.d.
Ciprofloxacin 2Cipro21.31.2n.d.
Levofloxacin 2Levo21.71.7n.d.
Pazufloxacin 2Pazu24.23.2n.d.
InhibitorAbbreviationIC50, day 1 (µM)IC50, day 2 (µM)IC50, gel (µM)
Pipemidic acidPipe8074n.d.
Nalidixic acidNal210200n.d.
Oxolinic acidOxo14280n.d.
EnoxacinEnox5.64.8n.d.
NorfloxacinNor3.32.9n.d.
CiprofloxacinCipro1.41.31.2
LevofloxacinLevo2.52.2n.d.
PazufloxacinPazu4.03.3n.d.
SparfloxacinSpar2.01.6n.d.
TrovafloxacinTrova1.91.8n.d.
GemifloxacinGemi1.01.1n.d.
PrulifloxacinPruli1.71.4n.d.
MoxifloxacinMoxi2.82.44.6
NovobiocinNovo2.82.6n.d.
Pipemidic acid 2Pipe27558n.d.
Enoxacin 2Enox26.15.1n.d.
Norfloxacin 2Nor22.82.7n.d.
Ciprofloxacin 2Cipro21.31.2n.d.
Levofloxacin 2Levo21.71.7n.d.
Pazufloxacin 2Pazu24.23.2n.d.

n.d., not determined

Table 1.

IC50s determined in replicate cruciform extrusion experiments and in gel-based assay

InhibitorAbbreviationIC50, day 1 (µM)IC50, day 2 (µM)IC50, gel (µM)
Pipemidic acidPipe8074n.d.
Nalidixic acidNal210200n.d.
Oxolinic acidOxo14280n.d.
EnoxacinEnox5.64.8n.d.
NorfloxacinNor3.32.9n.d.
CiprofloxacinCipro1.41.31.2
LevofloxacinLevo2.52.2n.d.
PazufloxacinPazu4.03.3n.d.
SparfloxacinSpar2.01.6n.d.
TrovafloxacinTrova1.91.8n.d.
GemifloxacinGemi1.01.1n.d.
PrulifloxacinPruli1.71.4n.d.
MoxifloxacinMoxi2.82.44.6
NovobiocinNovo2.82.6n.d.
Pipemidic acid 2Pipe27558n.d.
Enoxacin 2Enox26.15.1n.d.
Norfloxacin 2Nor22.82.7n.d.
Ciprofloxacin 2Cipro21.31.2n.d.
Levofloxacin 2Levo21.71.7n.d.
Pazufloxacin 2Pazu24.23.2n.d.
InhibitorAbbreviationIC50, day 1 (µM)IC50, day 2 (µM)IC50, gel (µM)
Pipemidic acidPipe8074n.d.
Nalidixic acidNal210200n.d.
Oxolinic acidOxo14280n.d.
EnoxacinEnox5.64.8n.d.
NorfloxacinNor3.32.9n.d.
CiprofloxacinCipro1.41.31.2
LevofloxacinLevo2.52.2n.d.
PazufloxacinPazu4.03.3n.d.
SparfloxacinSpar2.01.6n.d.
TrovafloxacinTrova1.91.8n.d.
GemifloxacinGemi1.01.1n.d.
PrulifloxacinPruli1.71.4n.d.
MoxifloxacinMoxi2.82.44.6
NovobiocinNovo2.82.6n.d.
Pipemidic acid 2Pipe27558n.d.
Enoxacin 2Enox26.15.1n.d.
Norfloxacin 2Nor22.82.7n.d.
Ciprofloxacin 2Cipro21.31.2n.d.
Levofloxacin 2Levo21.71.7n.d.
Pazufloxacin 2Pazu24.23.2n.d.

n.d., not determined

Screening of the NIH clinical collection

The NIH Clinical Collection (NCC) screen of 482 compounds was purchased from Evotec (South San Francisco, CA), and reagents were diluted to a 4× concentration of 200 µM in 4% DMSO. Reactions were performed as for the replicate-experiment study.

RESULTS

Preparation of the cruciform-forming plasmid for detection of supercoiling by fluorescence

Because the hairpins of DNA cruciforms may be separated by the torsional strain of negative supercoils (25,29,30), we reasoned that an inverted repeat of the appropriate sequence, labeled with a fluorophore and a quencher, would produce a fluorescent signal on supercoiling and be quenched on relaxation. The degree of supercoiling required to induce cruciform formation is sequence dependent, so we chose to use a 42 bp AT repeat that has been shown to form a cruciform at a supercoiling density of σ = −0.04 (26) (see ‘Materials and Methods’ section). To prepare a suitable plasmid (pAT42C, Figure 1), we inserted this repeat, labeled at adjacent sites on opposite strands with fluorescein and dabcyl, into the AvaI/BanII site of pUC19AB. To separate closed-circular DNA from nicked and linear forms, we purified pAT42C by gel electrophoresis in the presence of the intercalating agent chloroquine. Removal of chloroquine from the purified DNA was confirmed by measuring UV absorption at 344 nm and by the detection of relaxed DNA species by agarose gel electrophoresis (data not shown).

The extrusion of cruciforms from negatively-supercoiled DNA is accompanied by an increase in writhe, which decreases plasmid mobility during electrophoresis in agarose gels. To confirm that negative supercoiling causes extrusion of the AT42 cruciform used here, we first prepared a broad distribution of pAT42C topoisomers by nicking the plasmid and then religating it in the presence of increasing concentrations of ethidium bromide. Intercalation of ethidium bromide introduces positive supercoils to DNA in a concentration-dependent manner, and subsequent removal of the intercalator during purification results in negatively supercoiled DNA. Two-dimensional gel electrophoresis of the pAT42C topoisomer distribution revealed a discontinuity in plasmid migration between ΔLk=10 and ΔLk=11, showing that the cruciform is completely integrated at σ > −0.04 and completely extruded at σ < −0.04 (see ‘Materials and Methods’ section) (Figure 2). The discontinuity was not observed with the parental plasmid pUC19AB treated in the same manner. Thus, our starting plasmid substrate responds physically to alterations in supercoiling levels as planned.

Demonstration of cruciform extrusion by 2D electrophoresis of topoisomers. Topoisomer distributions of pUC19AB (A) and pAT42C (B) were displayed by electrophoresis in 1.2% agarose gels in tris-phosphate-EDTA (TPE) buffer for 18 h at 70 V. The gels were soaked in several changes of TPE plus 4.5 µg/ml chloroquine, then rotated 90° and subjected to electrophoresis in TPE plus chloroquine for an additional 18 h at 70 V. The gels were stained with ethidium bromide. pAT42C exhibits a discontinuity between ΔLk = 10 and ΔLk = 11, signifying cruciform extrusion (indicated in panel B with an arrow).
Figure 2.

Demonstration of cruciform extrusion by 2D electrophoresis of topoisomers. Topoisomer distributions of pUC19AB (A) and pAT42C (B) were displayed by electrophoresis in 1.2% agarose gels in tris-phosphate-EDTA (TPE) buffer for 18 h at 70 V. The gels were soaked in several changes of TPE plus 4.5 µg/ml chloroquine, then rotated 90° and subjected to electrophoresis in TPE plus chloroquine for an additional 18 h at 70 V. The gels were stained with ethidium bromide. pAT42C exhibits a discontinuity between ΔLk = 10 and ΔLk = 11, signifying cruciform extrusion (indicated in panel B with an arrow).

To confirm that the labeled cruciform gives rise to fluorescence in a supercoiling-dependent manner, we next performed two time-course assays that monitored fluorescence and DNA topology in parallel (Figure 3). We used gyrase to generate negatively supercoiled DNA, which was detected by gel electrophoresis and appeared at the same rate as cruciform formation, which we monitored continuously in microtiter plates as an increase in fluorescence (see ‘Materials and Methods’ section). This result demonstrates that supercoiling of pAT42C by gyrase can be observed in real time using our fluorescently labeled cruciform substrate. Similarly, in the reverse reaction, relaxation of supercoiled DNA by human topo IIα, as evidenced by the disappearance of supercoiled species by gel electrophoresis, can be seen to occur simultaneously with the fluorescence quenching of labeled pAT42C in the plate-based assay (Figure 4).

Time course of cruciform extrusion. Negative supercoils were introduced into labeled pAT42C (3.68 ng/µl) by treatment with 0.6 nM gyrase at 30°C; aliquots were removed at the indicated time points and quenched with SDS and EDTA before analysis by agarose gel electrophoresis; nicked, relaxed and supercoiled DNA bands are indicated as N, R and S, respectively (A). The appearance of the fully supercoiled species in the gel was quantified and expressed as a function of time (B, squares). Fluorescence was also monitored continuously by fluorescence in solution (B, circles). The close correspondence between the introduction of supercoils and the increase in fluorescence validates use of fluorescence as a measure of supercoiling. Error bars represent the standard deviation of three replicates.
Figure 3.

Time course of cruciform extrusion. Negative supercoils were introduced into labeled pAT42C (3.68 ng/µl) by treatment with 0.6 nM gyrase at 30°C; aliquots were removed at the indicated time points and quenched with SDS and EDTA before analysis by agarose gel electrophoresis; nicked, relaxed and supercoiled DNA bands are indicated as N, R and S, respectively (A). The appearance of the fully supercoiled species in the gel was quantified and expressed as a function of time (B, squares). Fluorescence was also monitored continuously by fluorescence in solution (B, circles). The close correspondence between the introduction of supercoils and the increase in fluorescence validates use of fluorescence as a measure of supercoiling. Error bars represent the standard deviation of three replicates.

Reintegration of cruciform. Supercoiled labeled pAT42C (3.68 ng/µl) was relaxed with human Topo IIα (1.6 nM) at 37°C; aliquots were removed at the indicated time points and quenched with SDS and EDTA before analysis by agarose gel electrophoresis; nicked, relaxed and supercoiled DNA bands are indicated as N, R and S, respectively (A). The disappearance of supercoiled bands in the gel was quantified and expressed as a function of time (B, squares). Fluorescence was also monitored continuously in solution (B, circles). Error bars represent the standard deviation of three replicates.
Figure 4.

Reintegration of cruciform. Supercoiled labeled pAT42C (3.68 ng/µl) was relaxed with human Topo IIα (1.6 nM) at 37°C; aliquots were removed at the indicated time points and quenched with SDS and EDTA before analysis by agarose gel electrophoresis; nicked, relaxed and supercoiled DNA bands are indicated as N, R and S, respectively (A). The disappearance of supercoiled bands in the gel was quantified and expressed as a function of time (B, squares). Fluorescence was also monitored continuously in solution (B, circles). Error bars represent the standard deviation of three replicates.

HT assay replicate-experiment study

Having established that a labeled cruciform-forming sequence can be used to assess both supercoiling state and topoisomerase activity, we next set out to test the reproducibility and robustness of the substrate and our assay. To assess the variability of a HT assay and to show reproducibility over a range of potencies, a replicate-experiment study is typically performed. In a replicate-experiment study, IC50 measurements of compounds spanning a range of potencies are measured in duplicate and compared to determine both a MR and a minimum significant ratio (MSR). The MR is the geometric average of the ratios between IC50s measured for each compound in two trials and provides a measure of reproducibility. The MSR is the smallest ratio of IC50s between two compounds that can be statistically significant and thus is a measure of the ability of an assay to rank-order compounds by efficacy (31,32). We first assayed supercoiling of pAT42C by E.coli gyrase in 384-well plates by monitoring the increase of fluorescence. To examine the reproducibility of gyrase inhibition identified using the assay, we assembled a panel of 14 known gyrase inhibitors with IC50s spanning the range 1–200 µM (Table 1). Inhibition isotherms, based on the fluorescence of the reactions, were used to calculate an IC50 value for each inhibitor (Figure 5A, Table 1). In two independent replicate experiments, the MR of IC50s determined between runs for each inhibitor was 1.15; although this ratio is significantly different from 1.0 (95% confidence interval, 1.08–1.22), it represents a small difference in potency between runs and therefore demonstrates that there is good agreement between measurements in separate experiments (Figure 5B). For the cruciform extrusion assay, MSR = 1.30; a pair of compounds whose IC50 ratios are higher than this value can be judged to have different potency with 95% confidence. MSR values close to 1 indicate that an assay is useful for ranking compounds by potency; MSR ≤3 has been proposed as a practical limit for this criterion (32), a limit which our assay is well within. To compare potencies determined by the cruciform extrusion assay to those determined by the classic gel-based assay, IC50 values were also determined for ciprofloxacin and moxifloxacin using gel electrophoresis (Figure 6, Table 1). The resultant values proved to be in good agreement with those determined in the replicate-experiment study.

Replicate-experiment study. (A) The ratios of IC50s measured on two separate days are plotted against the geometric mean of the IC50s measured for each compound (blue diamonds). The MR for all compounds is 1.15 (blue line) with a 95% confidence interval of 1.08–1.23 (green dashed lines). Because the MR is close to 1 and the 95% confidence interval is narrow, no statistically significant difference exists between the two experimental trials. The limits of agreement between replicates are 0.88–1.50 (red dashed lines), representing the individual compound variation between two trials. (B) Inhibition isotherms from a typical trial of the replicate-experiment study. Percent inhibition was normalized by uninhibited reactions containing 0 and 1 mM ATP as upper and lower limits, respectively. Abbreviations of compounds are defined in Table 1.
Figure 5.

Replicate-experiment study. (A) The ratios of IC50s measured on two separate days are plotted against the geometric mean of the IC50s measured for each compound (blue diamonds). The MR for all compounds is 1.15 (blue line) with a 95% confidence interval of 1.08–1.23 (green dashed lines). Because the MR is close to 1 and the 95% confidence interval is narrow, no statistically significant difference exists between the two experimental trials. The limits of agreement between replicates are 0.88–1.50 (red dashed lines), representing the individual compound variation between two trials. (B) Inhibition isotherms from a typical trial of the replicate-experiment study. Percent inhibition was normalized by uninhibited reactions containing 0 and 1 mM ATP as upper and lower limits, respectively. Abbreviations of compounds are defined in Table 1.

Comparison of drug responses by gel-based and cruciform extrusion assays. Labeled pAT42C (3.68 ng/µl) was supercoiled by incubation with 0.6 nM gyrase in the presence of the indicated concentrations of ciprofloxacin or moxifloxacin. Nicked, relaxed and supercoiled DNA bands are indicated as N, R and S, respectively (A). After quenching with SDS and EDTA, the reaction products were analyzed by electrophoresis in a 1% agarose gel. Inhibition isotherms were plotted based on the intensity of the supercoiled band (dashed lines, panels B and C). Fluorescence-based cruciform extrusion assays were also performed in solution for each fluoroquinolone and are plotted as solid lines in panels B and C.
Figure 6.

Comparison of drug responses by gel-based and cruciform extrusion assays. Labeled pAT42C (3.68 ng/µl) was supercoiled by incubation with 0.6 nM gyrase in the presence of the indicated concentrations of ciprofloxacin or moxifloxacin. Nicked, relaxed and supercoiled DNA bands are indicated as N, R and S, respectively (A). After quenching with SDS and EDTA, the reaction products were analyzed by electrophoresis in a 1% agarose gel. Inhibition isotherms were plotted based on the intensity of the supercoiled band (dashed lines, panels B and C). Fluorescence-based cruciform extrusion assays were also performed in solution for each fluoroquinolone and are plotted as solid lines in panels B and C.

Screening of the NIH Clinical Collection

To assess the performance of the cruciform-extrusion HT assay against a broad range of compounds, the assay was next tested against the NIH Clinical Collection (NCC) using a drug concentration of 50 µM. The NCC contains 446 compounds, including seven fluoroquinolones that are known gyrase inhibitors. Ciprofloxacin (1 mM) was used as a positive control for 100% inhibition. The screen generated eight hits (Figure 7, Table 2), including the seven fluoroquinolones and cefixime. Cefixime is a cephalosporin; inhibition of gyrase by this drug was not reproducible in subsequent trials of the cruciform extrusion assay or the gel-based assay and was thus judged to be a spurious false positive.

Results from screen of NCC. Plasmid pAT42C was incubated with DNA gyrase under supercoiling conditions in the presence of compounds from the NCC (circles); 1 mM ciprofloxacin was used as a positive inhibition control (open squares), and 1% (v/v) DMSO was included as a negative control (filled squares). The inherent fluorescence of many compounds in the NCC interfered with fluorescence from the supercoiled plasmid; in the future, this problem could be ameliorated by using a fluorophore with a red-shifted emission spectrum, e.g. TAMRA. Eight potential hits (filled circles) with >40% inhibition (solid line) were identified in this screen.
Figure 7.

Results from screen of NCC. Plasmid pAT42C was incubated with DNA gyrase under supercoiling conditions in the presence of compounds from the NCC (circles); 1 mM ciprofloxacin was used as a positive inhibition control (open squares), and 1% (v/v) DMSO was included as a negative control (filled squares). The inherent fluorescence of many compounds in the NCC interfered with fluorescence from the supercoiled plasmid; in the future, this problem could be ameliorated by using a fluorophore with a red-shifted emission spectrum, e.g. TAMRA. Eight potential hits (filled circles) with >40% inhibition (solid line) were identified in this screen.

Table 2.

Positive results from screen of NCC

Compound% Inhibition
Tosufloxacin96%
Levofloxacin99%
Rufloxacin89%
Pazufloxacin97%
Pefloxacin95%
Moxifloxacin96%
Cefixime70%
Enrofloxacin67%
Compound% Inhibition
Tosufloxacin96%
Levofloxacin99%
Rufloxacin89%
Pazufloxacin97%
Pefloxacin95%
Moxifloxacin96%
Cefixime70%
Enrofloxacin67%
Table 2.

Positive results from screen of NCC

Compound% Inhibition
Tosufloxacin96%
Levofloxacin99%
Rufloxacin89%
Pazufloxacin97%
Pefloxacin95%
Moxifloxacin96%
Cefixime70%
Enrofloxacin67%
Compound% Inhibition
Tosufloxacin96%
Levofloxacin99%
Rufloxacin89%
Pazufloxacin97%
Pefloxacin95%
Moxifloxacin96%
Cefixime70%
Enrofloxacin67%

Calculation of Z’

The inherent quality of an assay is commonly represented by the Z’ factor (33). A Z’ > 0.5 is characteristic of an assay showing clear separation between positive and negative results. In six repetitions of the replicate-experiment study, Z’ ranged between 0.77 and 0.85. Similarly, in the three plates measured while screening the NCC, Z’ ranged from 0.816 to 0.839. To test the suitability of lower concentrations of ciprofloxacin as a positive control for gyrase inhibition, we repeated the control measurements of the NCC assay using 50 µM ciprofloxacin as a positive control and 1% DMSO as a negative control. When ciprofloxacin was used at the same concentration as the test compounds in the NCC, we calculated Z’ factors of 0.66, 0.81 and 0.84 for three replicate plates (Supplementary Figure S1). The clear separation between the positive and negative controls shows that the cruciform extrusion assay allows for the sensitive detection of supercoiling inhibitors.

DISCUSSION

Although topoisomerases have long been the target of antimicrobial and antitumor agents, standard gel-based assays for monitoring DNA supercoiling and relaxation by these enzymes are both time-consuming and labor intensive. This shortcoming has led to the development of other assays that can read out on topoisomerase function—including fluorescent measurement of ethidium bromide binding (23), induction of SOS response (34) and fluorescence anisotropy measurement of DNA triplex formation (35,36)—for HT screening of potential inhibitors of these enzymes.

We describe here the development of a new HT assay for DNA supercoiling based on the extrusion of a cruciform from a plasmid. Labeling of the cruciform with a fluorophore and quencher at specific positions results in an increase in fluorescent signal on extrusion of the cruciform that accompanies supercoiling of the plasmid. This event in turn allows real-time monitoring of plasmid supercoiling by gyrase (Figure 1). One advantage of our cruciform extrusion assay compared with existing HT supercoiling assays is the high Z’ score, which is due both to a ∼4-fold range of signal between the positive and negative controls and to the low standard deviations of these measurements. A high Z’ score indicates a sensitive HT assay, reflecting the quality of the positive and negative controls and the reproducibility of the data points.

An additional utility of the cruciform extrusion assay as a primary screening tool is the use of fluorescence quenching as an indication of inhibition. Because many potential inhibitors are themselves fluorescent, a property we observed in our assessment of the NCC (Figure 7), an assay that relies on either gain of fluorescence or loss of fluorescence anisotropy to identify inhibitors stands to identify a large number of false-positive hits. Although it is possible that some naturally fluorescent inhibitors may be incorrectly ruled out, the likelihood of this occurrence could be reduced by using a longer wavelength fluorophore–quencher pair than we have used here, such as TAMRA and Black Hole Quencher 1 (37). Molecules that quench fluorescence, absorb light or alter DNA topology may appear as false-positive hits in the cruciform extrusion assay. Shapiro and colleagues (38) have described a method to correct for such artifacts by measuring the signal in an artifact plate. In our application, an artifact plate would be identical to a test plate, except that enzyme would be omitted and supercoiled pAT42C (product) would be substituted for relaxed pAT42C (substrate).

Although the high Z’ score and real-time capabilities of the cruciform extrusion assay represent an advance over existing HT assays, there are limitations as well. Unlike the ethidium bromide intercalation assay (23), the cruciform extrusion assay as implemented in this work cannot discriminate between catalytic inhibitors and gyrase poisons that cleave DNA; both types of agent result in a quenched product. Additionally, unlike the ethidium bromide intercalation and triplex formation (24) assays, the cruciform extrusion assay is binary: it can discriminate between DNAs with σ < −0.04 and σ > −0.04, but it cannot report with precision on the supercoiling density and/or distribution within a population of DNA, nor can it detect changes in the supercoiling density of positively supercoiled DNA.

We envision that our strategy of constructing fluorescently labeled cruciforms could have utility beyond in HT assays for gyrase inhibitors. By changing the relative positions of the fluorophore–quencher pair and tuning the degree of negative supercoiling of the plasmid, we could enable real-time detection of other processes that result in a change in the writhe of DNA. Such processes may include supercoil relaxation by other type I and type II topoisomerases, nucleosome assembly (39,40) and DNA remodeling (41,42).

In summary, we have demonstrated that cruciform extrusion can be used as a near-real time reporter of topological transitions of closed-circular DNA. By using a cruciform-containing plasmid labeled with a fluorophore and quencher, we have observed fluorescence changes corresponding to the introduction or removal of negative supercoils by E.coli gyrase and human topo IIα, respectively. We have subsequently implemented this substrate in a HT assay for DNA supercoiling by gyrase. The HT assay reported here may be applied to the search for novel antibacterial agents that inhibit gyrase and may be extendable to the search for antitumor inhibitors of human topo II and topo I.

FUNDING

National Institutes of Health (NIH) [5R01AI091412 to J.M.B.]. Funding for open access charge: NIH.

Conflict of interest statement. K.M.J. and J.M.B. are co-founders of Replisoma, Inc.

ACKNOWLEDGEMENTS

We thank Karl Drlica for critical reading of the manuscript. We also thank Scott Gradia of the QB3 Macrolab for helpful discussions and use of equipment in HT experiments.

REFERENCES

1
Fischbach
MA
Walsh
CT
,
Antibiotics for emerging pathogens
Science
,
2009
, vol.
325
(pg.
1089
-
1093
)
2
Boucher
HW
Talbot
GH
Bradley
JS
Edwards
JE
Gilbert
D
Rice
LB
Scheld
M
Spellberg
B
Bartlett
J
,
Bad bugs, no drugs: no eskape! An update from the Infectious Diseases Society of America
Clin. Infect. Dis.
,
2009
, vol.
48
(pg.
1
-
12
)
3
Bradbury
BJ
Pucci
MJ
,
Recent advances in bacterial topoisomerase inhibitors
Curr. Opin. Pharmacol.
,
2008
, vol.
8
(pg.
574
-
581
)
4
Collin
F
Karkare
S
Maxwell
A
,
Exploiting bacterial DNA gyrase as a drug target: current state and perspectives
Appl. Microbiol. Biotechnol.
,
2011
, vol.
92
(pg.
479
-
497
)
5
Pommier
Y
Leo
E
Zhang
H
Marchand
C
,
DNA topoisomerases and their poisoning by anticancer and antibacterial drugs
Chem. Biol.
,
2010
, vol.
17
(pg.
421
-
433
)
6
Tse-Dinh
YC
,
Bacterial topoisomerase I as a target for discovery of antibacterial compounds
Nucleic Acids Res.
,
2009
, vol.
37
(pg.
731
-
737
)
7
Drlica
K
Malik
M
,
Fluoroquinolones: action and resistance
Curr. Top. Med. Chem.
,
2003
, vol.
3
(pg.
249
-
282
)
8
Drlica
K
Hiasa
H
Kerns
R
Malik
M
Mustaev
A
Zhao
X
,
Quinolones: action and resistance updated
Curr. Top. Med. Chem.
,
2009
, vol.
9
(pg.
981
-
998
)
9
Deweese
JE
Osheroff
N
,
The DNA cleavage reaction of topoisomerase II: wolf in sheep’s clothing
Nucleic Acids Res.
,
2009
, vol.
37
(pg.
738
-
748
)
10
Nitiss
JL
,
Targeting DNA topoisomerase II in cancer chemotherapy
Nat. Rev. Cancer
,
2009
, vol.
9
(pg.
338
-
350
)
11
Pommier
Y
,
Topoisomerase I inhibitors: camptothecins and beyond
Nat. Rev. Cancer
,
2006
, vol.
6
(pg.
789
-
802
)
12
Vos
SM
Tretter
EM
Schmidt
BH
Berger
JM
,
All tangled up: how cells direct, manage and exploit topoisomerase function
Nat. Rev. Mol. Cell. Biol.
,
2011
, vol.
12
(pg.
827
-
841
)
13
Forterre
P
Gribaldo
S
Gadelle
D
Serre
MC
,
Origin and evolution of DNA topoisomerases
Biochimie
,
2007
, vol.
89
(pg.
427
-
446
)
14
Gellert
M
Mizuuchi
K
O'Dea
MH
Nash
HA
,
DNA gyrase: an enzyme that introduces superhelical turns into DNA
Proc. Natl Acad. Sci. USA
,
1976
, vol.
73
(pg.
3872
-
3876
)
15
Ali
JA
Jackson
AP
Howells
AJ
Maxwell
A
,
The 43-kilodalton N-terminal fragment of the DNA gyrase B protein hydrolyzes ATP and binds coumarin drugs
Biochemistry
,
1993
, vol.
32
(pg.
2717
-
2724
)
16
Gellert
M
O’Dea
MH
Itoh
T
Tomizawa
J
,
Novobiocin and coumermycin inhibit DNA supercoiling catalyzed by DNA gyrase
Proc. Natl Acad. Sci. USA
,
1976
, vol.
73
(pg.
4474
-
4478
)
17
Gellert
M
Mizuuchi
K
O’Dea
MH
Itoh
T
Tomizawa
JI
,
Nalidixic acid resistance: a second genetic character involved in DNA gyrase activity
Proc. Natl Acad. Sci. USA
,
1977
, vol.
74
(pg.
4772
-
4776
)
18
Khodursky
AB
Cozzarelli
NR
,
The mechanism of inhibition of topoisomerase IV by quinolone antibacterials
J. Biol. Chem.
,
1998
, vol.
273
(pg.
27668
-
27677
)
19
Boyd
L
Atmar
RL
Randall
GL
Hamill
RJ
Steffen
D
Zechiedrich
L
,
Increased fluoroquinolone resistance with time in Escherichia coli from >17,000 patients at a large county hospital as a function of culture site, age, sex, and location
BMC Infect. Dis.
,
2008
, vol.
8
pg.
4
20
Gewirtz
DA
,
A critical evaluation of the mechanisms of action proposed for the antitumor effects of the anthracycline antibiotics adriamycin and daunorubicin
Biochem. Pharmacol.
,
1999
, vol.
57
(pg.
727
-
741
)
21
Hooper
DC
Hooper
DC
Rubinstein
E
,
Mechanisms of quinolone resistance
Quinolone Antimicrobial Agents
,
2003
Washington, DC
ASM Press
(pg.
41
-
67
)
22
Robicsek
A
Jacoby
GA
Hooper
DC
,
The worldwide emergence of plasmid-mediated quinolone resistance
Lancet Infect. Dis.
,
2006
, vol.
6
(pg.
629
-
640
)
23
Andrea
J
Adachi
K
Morgan
R
,
Fluorometric assays for DNA topoisomerases and topoisomerase-targeted drugs: quantitation of catalytic activity and DNA cleavage
Mol. Pharmacol.
,
1991
, vol.
40
(pg.
495
-
501
)
24
Burrell
MR
Burton
NP
Maxwell
A
,
A high-throughput assay for DNA topoisomerases and other enzymes, based on DNA triplex formation
Methods Mol. Biol.
,
2010
, vol.
613
(pg.
257
-
266
)
25
Lilley
DM
,
The inverted repeat as a recognizable structural feature in supercoiled DNA molecules
Proc. Natl Acad. Sci. USA
,
1980
, vol.
77
(pg.
6468
-
6472
)
26
Panyutin
I
Lyamichev
V
,
A structural transition in d(AT)n.d(AT)n inserts within superhelical DNA
J. Biomol. Struct. Dyn.
,
1985
, vol.
2
(pg.
1221
-
1234
)
27
Tretter
EM
Berger
JM
,
Mechanisms for defining supercoiling set point of DNA gyrase orthologs: II. The shape of the GyrA subunit C-terminal domain (CTD) is not a sole determinant for controlling supercoiling efficiency
J. Biol. Chem.
,
2012
, vol.
287
(pg.
18645
-
18654
)
28
Walker
JV
Nitiss
KC
Jensen
LH
Mayne
C
Hu
T
Jensen
PB
Sehested
M
Hsieh
T
Nitiss
JL
,
A mutation in human topoisomerase II α whose expression is lethal in dna repair-deficient yeast cells
J. Biol. Chem.
,
2004
, vol.
279
(pg.
25947
-
25954
)
29
Panayotatos
N
Wells
RD
,
Cruciform structures in supercoiled DNA
Nature
,
1981
, vol.
289
(pg.
466
-
470
)
30
Lilley
DM
,
Hairpin-loop formation by inverted repeats in supercoiled DNA is a local and transmissible property
Nucleic Acids Res
,
1981
, vol.
9
(pg.
1271
-
1290
)
31
Iversen
PW
Beck
B
Chen
YF
Dere
W
Devanarayan
V
Eastwood
BJ
Farmen
MW
Iturria
SJ
Montrose
C
Moore
RA
et al.
Sittampalam
GS
Gal-Edd
N
Arkin
M
Auld
D
Austin
C
Bejcek
B
Glicksman
M
Inglese
J
Lemmon
V
Li
Z
et al.
,
HTS Assay Validation
Assay Guidance Manual
,
2004
Bethesda, MD
Eli Lilly & Company and the National Center for Advancing Translational Sciences
32
Eastwood
BJ
,
The minimum significant ratio: a statistical parameter to characterize the reproducibility of potency estimates from concentration-response assays and estimation by replicate-experiment studies
J. Biomol. Screen.
,
2006
, vol.
11
(pg.
253
-
261
)
33
Zhang
J
Chung
T
Oldenburg
K
,
A simple statistical parameter for use in evaluation and validation of high throughput screening assays
J. Biomol. Screen.
,
1999
, vol.
4
(pg.
67
-
73
)
34
Cheng
B
Liu
IF
Tse-Dinh
YC
,
Compounds with antibacterial activity that enhance DNA cleavage by bacterial DNA topoisomerase I
J. Antimicrob. Chemother.
,
2007
, vol.
59
(pg.
640
-
645
)
35
Maxwell
A
Burton
N
O’Hagan
N
,
High-throughput assays for DNA gyrase and other topoisomerases
Nucleic Acids Res.
,
2006
, vol.
34
pg.
e104
36
Shapiro
A
Jahic
H
Prasad
S
Ehmann
D
Thresher
J
Gao
N
Hajec
L
,
A homogeneous, high-throughput fluorescence anisotropy-based DNA supercoiling assay
J. Biomol. Screen.
,
2010
, vol.
15
(pg.
1088
-
1098
)
37
Turconi
S
Shea
K
Ashman
S
Fantom
K
Earnshaw
DL
Bingham
RP
Haupts
UM
Brown
MJ
Pope
AJ
,
Real Experiences of uHTS: a prototypic 1536-well fluorescence anisotropy-based uHTS screen and application of well-level quality control procedures
J. Biomol. Screen.
,
2001
, vol.
6
(pg.
275
-
290
)
38
Shapiro
AB
Walkup
GK
Keating
TA
,
Correction for interference by test samples in high-throughput assays
J. Biomol. Screen.
,
2009
, vol.
14
(pg.
1008
-
1016
)
39
Vlijm
R
Smitshuijzen
JS
Lusser
A
Dekker
C
,
NAP1-assisted nucleosome assembly on dna measured in real time by single-molecule magnetic tweezers
PLoS One
,
2012
, vol.
7
pg.
e46306
40
Huang
CC
Chang
KM
Cui
H
Jayaram
M
,
Histone H3-variant Cse4-induced positive DNA supercoiling in the yeast plasmid has implications for a plasmid origin of a chromosome centromere
Proc. Natl Acad. Sci. USA
,
2011
, vol.
108
(pg.
13671
-
13676
)
41
Erzberger
JP
Mott
ML
Berger
JM
,
Structural basis for ATP-dependent DnaA assembly and replication-origin remodeling
Nat. Struct. Mol. Biol.
,
2006
, vol.
13
(pg.
676
-
683
)
42
Zhang
W
Allen
S
Roberts
CJ
Soultanas
P
,
The Bacillus subtilis primosomal protein DnaD untwists supercoiled DNA
J. Bacteriol.
,
2006
, vol.
188
(pg.
5487
-
5493
)
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.

Supplementary data

Comments

0 Comments
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.