Abstract

Recurrent self-fertilization is thought to lead to reduced adaptive potential by decreasing the genetic diversity of populations, thus leading selfing lineages down an evolutionary “blind alley.” Although well supported theoretically, empirical support for reduced adaptability in selfing species is limited. One limitation of classical theoretical models is that they assume pure additivity of the fitness-related traits that are under stabilizing selection, despite ample evidence that quantitative traits are subject to dominance. Here, we relax this assumption and explore the effect of dominance on a fitness-related trait under stabilizing selection for populations that differ in selfing rates. By decomposing the genetic variance into additional components specific to inbred populations, we show that dominance components can explain a substantial part of the genetic variance of inbred populations. We also show that ignoring these components leads to an upward bias in the predicted response to selection. Finally, we show that when considering the effect of dominance, the short-term evolutionary potential of populations remains comparable across the entire gradient in outcrossing rates, and genetic associations can even make selfing populations more evolvable on the longer term, reconciling theoretical, and empirical results.

Plant mating systems are highly variable and range from functional asexuality to obligate outcrossing (Barrett 2003). Predominant selfing is uncommon compared to obligate outcrossing enforced by self-incompatibility, but many plant species self-fertilize at rates ranging from near zero to near one (Moeller et al. 2017). Within selfing species, outcrossing rates often vary widely among populations (Whitehead et al. 2018). The main fitness advantages associated with the transition from outcrossing to selfing are the reproductive-assurance benefits of ensuring reproduction when cross-pollination fails (Baker 1955; Eckert et al. 2006), and the two-fold transmission advantage of genes (Fisher 1941). Despite these short-term advantages, there are few predominantly selfing species (15% of species in Igic and Kohn 2006), and their generally recent origin is at least sometimes associated with a negative diversification rate (Goldberg et al. 2010), suggesting that selfing could be an evolutionary dead-end (Stebbins 1957, and see Takebayashi and Morrell 2001; Igic and Busch 2013 and Wright et al. 2013 for reviews). An important component of Stebbins's original dead-end hypothesis is that selfing populations should exhibit less genetic diversity, so that they are less adaptable and thus more prone to extinction.

Although reduced quantitative-genetic variation under recurrent inbreeding is expected theoretically (Lande and Porcher 2015; Abu Awad and Roze 2018), empirical results from quantitative surveys and meta-analyses are equivocal. Charlesworth and Charlesworth (1995) compiled estimates of outcrossing rates, heritabilities, and coefficients of genetic variation from published studies of plants, and detected weak overall relationships between outcrossing rates and standing genetic variation. They did, however, detect the predicted positive relationship when restricting the analysis to additive genetic coefficients of variation, and found that the magnitude of the reduction in quantitative-genetic variance in selfers was larger than expected theoretically. More recently, Opedal et al. (2017) reported only minor differences in evolvabilities (mean-scaled genetic variances) of floral traits between predominantly selfing, mixed-mating, and predominantly outcrossing plants, while Clo et al. (2019) detected a weak positive relationship for certain traits. The discrepancy between theory and data could arise from the fact that existing theoretical models considering the effect of selfing on quantitative traits under stabilising selection assumes a purely additive architecture (Lande 1977; Lande and Porcher 2015; Abu Awad and Roze 2018). This assumption contradicts the observation that fitness-related traits do not always behave additively, and that dominance relationships among alleles at a given locus are common (Shaw et al. 1998, Kelly and Arathi 2003, Wolak and Keller 2014).

The rationale for focusing on additive models is that the response to selection can be conveniently predicted as the product of the additive genetic variance and the selection gradient acting on a trait (Lande 1979). This simple model has facilitated the highly successful research programme in evolutionary quantitative genetics, which has yielded countless empirical estimates of natural selection (e.g., Siepielski et al. 2017) and additive genetic variance (e.g., Hansen et al. 2011; Opedal 2019). Importantly, this model rests on the assumption that populations mate randomly. Under partial inbreeding and dominance, predicting the response to selection becomes much more complicated. When inbreeding and dominance occurs simultaneously, at least three additional terms contribute to the genetic variance (Cockerham and Weir 1984). The genetic variance of a population with an average inbreeding coefficient of F = s/[2-s] (Haldane 1924), where s is the selfing rate, is then equal to
1

(Cockerham and Weir 1984), where σ²genic (the variance of additive effects of alleles) and σ²DR (the variance of dominance deviations of a randomly mating population) are the classical terms most often inferred in quantitative genetics. With dominance and inbreeding, these terms are not sufficient to describe the adaptive potential of populations. The additional terms arising under partial inbreeding include the variance of dominance deviations of a fully inbred population σ²DI, and the covariance between the additive effect of an allele and its homozygous dominance deviation σADI. This covariance arises because the increased homozygosity in inbred populations increases the probability that an allele occurs in its homozygote state, which creates covariance between the contribution of an allele to the breeding value and the dominance deviation of the homozygote genotype (Wolak and Keller 2014). Note that unlike the other terms of equation (1), this term is a covariance and can thus be negative. The third additional component, H*, is the squared per-locus inbreeding depression, summed over all loci. This last term is expected to be small if inbreeding depression is due to the cumulative effect of a large number of loci with small effects (Shaw et al. 1998). The new terms of equation (1) and their contributions due to F arise because the genetic components are inferred under the assumption of random mating. With inbreeding, an individual may have common ancestors through both parental lines, such that non-additive effects can contribute to the covariance between parents and offspring, which does not occur under random mating. While σ²DR does not affect the response to selection, the additional dominance components (notably σ²DI and σADI) contribute to the adaptive potential because they contribute to the covariance between parents and offspring, on which selection response depends (Wright and Cockerham 1985; Kelly 1999a, 1999b).

Accurate predictions of the adaptive potential of populations are of critical importance in light of ongoing environmental changes. With ongoing pollinator declines and other changes in pollinator communities, a question of particular interest is how a transition from outcrossing towards partial selfing affects the immediate and long-term adaptive potential of populations (e.g. Opedal et al. 2017; Clo et al. 2020; Cheptou 2021). A consequence of the focus of theoretical and empirical studies on the additive variance is that little is known about the effect of dominance on the evolutionary potential of populations, or how its interaction with self-fertilization can modify the effect of inbreeding on evolvability. Here, we use simulation models to study the relationship between mating systems and the genetic variance, focusing in particular on the contribution of those variance components related to dominance interacting with inbreeding. Specifically, by introducing dominance into classical models of quantitative traits under stabilizing selection, we dissect the genetic architecture of quantitative traits at mutation-selection-drift equilibrium. We test if incorporating all relevant components of the genetic variance into a simplified model of selection response yield accurate estimates of the rate of evolution of partially selfing populations, notably compared to purely additive models. Finally, we use the insights from our model to discuss the short- and long-term effects of self-fertilization on the adaptive potential of populations.

Material and Methods

SIMULATION PROGRAM

The model parameters, their abbreviations, and their values considered in simulations are summarized in Table 1. We consider the evolution of a quantitative trait in a population of size N, comprising diploid individuals reproducing through partial self-fertilization at a constant selfing rate s. The phenotypic value Z of an individual is given by
2
where E is the random environmental effect drawn from a Gaussian distribution with mean 0 and variance VE and assumed to be independent from the genetic component. The genetic component G is controlled by L bi-allelic loci with both additive and dominance effects. We used a simulation framework similar to that of Kelly and Williamson (2000). At the ith locus, the two alleles are labeled 0 and 1 and are present at frequencies pi and qi. The three genotypes A0A0, A0A1, and A1A1 have genotypic values G00, G10, and G11, respectively, equal to 0, (ri + di) and 2ri. The allelic effect at the ith locus, ri, is drawn from a Gaussian distribution with mean 0 and variance a² (Lande 1977). The dominance genetic effect between alleles 0 and 1, di, can range from -ri (allele 0 is fully dominant) to ri (allele 0 is fully recessive) and is fixed and identical for all loci (for example, always zero in a purely additive model). This notation is similar to that of Lynch and Walsh (1998, p.66). Note that adding variance around the mean value of di does not change the results (Fig. S1), as previously reported in studies of the effect of epistasis on genetic variance (Carter et al. 2005).
Table 1

Description of model parameters, their abbreviations and range of values considered in the simulations

ParameterAbbreviationValue(s)
Population sizeN1000
Selfing rateS0 to 1
Number of lociL50
Dominance genetic effectdi0 (additive model), ri/2 (partial dominance), ri (complete dominance)
Strength of stabilizing selectionω²1 or 9
Haploid phenotypic mutation rateU0.005 or 0.05
Mutational variance for the quantitative traita²0.05
Environmental varianceVE1
ParameterAbbreviationValue(s)
Population sizeN1000
Selfing rateS0 to 1
Number of lociL50
Dominance genetic effectdi0 (additive model), ri/2 (partial dominance), ri (complete dominance)
Strength of stabilizing selectionω²1 or 9
Haploid phenotypic mutation rateU0.005 or 0.05
Mutational variance for the quantitative traita²0.05
Environmental varianceVE1
Table 1

Description of model parameters, their abbreviations and range of values considered in the simulations

ParameterAbbreviationValue(s)
Population sizeN1000
Selfing rateS0 to 1
Number of lociL50
Dominance genetic effectdi0 (additive model), ri/2 (partial dominance), ri (complete dominance)
Strength of stabilizing selectionω²1 or 9
Haploid phenotypic mutation rateU0.005 or 0.05
Mutational variance for the quantitative traita²0.05
Environmental varianceVE1
ParameterAbbreviationValue(s)
Population sizeN1000
Selfing rateS0 to 1
Number of lociL50
Dominance genetic effectdi0 (additive model), ri/2 (partial dominance), ri (complete dominance)
Strength of stabilizing selectionω²1 or 9
Haploid phenotypic mutation rateU0.005 or 0.05
Mutational variance for the quantitative traita²0.05
Environmental varianceVE1
The trait Z is subject to stabilizing selection around an optimal phenotypic value denoted Zopt. The fitness value WZ of an individual with phenotype Z is thus described by the Gaussian fitness function:
3
where ω² is the width of the fitness function and represents the strength of selection.

We initiated each simulation from a population of genetically identical individuals at the phenotypic optimum (all loci carried ancestral alleles with effect 0 and Z = ZOPT = 0, Abu Awad and Roze 2018). Following Clo et al. (2020), the life cycle can be summarized by five successive events. First, there is a phenotype-dependent choice of the first parent (selection), followed by mating-type choice (selfing versus outcrossing at rates s and [1- s], respectively). In the case of outcrossing, the choice of the second parent is also phenotype dependent. Selection takes place as follows: if the ratio of the selected parent's fitness over the highest recorded fitness value in the current generation is higher than a threshold value sampled from a uniform distribution between 0 and 1, the individual is allowed to reproduce. Once the two parents are chosen, they each contribute a gamete produced by random sampling of one allele per locus. This phase is then followed by the introduction of mutations from allele 0 to allele 1 and vice versa, the number of which is sampled from a Poisson distribution with parameter U (with U = μL, where μ is the per-locus mutation rate and L is the number of loci underlying the quantitative trait; Abu Awad and Roze 2018).

Each simulation run consists of two phases, of which the first is a “burn-in” period allowing the population to attain Mutation-Selection-Drift equilibrium (M-S-D). The population is considered to be at M-S-D equilibrium when the average fitness value calculated over the last 1000 generations does not differ by more than 1% from the mean fitness calculated over the previous one thousand generations (Abu Awad and Roze 2018; Clo et al. 2020). The second phase consists of following the population after a shift in the phenotypic optimum (from 0 to 2.5, as in Clo et al. 2020), during 20 generations. After the shift, the haploid genomic mutation rate U is set to 0 so that the only source of genetic variation available to approach the new optimum is the standing variation accumulated before the environmental change.

INVESTIGATED PARAMETER VALUES

We ran simulations for several parameter sets (Table 1). The values chosen for the mutation rate U (0.005 and 0.05) reflect the expected per-trait haploid genomic mutation rate reported in the literature (Keightley and Bataillon 2000; Shaw et al. 2002). This also reflects two distinct mutation regimes, one where genetic associations are negligible, as deleterious mutations arise slowly enough to be efficiently purged (U = 0.005), and one where they are influential, as mutations arise faster and the generation of associations between alleles having opposite effects on the phenotype allow populations to stay close to the phenotypic optimum (U = 0.05, see Clo et al. 2020). We chose parameter set values similar to those explored in Bürger et al. (1989) and Ronce et al. (2009), with the number of freely recombining loci under selection L = 50, and a² = 0.05 (in agreement with empirical estimates, Lynch 1988), VE = 1, ω² = 1 or 9. We considered three levels of dominance, di = 0 (additive model), di = ri/2 (partial dominance) and di = ri (complete dominance). Scenarios of partial and complete recessivity are not presented as they gave results similar to those for partial and complete dominance. Simulations were run for the full range of selfing rates (s varied from 0 to 1). We considered a constant population size of N = 1000, but initial simulations assuming smaller or larger N (250 and 10.000) did not change the conclusions of the study (data not shown).

QUESTION 1: WHAT IS THE RELATIVE CONTRIBUTION OF EACH GENETIC VARIANCE COMPONENT?

Our simulations allow us, for the first time, to evaluate the contribution of each genetic parameter of equation (1) for a quantitative trait under stabilizing selection. To estimate each component of the genetic variance, it is necessary to calculate the average effects of alleles 0 and 1 at each locus, and the statistical dominance deviations of each of three genotypes, under the assumption of random mating (see Falconer & Mackay 1996 chapter 7, and Wolak and Keller 2014 for details).

At the ith locus, the mean genotypic value Gi¯ is equal to
4
and the average effects of alleles 0 and 1 are respectively
5.1
and
5.2
Using these quantities, we can now infer dominance deviations δ00, δ10 and δ11 associated respectively to the genotypes A0A0, A0A1 and A1A1 as
6.1
 
6.2
and
6.3
We computed each variance component at the ith locus following Cockerham and Weir (1984) as
7
 
8
 
9
and
10
We summed all variance components over the L loci. We then multiplied them by their expected contribution based on the inbreeding coefficient F (equation 1, expected and observed F did not detectably differ, Fig. S2, and reported by Glémin 2003), as selfing violates the random-mating assumption typically made for inferring quantitative-genetic parameters. We also explored the effect of dominance on the amount of variance due to genetic associations across loci (i.e. a Bulmer effect, Bulmer 1974). The genetic covariances (σLD hereafter) between the ith and jth locus is calculated as
11
where GXX,i is the genotypic value (G00, G10, or G11) at the ith locus, and Gi¯ is the mean genotypic value at the ith locus. Pairwise associations explained most of the among-locus component (Fig. S3). Finally, to determine how dominance affects the distribution of allele frequencies, we computed the frequency of allele 0 for all simulated loci.
As a second step, we computed the proportion of within-locus variance components that is due to additivity and dominance, following the formulae of Cockerham and Weir (1984). If identity disequilibrium is accounted for (which is the case when there is no variance in inbreeding level within the population, or when all individual inbreeding coefficients are known, Shaw et al. 1998; Nietlisbach et al. 2016), one can decompose the genetic variance into additive and dominance components. The additive and dominance variances of a population with a given inbreeding coefficient F are equal to
12
and
13

(Cockerham and Weir 1984). It is important to note that this decomposition of genetic variance into “additive” and “dominance” components minimizes σD,F2 (Cockerham and Weir 1984).

QUESTION 2: THE INTERACTIVE EFFECTS OF DOMINANCE AND SELFING ON SHORT-TERM ADAPTIVE POTENTIAL AND THE ACCURACY OF PREDICTED SELECTION RESPONSE UNDER INBREEDING

We investigated how dominance affects the short- to mid-term adaptive potential of selfing populations. To do so, we inferred the cumulative response to selection (calculated as the fitness gain) in a population for 1 and 20 generations after the environmental change. As pointed out by Abu Awad and Roze (2018), the number of traits under selection can have strong effects on the adaptive potential of populations. We assessed if this is the case also when dominance occurs on phenotypes. To do so, we inferred the cumulative response to selection of populations for which fitness is determined by ten independent quantitative traits controlled by the same genetic architecture described above. We introduced the environmental change by shifting the optimum of one trait from 0 to 2.5, so that the Euclidian distance to cross in phenotypic space is the same for the two sets of simulations.

To predict the immediate response to selection for a population with a given selfing rate, we used a simplification of the Structured Linear Model (SLM hereafter) of Kelly (1999a). The SLM decomposes the population under study into cohorts sharing the number of generations of selfing that individuals have undergone. Within each of these cohorts, the model assumes that the parent-offspring regression is linear. Following Kelly (1999a), the mean value of a quantitative trait controlled by loci with alleles having arbitrary dominance relations can be written as
14.1
or
14.2
where μI and μO are the means of the obligate inbred and obligate outbred populations, respectively, the difference among them B is the directional dominance of the trait, and F the mean inbreeding coefficient of the population. Following Kelly (1999a), we can write
15
and
16
where S is the selection differential. In the SLM, ΔB, ΔμO, and S are calculated within each cohort of selfing, and the overall changes ΔB and ΔμO, and hence the change in the mean phenotype, are determined by a weighted average of cohort-specific values. Here, we simplified the SLM by considering the population as a single cohort of equally inbred individuals. By doing so, the expected change of the quantitative trait under study is equal to
17
This equation is equal to the Covariance Genetic Model (CGM hereafter) of Wright and Cockerham (1985, equation CP2,∞). Nevertheless, the former result holds only under linkage equilibrium. With genetic associations, the equation becomes
18
where σLD represents the effect of genetic associations on the phenotypic variance. When F is equal to 0, equation 18 is equal to the breeder's equation (Walsh and Lynch 2018, chapter 6), and when F is equal to 1, we find the classical model of pure-line selection (Walsh and Lynch 2018, chapter 23). We tested if incorporating all the variance components allows predicting the response to selection more accurately than is possible with a simpler “additive” model (taking into account σgenic2 and σLD only). To do so, we followed the response to selection over one generation. We compared the response to selection (the observed change in simulations) with predictions based on the CGM (equation 13), and predictions of the “additive” model.
The assumption that all individuals have the same inbreeding coefficient is realistic for extreme selfing rates (close to either 0 or 1) but does not hold for mixed-mating populations. Nevertheless, Kelly and Williamson (2000) compared the accuracy of this “single-cohort model” with the full SLM and found that, while the full SLM is overall more accurate over the set of simulations they considered, the single-cohort model is generally a good predictor of the mean changes. The only case for which the single-cohort model can be inaccurate is when there is excessively strong inbreeding depression for fitness (Kelly and Williamson 2000). Such cases are not expected in our simulations, because the trait under study is already under stabilizing selection, and inbreeding depression is expected to be smaller in selfing populations at equilibrium (Abu Awad and Roze 2018). We computed the amount of inbreeding depression in our simulated populations as
19
where Wself and Wout are respectively the mean fitness of 100 progeny obtained from selfing and outcrossing from randomly selected parents. In addition, the single-cohort model is probably more applicable empirically than the full SLM, as it required fewer parameters to be estimated (Kelly and Williamson 2000; Kelly 1999a).

QUESTION 3: THE EFFECT OF SHIFTING FROM OUTCROSSING TO SELFING ON HERITABLE VARIANCE

It is generally accepted that a shift from outcrossing to selfing increases adaptive potential in the short term, because the genic variance is expected to increase by a factor (1+F) due to positive correlations between additive allelic effects within loci among offspring (Wright 1931; Lande 1977; Peterson and Kay 2015). However, this ignores the contribution of the other components of the genetic variance, notably the covariance between the additive effect of an allele and its dominance deviation (σADI) which can be substantially negative. Using equation 18, we will test if this hypothesis holds when dominance occurs. We investigate this empirically and theoretically. We first compiled a dataset of quantitative traits for which all the components of the genetic variance have been estimated (Table S1). Only four studies have estimated all the components of genetic variance in natural plant populations (Shaw et al. 1998; Kelly 2003; Kelly and Arathi 2003; Marriage and Kelly 2009). These studies are further restricted to two species, Mimulus guttatus (Kelly 2003; Kelly and Arathi 2003; Marriage and Kelly 2009) and Nemophila menziesii (Shaw et al. 1998), and a total of 22 estimates for individual traits. To study the effect of shifting from obligate outcrossing to a given selfing rate s on adaptive potential, we computed the ratio
20
for s (and hence F) varying from 0 to 1. As a second step, we performed the same analysis on our simulated data. This allowed us to identify parameter sets that fit with the empirical data, which can yield insights into the range of possible values for the level of dominance and strength of stabilizing selection to which traits are subject in natural populations.

Results

QUESTION 1: WHAT IS THE RELATIVE CONTRIBUTION OF EACH GENETIC VARIANCE COMPONENT?

Overall, the within-loci genetic variance (i.e., ignoring genetic associations) is dominated by the additive component for all selfing rates and all dominance genetic effects (Fig. 1). As expected, the contribution of additive variance to genetic variance decreases with the degree of dominance. In the case of complete dominance (di = ri), the additive component explains around 75% of the genetic variance for outcrossing populations (Fig. 1). These patterns are found for all simulation parameters we considered, and additive variance never explained less than 70% of the genetic variance (Fig. 1). For completely selfing populations, the contribution of dominance variance to total genetic variance is always zero (eqs. 12 and 13).

Effects of selfing rate and the dominance genetic effect between alleles at a given locus on the proportion of the within-loci genetic variance that is additive (σA,F2/(σA,F2+σD,F2) see eqs. 12 and 13 for details). All figures are for N = 1000 and L = 50, while the strength of stabilizing selection (ω² = 1 or 9) and mutation rate (U = 0.005 or 0.05) vary among panels. The red, blue and dark points represent data for additivity, partial dominance and complete dominance scenarios. Errors bars indicate 95% confidence intervals (n = 200).
Figure 1

Effects of selfing rate and the dominance genetic effect between alleles at a given locus on the proportion of the within-loci genetic variance that is additive (σA,F2/(σA,F2+σD,F2) see eqs. 12 and 13 for details). All figures are for N = 1000 and L = 50, while the strength of stabilizing selection (ω² = 1 or 9) and mutation rate (U = 0.005 or 0.05) vary among panels. The red, blue and dark points represent data for additivity, partial dominance and complete dominance scenarios. Errors bars indicate 95% confidence intervals (n = 200).

The overall effect of dominance is to flatten the relationship between the genetic variance and the selfing rate (Fig. 2). When the model is additive (di = 0), the genetic variance decreases progressively with the selfing rate (Fig. 2). In the presence of dominance, the genetic variance is smaller in outcrossing and mixed-mating populations (s < 0.8), and higher in predominantly selfing populations (s ≥ 0.8), compared to an additive scenario (Fig. 2), even if the magnitude of the effect is moderate.

Genetic variance decomposition (contribution of each component) as a function of the selfing rate and the dominance genetic effect among alleles. Other parameters are N = 1000, L = 50, U = 0.05, and ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).
Figure 2

Genetic variance decomposition (contribution of each component) as a function of the selfing rate and the dominance genetic effect among alleles. Other parameters are N = 1000, L = 50, U = 0.05, and ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).

The genetic variance is dominated by those components contributing to the additive variance, that is the genic variance (σ²genic), the variance of homozygous dominance deviations (σ²DI), and the covariance between additive effects of alleles and their homozygous dominance deviations (σADI, Fig. 2). The main effect of dominance is to increase the strength of purifying selection against deleterious mutations, leading to a loss of genic variance (σ²genic) for outcrossing and mixed mating populations, and less diversity stored through linkage disequilibrium (σLD) when the degree of dominance increases (Fig. 2), except for highly selfing populations. This is due to the fact that the frequency of allele 0 is generally higher and close to 1 when dominance increase for low and high selfing rates (Fig. 3). The contribution of the variance of homozygous dominance deviations (σ²DI), and the covariance between additive effects and their homozygous dominance deviations (σADI) slowly increase with the selfing rate, so that these components become important contributors of the genetic variance at high selfing rates (s ≥ 0.8) and for strong dominance (di = ri, Fig. 2). The genetic associations (σLD) are important to consider only for predominantly selfing populations (s ≥ 0.8, Fig. 2). The higher the degree of dominance, the higher the selfing rate for which the effect of genetic associations becomes substantial (Fig. 2). This leads to the result that the covariance between additive effects and their homozygous dominance deviations (σADI) can be the main factor decreasing the genetic variance and thus the adaptive potential of populations (Fig. 2), notably when the mutation rate is low (Fig. S5). Decreasing the mutation rate or the strength of stabilizing selection does not alter the described patterns (Fig. S5 and S6), although, when selection is weaker, positive genetic covariances between alleles at different loci can arise for mixed-mating populations (Fig. S6). Overall, the dominance variance of a random-mating population (σ²DR) and the sum over all loci of squared per-locus inbreeding depression (H*) has minor effects on genetic variance (Fig. S4-S6) and have been omitted from Fig. 2 for clarity.

Distribution of the frequency of allele “0” at mutation-selection-drift equilibrium for the 10.000 simulated loci (L = 50 and 200 repetitions), as a function of the dominance genetic effect, for two representative selfing rates (s = 0 and 0.95). Other parameters are N = 1000, L = 50, ω² = 1, and U = 0.05.
Figure 3

Distribution of the frequency of allele “0” at mutation-selection-drift equilibrium for the 10.000 simulated loci (L = 50 and 200 repetitions), as a function of the dominance genetic effect, for two representative selfing rates (s = 0 and 0.95). Other parameters are N = 1000, L = 50, ω² = 1, and U = 0.05.

The reduction of genic variance for outcrossing populations with dominance also lead to the surprising result that the genic variance is higher in predominantly selfing populations than in outcrossing or mixed-mating populations, independently of the mutation rate for the quantitative trait and hence the strength of genetic associations (Fig. 2; Fig. S5 and S6). Even though some genetic components do not contribute to the total genetic variance due to the value of the inbreeding coefficient, it does not mean that the genetic component itself equals zero.

  • Question 2: The interactive effects of dominance and selfing on short-term adaptive potential and the accuracy of predicted selection response under inbreeding

EFFECTS OF THE MATING SYSTEM ON THE SHORT- AND MID-TERM RESPONSE TO SELECTION

Dominance modifies the effect of the selfing rate on the response to selection (Fig. 4). The additive model (di = 0) yields classical results (Charlesworth and Charlesworth 1995; Lande and Porcher 2015; Abu Awad and Roze 2018), with a nonlinear decay of adaptive potential of populations as a function of the selfing rate in the short term (Fig. 4, 1 generation of selection). The decay is slow for mixed-mating populations (s ≤ 0.9), and abrupt for predominantly selfing populations (s > 0.9). In the mid-term (20 generations of selection), the effect of selfing vanished and all populations have the same cumulative response to selection, except for extreme rates of selfing (s ≥ 0.99, Fig. 4). For scenarios with dominance (di = ri/2 or ri), the immediate response to selection declines rapidly at very high selfing rates (s ≥ 0.99), while the relationship is more U-shaped for more moderate selfing rates (Figure 4, 1 generation of selection). The initial decline in response to selection for intermediate rates of inbreeding followed by an increase for highly selfing populations (0.6 ≤ s ≤ 0.95) means that predominantly selfing populations may exhibit adaptive potential comparable to that for outcrossing populations (Fig. 4), notably for higher degrees of dominance (di = ri). These patterns remain true for low mutation rates (Fig. 4). In the mid-term, when dominance occurs, the response to selection is positively correlated with the selfing rate, unless populations are obligately selfing (Fig. 4, 20 generations of selection). When the mutation rate is low, however, long-term response to selection is limited in selfing populations, independently of the dominance level of alleles (Fig. 4). Adding several quantitative traits under stabilizing selection does not change the conclusions (Fig. S7).

Cumulative response to directional selection over 1 and 20 generations as a function of the selfing rate, the dominance genetic effect and two mutation rates (U = 0.005 or 0.05). The red, blue and dark points represent data for additivity, partial dominance and complete dominance scenarios. Other parameters are N = 1000, L = 50, ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).
Figure 4

Cumulative response to directional selection over 1 and 20 generations as a function of the selfing rate, the dominance genetic effect and two mutation rates (U = 0.005 or 0.05). The red, blue and dark points represent data for additivity, partial dominance and complete dominance scenarios. Other parameters are N = 1000, L = 50, ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).

PREDICTING RESPONSE TO SELECTION WITH INBREEDING AND DOMINANCE

Considering all relevant components of the genetic variance allows more accurate prediction of the response of a population to selection than is possible with a restricted model focused on the genic variance only (Fig. 5). Both models tend to overestimate the response to selection, but the upward bias is much greater when considering only the genic variance as a source of adaptive potential (Fig. 5). This effect relates largely to the contribution of the covariance of additive effect of alleles and their homozygous dominance deviations (σADI), which is negative and thus tends to decrease the response to selection. Importantly, the prediction of the full model can be far from the observed mean fitness change for populations that are highly but not completely selfing (0.9 ≤ s ≤ 0.95, Fig. 5), notably when the change in the optimum occurs in the same direction as the direction of dominance (Figure S8). The higher the degree of dominance, the more accurate is the full model compared to the restricted model (Fig. 5). The fact that this simplified model is reasonably accurate also comes from the fact that the level of inbreeding depression is negatively correlated with the selfing rate (Fig. 6) and can even be negative (i.e., outbreeding depression) for highly selfing populations (Fig. 6).

Simulated and predicted mean fitness change after one generation of directional selection, as a function of the selfing rate and the dominance genetic effects. The blue points represent predictions computed by using all the components of the genetic variance that contribute to adaptive potential (Covariance Genetic Model, equation 18). The red points represent predictions computed by using the genic variance only. The black points are the simulated data. Other parameters are N = 1000, L = 50, U = 0.05, and ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).
Figure 5

Simulated and predicted mean fitness change after one generation of directional selection, as a function of the selfing rate and the dominance genetic effects. The blue points represent predictions computed by using all the components of the genetic variance that contribute to adaptive potential (Covariance Genetic Model, equation 18). The red points represent predictions computed by using the genic variance only. The black points are the simulated data. Other parameters are N = 1000, L = 50, U = 0.05, and ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).

Mean level of inbreeding depression (ID, equation 19), as a function of the selfing rate and the level of dominance. The blue and black points represent values for partial dominance and complete dominance. Other parameters are N = 1000, L = 50, U = 0.05 and ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).
Figure 6

Mean level of inbreeding depression (ID, equation 19), as a function of the selfing rate and the level of dominance. The blue and black points represent values for partial dominance and complete dominance. Other parameters are N = 1000, L = 50, U = 0.05 and ω² = 1. Errors bars indicate 95% confidence intervals (n = 200).

QUESTION 3: THE EFFECT OF SHIFTING FROM OUTCROSSING TO SELFING ON ADDITIVE VARIANCE

The empirical estimates of all the genetic-variance components for floral and fitness traits compiled from the literature suggest that considering all the components is critical for understanding the adaptive potential of historically outcrossing populations in the event of a shift towards selfing (Fig. 7). In the full model, switching from obligate outcrossing to complete selfing increases the adaptive potential by a factor of 3, compared to a factor of 2 for the additive model (Fig. 7). The simulated data agree with this pattern when genetic diversity is low (i.e., for low mutation rates and/or strong stabilizing selection, Fig. 7; Fig. S9 and S10). The rate of increase in adaptive potential with increasing selfing rate depends on the degree of dominance and is stronger for complete dominance (Fig. 7). When genetic diversity is higher (for high mutation rate and/or weak stabilizing selection), on the other hand, the increase in adaptive potential with selfing is weaker under the full model than under the additive model (Fig. S11). Interestingly, several of our simulation sets corresponds well to the pattern in the empirical data (Fig. 7; Fig. S9 and S10), especially the case N = 1000, U = 0.005, L = 50, D = 1, and ω² = 9 (Fig. 7). These observations suggest that the studied traits may tend to be subject to strong dominance (0.5 ≤ D ≤ 1) and strong stabilizing selection (1 ≤ ω² ≤ 9).

Evolution of the additive variance (equation 12) for a randomly mating population (s = 0) in the event of a switch to a given selfing rate s. Grey points represent average values for empirical estimates (± 1 SE, see eq. 20 for details, and Table S1 for the data), whereas red, blue and black points represent simulation results for di = 0, ri/2 and ri, respectively. The genic model represents the classical prediction of an increase of the adaptive potential of a factor (1+F). Other parameters values are N = 1000, U = 0.005, L = 50, and ω² = 9. Errors bars indicate 95% confidence intervals for simulated values (n = 200), and standard errors for empirical values (n = 22).
Figure 7

Evolution of the additive variance (equation 12) for a randomly mating population (s = 0) in the event of a switch to a given selfing rate s. Grey points represent average values for empirical estimates (± 1 SE, see eq. 20 for details, and Table S1 for the data), whereas red, blue and black points represent simulation results for di = 0, ri/2 and ri, respectively. The genic model represents the classical prediction of an increase of the adaptive potential of a factor (1+F). Other parameters values are N = 1000, U = 0.005, L = 50, and ω² = 9. Errors bars indicate 95% confidence intervals for simulated values (n = 200), and standard errors for empirical values (n = 22).

Discussion

Shifts in mating systems can have important implications for trait evolvability and hence the potential of populations to adapt to shifting adaptive optima. Here, we have explored the effect of dominance on a quantitative trait under stabilizing selection. We have shown that the additive variance is always the largest component of the genetic variance, but the relative contribution of each component of the genetic variance depends on the degree of dominance and the selfing rate of the population under study. For inbred populations, even if the contribution of those dominance terms specific to inbred populations can be moderate, incorporating them into models of response to selection greatly improves the predictive power. We also showed that a simplification of existing models of selection response in partially selfing populations do not lead to dramatic reductions in predictive power. The overall effect of dominance is to flatten the effect of mating system on the immediate response to selection, notably by reducing the standing genetic variation of randomly mating populations compared to the additive model (Fig. 2). In the mid-term, the effect of selfing depends on the patterns of genetic associations within populations. For high mutation rates, response to selection is positively correlated with the selfing rate of populations, as the release of genetic diversity stored in linkage disequilibrium may then fuel response to selection. For low mutation rates and low linkage disequilibrium, we found the opposite pattern that the immediate response to selection was uncorrelated with the selfing rate with dominance, but the relationship became negative over time. Finally, based on empirical estimates of all relevant components of genetic variance in partially inbred species, we have shown that the transition from obligate outcrossing to selfing is probably more advantageous in terms of adaptive potential than previously expected, suggesting that selfing may evolve under a wider range of conditions than traditionally thought. The comparison of empirical estimates of variance components to our simulation results allowed us to formulate hypotheses about the strength of stabilizing selection typically acting on fitness-related traits.

THE DECOMPOSITION OF THE GENETIC VARIANCE UNDER DOMINANCE AND INBREEDING

Our simulations demonstrate that most of the genetic variance is explained by the additive variance (as defined by Cockerham and Weir 1984). For outcrossing populations, where only the genic and classical dominance variance (σ²DR) contributes to genetic diversity, we found that dominance variance never explains more than 30% of the genetic variance. This result extends the theoretical predictions of Hill et al. (2008), namely that dominance variance contributes only a small fraction of the genetic variance and that adding selection on the focal trait does not alter qualitatively these results. Empirical results are more variable, and dominance variance can explain from 0 to almost 100% of the genetic variance (see Wolak and Keller 2014 and Class and Brommer 2020 for brief reviews). Estimates from natural populations are rare and hence prevent generalization about the contribution of dominance to genetic variance, but most estimates suggest a dominance contribution of less than 50% (Mullin et al. 1992; Abney et al. 2000; Merilä et al. 2001; Waldmann et al. 2008; Silva et al. 2010; Class and Brommer 2020), in agreement with our simulation results.

When considering all relevant components of the genetic variance, we found that the genic variance, the variance of dominance deviations in a fully inbred populations, and the covariance between additive effects of alleles and their homozygous dominance deviations are important components to consider if we want to understand the adaptive potential of populations. The contribution of these terms to the genetic variance is important mainly for highly selfing populations for which the inbreeding coefficient is high. This result agrees with the few empirical data available in the literature (Hoeschele and Vollema 1993; Shaw et al. 1998; Edwards and Lamkey 2002; Kelly 2003; Kelly and Arathi 2003; Marriage and Kelly 2009). Again, more empirical results are needed to gain insight into the evolutionary importance of these components in concrete cases. The scarcity of such data in the literature almost certainly relates to the complexity of their inference, which necessitates either complicated crossing designs (Shaw et al. 1998), or the use of fully inbred lines (Kelly and Arathi 2003). Exploiting predominantly selfing species is probably the easiest way forward towards greater empirical insight into these processes (Gay et al. 2013), because their populations are naturally organized into fully inbred lines (Siol et al. 2008; Jullien et al. 2019). By considering the selfed progenies of these natural lines as well as the rare hybrids produced by residual allogamy between the repeated multi-locus genotypes, it is possible to estimate all the components of the genetic variance (Kelly and Arathi 2003).

CONSEQUENCES OF A MATING SYSTEM SHIFT FOR SHORT- AND LONG-TERM ADAPTIVE POTENTIAL

Based on a fully additive model, a shift from outcrossing to selfing increases the adaptive potential by a factor 1 + F (Wright 1931). By considering a more realistic genetic architecture of quantitative traits, and by compiling empirical estimates of all genetic components of mixed-mating plants, we have shown that the gain in adaptive potential can be greater than in the additive model, notably when tending toward high selfing rates (s ≥ 0.8). This strong beneficial effect can contribute to explain why transitions from outcrossing to selfing are so frequent (Wright et al. 2013). The good fit between our simulation results and the empirical data allowed us to hypothesize that the floral traits studied in N. menziesii (Shaw et al. 1998) and M. guttatus (Kelly 2003; Kelly and Arathi 2003; Marriage and Kelly 2009) tend to be under strong stabilizing selection (1 ≤ ω² ≤ 9). This insight must be taken as provisional, however, because other parameter sets not consider here could conceivably fit the empirical data equally well. Estimates of the strength of stabilizing selection acting on fitness-related traits are rare in the literature (Kingsolver et al. 2001), and our results stress the importance of further investigations.

One important insight from our simulations is that, in the long term, the reduction of genic variance due to purifying selection and dominance in outcrossing and mixed-mating populations lead to a limited effect of the selfing rate on the immediate response to selection. This is in agreement with the overall weak relationship between the selfing rate and the adaptive potential of populations detected in meta-analyses (Charlesworth and Charlesworth 1995; Geber and Griffen 2003; Ashman and Majetic 2006; Opedal et al. 2017; Clo et al. 2019). In addition, Clo et al. (2019) found that narrow sense-heritabilities of strictly allogamous species did not differ detectably from broad-sense heritabilities of predominantly selfing species (selfing rate ≥ 0.8), which is expected to be a more accurate predictor of evolutionary potential for this mating-system category. While these studies have assessed relationships between mating systems and standing genetic variance, we are not aware of any experiments comparing the realized response to selection for a trait in populations that truly differ in their mating regimes (Holeski and Kelly 2006 and Noël et al. 2017 artificially manipulated the selfing rates of their model organisms). Such experiments are necessary to assess the realized effect of mating systems on adaptive potential because no integrative measures of the additive variance of populations as a function of their selfing rate are available in the literature. The best way to estimate the “realized” evolvability (additive variance) of a trait remains to impose directional selection, and control for the selection differential (as in Noël et al. 2017). In addition, this approach may be the most promising way forward for estimating additive variance in mixed-mating and predominantly selfing populations, notably if the aim is not to estimate the exact value of each component of the genetic variance. The effect of selfing on the mid-term adaptive potential will depend on the strength of genetic associations. When they are strong, selfing remains at least as advantageous as outcrossing, and can even be more advantageous, as the remobilization of the diversity stored within genetic associations will fuel the response to selection in later generations. Such associations are expected to be common in natural populations (Rieseberg et al. 1999). If these associations are negligible, on the other hand, the neutral effect of selfing in the short-term becomes negative in the mid-term, as selection in selfing populations will occur on the few lines segregating in the populations (Clo et al. 2020), while outcrossing populations will adapt from standing genetic variation accumulated at equilibrium.

PREDICTING THE RESPONSE TO SELECTION IN PARTIALLY SELFING POPULATIONS

To evaluate the importance of non-additive variance components for selection response, we tested if a simplification of the structured linear model (Kelly 1999a) can be a good predictor of the evolution of population mean fitness. Although the additional genetic variance components relevant to inbred populations (σ²DI, σADI, and H*) contribute only moderately to the genetic variance of the population, the single-cohort model we used proved always to be more accurate than a fully additive model, even when dominance is not directional on average, in agreement with a previous investigation by Kelly and Williamson (2000). The additive model generally overestimates the response to selection compared to the full model, notably because it ignores the covariance between the additive effects of alleles and their homozygous dominance deviations, which can be substantially negative as previously pointed out by Shaw et al. (1998). The single-cohort model is expected to be inaccurate when inbreeding depression is strong (Kelly and Williamson 2000), which was not the case in our simulations because the quantitative trait under study is already under selection, or when the selected individuals are not a random sample of the inbreeding classes (Kelly 1999a; Walsh and Lynch 2018). Inbreeding depression does not seem to alter our ability to predict response to selection, notably because it is purged with selfing (Fig. 6). A surprising result was that, with dominance, highly selfing populations may be subject to substantial outbreeding depression. Dominance can cause negative inbreeding depression within a highly selfing population because inbred individuals have high fitness (they are adapted to the local optima), but outcrossing events among inbred lines revealed the dominance relationship among alleles fixed in parental lines, and make hybrids deviate from the phenotypic optimum, leading to a more or less drastic decrease in fitness. This result is supported empirically, because studies of Caenorhabditis elegans (Dolgin et al. 2007; Gimond et al. 2013) and Priquieta caroliniana (Rhode and Cruzan 2005) have found that hybrids from naturally occurring inbred lines within a population were less fit than selfed parental lines.

We found that this latter mechanism can greatly bias the predictions derived from the simplified model for highly but not fully selfing populations when the dominance deviations and selection act in the same direction. This discrepancy is notably due to the fact that for such selfing rates populations are organized into inbred lines (Lande and Porcher 2015; Abu Awad and Roze 2018), and hybridization events between those lines creates F1 hybrids in which directional dominance is fully expressed. If the dominance and selection act in the same direction, it will split the population into two cohorts, one with those F1 that were selected against before the change, and another cohort of inbred lines that are less fit than their hybrids (Clo et al. 2020). In such cases, the inbreeding coefficient of the selected individuals is much lower than expected for such selfing rates, explaining the difference between predicted and observed changes (Kelly 1999a). If dominance and selection act in different directions, F1 hybrids will be less fit than inbred lines in the new environment, and the selected individuals will have an inbreeding coefficient closer to that expected under such a high selfing rate, explaining why our simplification is more accurate in this case (Fig. S6). Because the response to selection after an environmental change can be fuelled by the remobilization of cryptic diversity stored in negative linkage disequilibrium by residual allogamy in predominantly selfing species (Clo et al. 2020), we expect that the alignment between dominance and selection will have a major effect on the short-term adaptive potential of inbred populations. Notably, if hybrids are selected against because dominance generates recombinant individuals far from the new phenotypic optimum, the remobilization of cryptic diversity by residual allogamy will not occur, and response to selection will be based on inbred lines, limiting the adaptive potential of selfing populations (Noël et al. 2017; Clo et al. 2020).

Conclusions and Implications for Evolution in Changing Reproductive Environments

Our results offer some insights into the consequences of a change in the reproductive environment, such as a decline in the reliability of pollination leading to a shift toward a greater rate of selfing. Based on our simulations, if a shift in the phenotypic optimum occurs, the ability of populations to track this shift is not compromised by an increased rate of selfing. This suggests that reduced adaptive potential is unlikely to make predominantly selfing an evolutionary “dead end” (Stebbins 1957), at least in the short term. Indeed, if the mutation rate on the phenotypic trait is sufficiently high so that genetic associations contribute to genetic variance, the release of such diversity could allow predominantly selfing lineages to evolve faster than outcrossing or mixed-mating lineages. While some support for Stebbins’ classic hypothesis has come from phylogenetic studies showing increased diversification rates of some self-incompatible taxa (e.g., Goldberg et al. 2010), it is not well understood whether similar trends exist for mixed-mating lineages with continuous variation in outcrossing rates (Wright et al. 2013). Our finding that evolutionary potential remains comparable across the entire gradient in outcrossing rates suggest that other ecological or evolutionary mechanisms need to be invoked to explain reduced evolutionary success of (partially) selfing species. For example, it is known that selfing populations occurs more frequently at range margins (Griffin and Willi 2014), and at higher latitudes (Grossenbacher et al. 2015), compared to outcrossing populations. These environments are generally harsh, with for example more extreme temperatures, increased seasonality, and less biotic diversity (Mittelbach et al. 2007). It is possible that the probability of extinction is not affected by the mating system in the core of species distributions, but selfing populations occurring in harsher environment could be more prone to extinction as genetic variance is reduced under such conditions (Martínez-Padilla et al. 2017). Another interesting question would be to investigate which levels of selfing are more prone to extinction. Goldberg et al. (2010) reported higher extinction rates of self-compatible lineages, but nothing is known about which levels of selfing are driving this pattern. Notably, the transition from outcrossing to selfing can be highly risky, as it exposes inbreeding load to selection, decreasing at least temporarily the fitness of the population (Cheptou 2004), and increases the probability of fixing deleterious mutations due to a decrease in effective population size (Abu Awad and Billard 2017). Nevertheless, in such a case, the extinction is theoretically so fast that it could not be detectable in phylogenetic data (Abu Awad and Billard 2017). These two phenomena can lead to population extinction (Cheptou 2019).

Hence, further studies are needed to understand when and how selfing can be an evolutionary dead-end. For example, it is important to note that our model remains simplistic and does not consider other factors influencing the amount of diversity for a quantitative trait such as linked selection and recurrent bottlenecks that often occur for selfing populations. In addition, quantitative-genetic models do not consider the effect of background deleterious mutations on the fitness of selfing populations, which are known to play a role in population viability. Integrating these factors into future model would contribute to a deeper understanding of the adaptive potential of selfing populations.

AUTHOR CONTRIBUTIONS

J.C. wrote the simulation code and compiled empirical data. J.C. and Ø.H.O. analyzed the results and wrote the manuscript.

ACKNOWLEDGMENTS

We thank J.K. Kelly for providing information about the interpretation of the quantitative traits measured in Mimulus. We thank R. Shaw, T. Bataillon, J. Ronfort, and E.V. Tambarussi for helpful comments on the manuscript. We thank Sylvain Glémin and two anonymous reviewers that helped improve the clarity and interpretation of the manuscript. We finally thank the Evolvability Working Group at the Centre for Advanced Study in Oslo for hosting us during parts of the work. This work has been conducted with the help of the data and calculation centre South Green of the CIRAD-UMR AGAP.

DATA ARCHIVING

Code and data will have been deposited on Dryad (https://datadryad.org/stash/share/ps5OvvZMk2PNg8WQvANqQG964IT1FkGmGVCbBdkG4m0).

CONFLICT OF INTEREST

Authors declare no conflict of interest.

LITERATURE CITED

Abney
,
M.
,
M. S.
McPeek
, and
C.
Ober
.
2000
.
Estimation of variance components of quantitative traits in inbred populations
.
The American Journal of Human Genetics
 
66
:
629
650
.

Abu Awad
,
D.
, and
S.
Billiard
.
2017
.
The double edged sword: The demographic consequences of the evolution of self-fertilization
.
Evolution
 
71
:
1178
1190
.

Abu Awad
,
D.
, and
D.
Roze
.
2018
.
Effects of partial selfing on the equilibrium genetic variance, mutation load, and inbreeding depression under stabilizing selection
.
Evolution
 
72
:
751
769
.

Ashman
,
T. L.
, and
C. J.
Majetic
.
2006
.
Genetic constraints on floral evolution: a review and evaluation of patterns
.
Heredity
 
96
:
343
352
.

Baker
,
H. G.
 
1955
.
Self-compatibility and establishment after ‘long-distance’ dispersal
.
Evolution
 
9
:
347
-
349
.

Barrett
,
S. C.
 
2003
.
Mating strategies in flowering plants: the outcrossing–selfing paradigm and beyond
.
Philosophical Transactions of the Royal Society of London Series B: Biological Sciences
 
358
:
991
1004
.

Bulmer
,
M. G.
 
1974
.
Linkage disequilibrium and genetic variability
.
Genetics Research
 
23
:
281
289
.

Bürger
,
R.
,
G. P.
Wagner
, and
F.
Stettinger
.
1989
.
How much heritable variation can be maintained in finite populations by mutation–selection balance?
 
Evolution
 
43
:
1748
1766
.

Carter
,
A. J.
,
J.
Hermisson
, and
T. F.
Hansen
.
2005
.
The role of epistatic gene interactions in the response to selection and the evolution of evolvability
.
Theoretical population biology
 
68
:
179
-
196
.

Charlesworth
,
D.
, and
B.
Charlesworth
.
1995
.
Quantitative genetics in plants: the effect of the breeding system on genetic variability
.
Evolution
 
49
:
911
920
.

Cheptou
,
P. O.
 
2004
.
Allee effect and self-fertilization in hermaphrodites: reproductive assurance in demographically stable populations
.
Evolution
 
58
:
2613
2621
.

Cheptou
,
P. O.
 
2019
.
Does the evolution of self-fertilization rescue populations or increase the risk of extinction?
.
Annals of botany
 
123
:
337
345
.

Cheptou
,
P. O.
 
2021
.
Pollination strategies in the face of pollinator decline
.
Botany Letters
 
1
8
.

Class
,
B.
, and
J. E.
Brommer
.
2020
.
Can dominance genetic variance be ignored in evolutionary quantitative genetic analyses of wild populations?
 
Evolution
.

Clo
,
J.
,
L.
Gay
, and
J.
Ronfort
.
2019
.
How does selfing affect the genetic variance of quantitative traits? An updated meta-analysis on empirical results in angiosperm species
.
Evolution
.

Clo
,
J.
,
J.
Ronfort
, and
D.
Abu Awad
.
2020
.
Hidden genetic variance contributes to increase the short-term adaptive potential of selfing populations
.
Journal of Evolutionary Biology
 
33
:
1203
1215
.

Cockerham
,
C. C.
, and
B. S.
Weir
.
1984
.
Covariances of relatives stemming from a population undergoing mixed self and random mating
.
Biometrics
:
157
164
.

Dolgin
,
E. S.
,
B.
Charlesworth
,
S. E.
Baird
, and
A. D.
Cutter
.
2007
.
Inbreeding and outbreeding depression in caenorhabditis nematodes
.
Evolution
 
61
:
1339
1352
.

Eckert
,
C. G.
,
K. E.
Samis
, and
S.
Dart
.
2006
.
Reproductive assurance and the evolution of uniparental reproduction in flowering plants
.
Ecology and evolution of flowers
 
183
:
203
.

Edwards
,
J. W.
, and
K. R.
Lamkey
.
2002
.
Quantitative genetics of inbreeding in a synthetic maize population
.
Crop Science
 
42
:
1094
1104
.

Falconer
,
D. S.
, and
T. F. C.
Mackay
.
1996
.
Introduction to quantitative genetics
.
Pearson Education Limited
,
Edimbourg, U.K
.

Fisher
,
R. A.
 
1941
.
Average excess and average effect of a gene substitution
.
Annals of Eugenics
 
11
:
53
-
63
.

Gay
,
L.
,
M.
Siol
, and
J.
Ronfort
.
2013
.
Pedigree-free estimates of heritability in the wild: promising prospects for selfing populations
.
PloS one
 
8
:e66983.

Geber
,
M. A.
, and
L. R.
Griffen
.
2003
.
Inheritance and natural selection on functional traits
.
International Journal of Plant Sciences
 
164
:
S21
S42
.

Gimond
,
C.
,
R.
Jovelin
,
S.
Han
,
C.
Ferrari
,
A. D.
Cutter
, and
C.
Braendle
.
2013
.
Outbreeding depression with low genetic variation in selfing caenorhabditis nematodes
.
Evolution
 
67
:
3087
3101
.

Glémin
,
S.
 
2003
.
How are deleterious mutations purged? Drift versus nonrandom mating
.
Evolution
 
57
:
2678
2687
.

Goldberg
,
E. E.
,
J. R.
Kohn
,
R.
Lande
,
K. A.
Robertson
,
S. A.
Smith
, and
B.
Igić
.
2010
.
Species Selection Maintains Self-Incompatibility
.
Science
 
330
:
493
.

Griffin
,
P. C.
, and
Y.
Willi
.
2014
.
Evolutionary shifts to self-fertilisation restricted to geographic range margins in North American Arabidopsis lyrata
.
Ecology Letters
 
17
:
484
490
.

Grossenbacher
,
D.
,
R.
Briscoe Runquist
,
E. E.
Goldberg
, and
Y.
Brandvain
.
2015
.
Geographic range size is predicted by plant mating system
.
Ecology letters
 
18
:
706
713
.

Haldane
,
J. B. S.
 
1924
.
A mathematical theory of natural and artificial selection. Part II the influence of partial self-fertilisation, inbreeding, assortative mating, and selective fertilisation on the composition of mendelian populations, and on natural selection
.
Biological Reviews
 
1
:
158
163
.

Hansen
,
T. F.
,
C.
Pélabon
, and
D.
Houle
.
2011
.
Heritability is not evolvability
.
Evolutionary Biology
 
38
:
258
.

Hill
,
W. G.
,
M. E.
Goddard
, and
P. M.
Visscher
.
2008
.
Data and theory point to mainly additive genetic variance for complex traits
.
PLoS Genet
 
4
:e1000008.

Hoeschele
,
I.
, and
A. R.
Vollema
.
1993
.
Estimation of variance components with dominance and inbreeding in dairy cattle
.
Journal of Animal Breeding and Genetics
 
110
:
93
104
.

Holeski
,
L. M.
, and
J. K.
Kelly
.
2006
.
Mating system and the evolution of quantitative traits: an experimental study of Mimulus guttatus
.
Evolution
 
60
:
711
723
.

Igic
,
B.
, and
J. R.
Kohn
.
2006
.
The distribution of plant mating systems: study bias against obligately outcrossing species
.
Evolution
 
60
:
1098
-
1103
.

Igic
,
B.
, and
J. W.
Busch
.
2013
.
Is self-fertilization an evolutionary dead end?
.
New Phytologist
 
198
:
386
-
397
.

Jullien
,
M.
,
M.
Navascués
,
J.
Ronfort
,
K.
Loridon
, and
L.
Gay
.
2019
.
Structure of multilocus genetic diversity in predominantly selfing populations
.
Heredity
 
123
:
176
191
.

Keightley
,
P. D.
, and
T. M.
Bataillon
.
2000
.
Multigeneration Maximum-Likelihood Analysis Applied to Mutation-Accumulation Experiments in Caenorhabditis elegans
.
Genetics
 
154
:
1193
.

Kelly
,
J. K.
 
1999a
.
Response to selection in partially self-fertilizing populations. I. Selection on a single trait
.
Evolution
 
53
:
336
349
.

Kelly
,
J. K.
 
1999b
.
Response to selection in partially self-fertilizing populations. II. Selection on multiple traits
.
Evolution
 
53
:
350
357
.

Kelly
,
J. K.
 
2003
.
Deleterious mutations and the genetic variance of male fitness components in Mimulus guttatus
.
Genetics
 
164
:
1071
1085
.

Kelly
,
J. K.
, and
H. S.
Arathi
.
2003
.
Inbreeding and the genetic variance in floral traits of Mimulus guttatus
.
Heredity
 
90
:
77
.

Kelly
,
J. K.
, and
S.
Williamson
.
2000
.
Predicting response to selection on a quantitative trait: a comparison between models for mixed-mating populations
.
Journal of theoretical biology
 
207
:
37
56
.

Kingsolver
,
J. G.
,
H. E.
Hoekstra
,
J. M.
Hoekstra
,
D.
Berrigan
,
S. N.
Vignieri
,
C. E.
Hill
, … &
P.
Beerli
.
2001
.
The strength of phenotypic selection in natural populations
.
The American Naturalist
 
157
:
245
261
.

Lande
,
R.
 
1977
.
The influence of the mating system on the maintenance of genetic variability in polygenic characters
.
Genetics
 
86
:
485
498
.

Lande
,
R.
 
1979
.
Quantitative genetic analysis of multivariate evolution, applied to brain: body size allometry
.
Evolution
:
402
416
.

Lande
,
R.
, and
E.
Porcher
.
2015
.
Maintenance of quantitative genetic variance under partial self-fertilization, with implications for evolution of selfing
.
Genetics
 
200
:
891
906
.

Lynch
,
M.
 
1988
.
The rate of polygenic mutation
.
Genetics Research
 
51
:
137
148
.

Lynch
,
M.
, and
B.
Walsh
.
1998
.
Genetics and analysis of quantitative traits
.
Sinauer Sunderland, MA
.

Marriage
,
T. N.
, and
J. K.
Kelly
.
2009
.
Inbreeding depression in an asexual population of Mimulus guttatus
.
Journal of Evolutionary Biology
 
22
:
2320
2331
.

Martínez-Padilla
,
J.
,
A.
Estrada
,
R.
Early
, and
F.
García-González
.
2017
.
Evolvability meets biogeography: evolutionary potential decreases at high and low environmental favourability
.
Proceedings of the Royal Society B: Biological Sciences
 
284
:20170516.

Mittelbach
,
G. G.
,
D. W.
Schemske
,
H. V.
Cornell
,
A. P.
Allen
,
J. M.
Brown
,
M. B.
Bush
, et al.
2007
.
Evolution and the latitudinal diversity gradient: speciation, extinction and biogeography
.
Ecology Letters
 
10
:
315
331
.

Merilä
,
J.
,
L. E. B.
Kruuk
, and
B. C.
Sheldon
.
2001
.
Natural selection on the genetical component of variance in body condition in a wild bird population
.
Journal of Evolutionary Biology
 
14
:
918
929
.

Moeller
,
D. A.
,
R. D.
Briscoe Runquist
,
A. M.
Moe
,
M. A.
Geber
,
C.
Goodwillie
,
P. O.
Cheptou
, …,
A. A.
Winn
.
2017
.
Global biogeography of mating system variation in seed plants
.
Ecology Letters
 
20
:
375
384
.

Mullin
,
T. J.
,
E. K.
Morgenstern
,
Y. S.
Park
, and
D. P.
Fowler
.
1992
.
Genetic parameters from a clonally replicated test of black spruce (Picea mariana)
.
Canadian Journal of Forest Research
 
22
:
24
36
.

Nietlisbach
,
P.
,
L. F.
Keller
, and
E.
Postma
.
2016
.
Genetic variance components and heritability of multiallelic heterozygosity under inbreeding
.
Heredity
 
116
:
1
11
.

Noël
,
E.
,
P.
Jarne
,
S.
Glémin
,
A.
MacKenzie
,
A.
Segard
,
V.
Sarda
, et al.
2017
.
Experimental evidence for the negative effects of self-fertilization on the adaptive potential of populations
.
Current Biology
 
27
:
237
242
.

Opedal
,
Ø. H.
 
2019
.
Evolutionary Potential of Herkogamy
.
eLS
:
1
8
.

Opedal
,
Ø. H.
,
G. H.
Bolstad
,
T. F.
Hansen
,
W. S.
Armbruster
, and
C.
Pélabon
.
2017
.
The evolvability of herkogamy: Quantifying the evolutionary potential of a composite trait
.
Evolution
 
71
:
1572
1586
.

Peterson
,
M. L.
, and
K. M.
Kay
.
2015
.
Mating system plasticity promotes persistence and adaptation of colonizing populations of hermaphroditic angiosperms
.
The American Naturalist
 
185
:
28
43
.

Rhode
,
J. M.
, and
M. B.
Cruzan
.
2005
.
Contributions of Heterosis and Epistasis to Hybrid Fitness
.
The American Naturalist
 
166
:
E124
E139
.

Rieseberg
,
L. H.
,
M. A.
Archer
, and
R. K.
Wayne
.
1999
.
Transgressive segregation, adaptation and speciation
.
Heredity
 
83
:
363
372
.

Ronce
,
O.
,
F. H.
Shaw
,
F.
Rousset
, and
R. G.
Shaw
.
2009
.
Is inbreeding depression lower in maladapted populations? a quantitative genetics model
.
Evolution
 
63
:
1807
1819
.

Shaw
,
R. G.
,
D. L.
Byers
, and
F. H.
Shaw
.
1998
.
Genetic components of variation in Nemophila menziesii undergoing inbreeding: morphology and flowering time
.
Genetics
 
150
:
1649
1661
.

Shaw
,
F. H.
,
C. J.
Geyer
, and
R. G.
Shaw
.
2002
.
A comprehensive model of mutations affecting fitness and inferences for arabidopsis thaliana
.
Evolution
 
56
:
453
463
.

Siepielski
,
A. M.
,
M. B.
Morrissey
,
M.
Buoro
,
S. M.
Carlson
,
C. M.
Caruso
,
S. M.
Clegg
, et al.
2017
.
Precipitation drives global variation in natural selection
.
Science
 
355
:
959
962
.

Silva
,
J. C.
,
C.
Hardner
, and
B. M.
Potts
.
2010
.
Genetic variation and parental performance under inbreeding for growth in Eucalyptus globulus
.
Annals of Forest Science
 
67
:
606
606
.

Siol
,
M.
,
J. M.
Prosperi
,
I.
Bonnin
, and
J.
Ronfort
.
2008
.
How multilocus genotypic pattern helps to understand the history of selfing populations: a case study in Medicago truncatula
.
Heredity
 
100
:
517
.

Stebbins
,
G. L.
 
1957
.
Self fertilization and population variability in the higher plants
.
The American Naturalist
 
91
:
337
354
.

Takebayashi
,
N.
, and
P. L.
Morrell
.
2001
.
Is self-fertilization an evolutionary dead end? revisiting an old hypothesis with genetic theories and a macroevolutionary approach
.
American Journal of Botany
 
88
:
1143
1150
.

Waldmann
,
P.
,
J.
Hallander
,
F.
Hoti
, and
M. J.
Sillanpää
.
2008
.
Efficient Markov chain Monte Carlo implementation of Bayesian analysis of additive and dominance genetic variances in noninbred pedigrees
.
Genetics
 
179
:
1101
1112
.

Walsh
,
B.
, and
M.
Lynch
.
2018
.
Evolution and selection of quantitative traits
.
Oxford University Press
.

Whitehead
,
M. R.
,
R.
Lanfear
,
R. J.
Mitchell
, and
J. D.
Karron
.
2018
.
Plant mating systems often vary widely among populations
.
Frontiers in Ecology and Evolution
 
6
:
38
.

Wolak
,
M. E.
, and
L. F.
Keller
.
2014
.
Dominance genetic variance and inbreeding in natural populations
.
Quantitative genetics in the wild
:
104
127
.

Wright
,
S.
 
1931
.
Evolution in Mendelian populations
.
Genetics
 
16
:
97
.

Wright
,
A. J.
, and
C. C.
Cockerham
.
1985
.
Selection with partial selfing. I. Mass selection
.
Genetics
 
109
:
585
597
.

Wright
,
S. I.
,
S.
Kalisz
, and
T.
Slotte
.
2013
.
Evolutionary consequences of self-fertilization in plants
.
Proc R Soc B
 
280
:20130133.

Associate Editor: S. Glemin

Handling Editor: M. Zelditch

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://dbpia.nl.go.kr/journals/pages/open_access/funder_policies/chorus/standard_publication_model)

Supplementary data