Abstract

The warping effect on the fractional quantum Hall (FQH) states in topological insulators is studied theoretically. Based on the perturbed wavefunctions, which include contributions from the warping term, analytical expressions for Haldane's pseudopotentials are obtained. We show that the warping term does not break the symmetry of the pseudopotentials for |$n={\pm }1$| Landau levels (LLs). On increasing the warping strength of the Fermi surface, our results indicate that the stability of the FQH states for LL |$n=0$| (LLs |$n={\pm }1$|⁠) becomes stronger (weaker), and the excitation gap at the |$\nu =1/3$| FQH state for LL |$n=0$| also increases while the gaps for LLs |$n={\pm }1$| are unchanged.

1. Introduction

Topological insulators (TIs) as a new phase of quantum matter, which cannot be adiabatically connected to conventional insulators and semiconductors, have been intensively studied in recent years [1–10]. TIs are characterized by a full insulating gap in the bulk and protected gapless edge or surface states. Near the Fermi level the low-energy dispersion of the TI surface states shows a Dirac linear behavior. However, the recent angle-resolved photoemission spectroscopy experiments show that the Fermi surface in Bi2Te3 [9,10], a typical TI, is a snowflake shape rather than a circle one. The origin of this snowflake-like Fermi surface has been confirmed to arise from an unconventional hexagonal warping term [11]. It is this warping term that brings about many unique physical phenomena [12–14], which cannot be observed in other systems, including the extensively studied graphene and the conventional 2D electron gas.

More recently, increasing attention has been paid to the interactions of the Dirac-type quasiparticles and their strong correlation effects in TI, especially the TI fractional quantum Hall (TIFQH) states. Despite no undeniable experimental observation of the TIFQH states heretofore, some theoretical studies have been undertaken. For example, DaSilva [15] predicted the stability of the TIFQH states for Landau levels (LLs) with index |$n=0$| and ±1 in TIs. Apalkov and Chakraborty studied the finite thickness effect on the TIFQH states [16]. Also, the present authors investigated the influences of the Zeeman splitting and the tilted strong magnetic field on the stability of the TIFQH states [17,18] with large g factor. However, many important and interesting open questions, such as the warping effect, the spin excitations, and the subband–LL coupling, have not been discussed in the TIFQH regime.

In this paper we theoretically study the warping effect on the TIFQH states. Here the warping term is perturbatively treated. With the help of the numerical calculations, we show that the warping term cannot break the symmetry of Haldane's pseudopotentials for |$n={\pm }1$| LLs, which differs from the role of the spin splitting [17]. Moreover, our results indicate that, with an increase in the warping strength of the Fermi surface, the stability of the TIFQH states for LL |$n=0$| (LLs |$n={\pm }1$|⁠) become stronger (weaker), and the excitation gap at |$\nu =1/3$| filling for LL |$n=0$| (gaps for LLs |$n={\pm }1$|⁠) also increases (remains unchanged).

2. Model and results

In the presence of a perpendicular magnetic field |$\textbf {B}=B\hat {z}$|⁠, the effective Dirac Hamiltonian for the Bi2Te3(111) surface is written as
(1)
where |$\boldsymbol {\Pi }=\textbf {k}+e\textbf {A}/c$| with the wave vector |$\textbf {k}=(k_{x},k_{y},0)$| and the gauge |$\textbf {A} =B(-y/2,x/2,0)$|⁠. Here, |$\Pi _{\pm }=\boldsymbol {\Pi }_{x}\pm \boldsymbol {\Pi }_{y}$|⁠, |$\sigma _{x,y,z}$| are Pauli matrices, |$v_{f}$| denotes the Fermi velocity, and |$\lambda $| describes the hexagonal warping strength of the Fermi surface [11]. Here we have assumed that the Zeeman splitting is much weaker than the warping term and can therefore be neglected for the first step in order to solely illustrate the role played by the warping term. This is the case for the Bi2Te3(111) system. By introducing the ladder operators |$a^{\dagger }=\frac {1}{\sqrt {2}}\left (\frac {z}{2l_{B}}-2l_{B}\partial _{\bar {z}}\right)$| and |$a=\frac {1}{\sqrt {2}}\left (\frac {\bar {z}}{2l_{B}}+2l_{B}\partial _{z}\right)$| with |$z(\bar {z})=x\pm iy$| and the magnetic length |$l_{B}=\sqrt {\hbar c/eB}$|⁠, we can rewrite the Hamiltonian (1) as
(2)
When |$\lambda =0$| the Hamiltonian (2) can be exactly solved, and the eigenstates are given by
(3)
where the symbol |$|n,m\rangle $| is the non-relativistic 2D electron gas Landau eigenstates with non-relativistic quadratic dispersion relation in the nth LL with angular momentum m. The corresponding LLs are expressed as |$\varepsilon _{n} = {\mathrm {sgn}}(n) v_{f}\sqrt {2\vert n\vert }/l_{B}$|⁠. When the warping term is taken into account |$(\lambda \neq 0)$|⁠, however, the single-particle eigenstate cannot be obtained directly. Fortunately, one can use the perturbation method to get eigenstates of Hamiltonian (2), since the warping term, |$\sqrt {2}\lambda l_{B}^{-3}$|⁠, is much smaller than the typical energy space between the nearest-neighboring LLs, |$\sqrt {2}v_{f}/l_{B}$|⁠, i.e., |$\zeta \equiv \lambda /(v_{f}l_{B}^{2}) \ll 1$|⁠. After some long but straightforward algebraic operations, and only keeping the first-order terms, we have
(4)
where the coefficients are
(5)
Note that it seems that Eq. (4) should have |$\Vert n\vert - 4, m\rangle $| and |$\Vert n\vert + 3, m\rangle $| for the upper and lower components, respectively, in the first-order perturbation. However, after a long but straightforward derivation, we find that both of them vanish in the eigenstates of Hamiltonian (2).
In the following discussion we will focus our attention on the TIFQH states of |$|n|\leqslant 1$|⁠, because the stable TIFQH states can only be observed for LLs |$|n|\leqslant 1$| [15]. Haldane's pseudopotential [19,20] for the Coulomb interaction |$V(\textbf {r}) = \frac {e^{2}}{\epsilon r}$| between electrons in the nth LL with relative angular momentum m is given by
(6)
in terms of Laguerre polynomials |$L_{m}(x)$| and the form factor |$\mathcal {F}(q) = \langle \boldsymbol {\Psi }_{n}|e^{-i\textbf {q}\cdot \boldsymbol {\eta }}|\Psi _{n}\rangle $| with the cyclotron variable |$\boldsymbol {\eta } = \textbf {r} - \textbf {R}$|⁠. Here, R is the guiding-center position. Explicitly, for LLs |$|n| \leqslant 1$| we have
(7)
and
(8)
with |$x \equiv \frac {q^{2}l_{B}^{2}}{2}$| being a dimensionless variable. From Eq. (8) one can clearly see that Haldane's pseudopotentials for LLs |$n=1$| and |$n=-1$| are still identical in the presence of the warping term. This is different from the Zeeman splitting effect, which can induce an asymmetry in the pseudopotentials for |$n = \pm 1$| LLs [17,18].

Figure 1 plots Haldane's pseudopotentials of Coulomb interaction |$V^{(n,m)}$| for (a) |$n = 0$| and (b) |$n = 1$| LLs as functions of the relative angular momentum m. Comparing these with the results in the absence of the warping term (black dots in Fig. 1), one can clearly see that, in the presence of the warping term, the magnitude of the pseudopotentials increases (red stars in Fig. 1).

The effective pseudopotentials of the Coulomb interaction $V^{(n,m)}$ between two electrons at (a) $n = 0$ and (b) $n = 1$ LLs as functions of the relative angular momentum with different warping strengths, $\zeta = 0$ (circles) and $\zeta = 0.2$ (stars).
Fig. 1.

The effective pseudopotentials of the Coulomb interaction |$V^{(n,m)}$| between two electrons at (a) |$n = 0$| and (b) |$n = 1$| LLs as functions of the relative angular momentum with different warping strengths, |$\zeta = 0$| (circles) and |$\zeta = 0.2$| (stars).

Subsequently, the stability of the TIFQH states should also be modified by the warping term. The typical results of |$V^{(n,1)}/V^{(n,3)}$| (⁠|$n = 0$| and |$n = \pm 1$|⁠) are shown in Fig. 2 as a function of the warping parameter ζ. One can see that, with increasing ζ, |$V^{(0,1)}/V^{(0,3)}$| increases while |$V^{(\pm 1, 1)}/V^{(\pm 1, 3)}$| decreases. According to the composite fermion theory, the larger the value of |$V^{(n,1)}/V^{(n,3)}$| is, the more stable are the fractional quantum Hall states. Therefore, the remarkable warping term results in the composite fermions at fractional filling for LL |$n = 0$| (LLs |$n = \pm 1$|⁠) becoming more stable (unstable). This result suggests that on the surface of a TI material with strong (weak) warping strength, such as Bi2Te3 (Bi2Se3), the TIFQH states for LLs |$n = 0$||$(n = \pm 1)$| may be observed much more easily under a perpendicular magnetic field. We hope that this prediction will be detected in future experiments.

The ratio of the first and third relative angular momentum pseudopotentials for LLs $n = 0$ (black solid line) and $n = \pm 1$ (red dashed line) as a function of the warping term ζ.
Fig. 2.

The ratio of the first and third relative angular momentum pseudopotentials for LLs |$n = 0$| (black solid line) and |$n = \pm 1$| (red dashed line) as a function of the warping term ζ.

In what follows, by using the exact diagonalization method in the spherical geometry, we investigate the system with the fractional filling factor |$\nu = 1/(2p + 1)$|⁠, where p is an integer. For briefness we only illustrate the |$\nu = 1/3$| TIFQH state, which is realized at |$S=\frac {3}{2}(N - 1)$| in the spherical geometry, with N being the electron number. Under this configuration, the perpendicular magnetic field is equivalent to a fictitious radial magnetic field produced by a magnetic monopole at the center of a sphere of radius |$R=\sqrt {S}l_{B}$| (in units of flux quanta), and the many-body states can be described by the total angular momentum L and its z component |$L_{z}$|⁠.

We show in Fig. 3 the energy spectra of the many-body states at |$\nu = 1/3$| filling for |$N = 7$| electrons. Comparing the two cases with |$(\zeta = 0.2)$| and without |$(\zeta = 0)$| warping term, one can see from Fig. 3 that the gap width at |$n = 0$| LL between the ground state and the first excited state has a visible increment, while those at |$n = \pm 1$| LL remain unchanged. Furthermore, we calculate the corresponding excitation gap width |$E_{\mathrm {gap}}^{n} (\zeta)$| by increasing the warping term from |$\zeta = 0$| to |$\zeta = 0.3$|⁠. The variations |$\Delta E_{\mathrm {gap}} = E_{\rm gap}^{n} (\zeta) - E_{\rm gap}^{n} (\zeta = 0)$| as a function of ζ are plotted in Fig. 4, which shows that the TIFQH gap between the ground state and the lowest excited state at |$n = 0$| LL (solid line) is sensitively dependent on the warping term while the |$\Delta E_{\mathrm {gap}}$| at |$n = \pm 1$| LLs (dashed line) remains constant no matter whether the warping term is included or not. This also implies that the warping term is different from the Zeeman splitting and the tilted magnetic field, which will induce a change in the gap of the TIFQH states at LLs |$n = \pm 1$| [17,18].

Exact energies versus the angular momentum L for $N = 7$ electrons at the $\nu = \frac {1}{3}$ TIFQH state. The warping strength is chosen as $\zeta = 0$ (circles) and $\zeta = 0.2$ (stars).
Fig. 3.

Exact energies versus the angular momentum L for |$N = 7$| electrons at the |$\nu = \frac {1}{3}$| TIFQH state. The warping strength is chosen as |$\zeta = 0$| (circles) and |$\zeta = 0.2$| (stars).

The increment of the gap width as a function of the warping term ζ for $N = 7$ electrons at $\nu = \frac {1}{3}$ TIFQH states for LLs $n = 0$ (black solid line) and $n = \pm 1$ (red dashed line).
Fig. 4.

The increment of the gap width as a function of the warping term ζ for |$N = 7$| electrons at |$\nu = \frac {1}{3}$| TIFQH states for LLs |$n = 0$| (black solid line) and |$n = \pm 1$| (red dashed line).

3. Conclusion

In summary, we have perturbatively studied the effect of the warping term on the TIFQH states. It was found that, unlike the role of the Zeeman splitting and the tilted magnetic field, the warping term does not break the symmetry of Haldane's pseudopotentials for |$n = \pm 1$| LLs. Our results showed, on one hand, that the stability of the |$\nu = 1/3$| TIFQH states for LL |$n = 0$| (LLs |$n = \pm 1$|⁠) becomes stronger (weaker) by increasing the warping strength of the Fermi surface. On the other hand, the excitation gap for LL |$n = 0$| increases on increasing the strength of the warping term; the gaps for LLs |$n = \pm 1$| are insensitive to this term.

Acknowledgements

This work was supported by the Natural Science Foundation of China under Grant Nos. 11274049, 10904005, 11004013, and by the the National Basic Research Program of China (973 Program) under Grant No. 2009CB929103.

References

1

Hasan
M. Z.
Kane
C. L.
,
Rev. Mod. Phys.
82
,
3045
(
2010
).

2

Qi
X.-L.
Zhang
S.-C.
,
Rev. Mod. Phys.
83
,
1057
(
2011
).

3

Bernevig
B. A.
Hughes
T. L.
Zhang
S.-C.
,
Science
314
,
1757
(
2006
).

4

Fu
L.
Kane
C. L.
,
Phys. Rev. B
76
,
045302
(
2007
).

5

König
M.
Wiedmann
S.
Brüne
C.
Roth
A.
Buhmann
H.
Molenkamp
L. W.
Qi
X.-L.
Zhang
S.-C.
,
Science
318
,
766
(
2007
).

6

Hsieh
D.
Qian
D.
Wray
L.
Xia
Y.
Hor
Y. S.
Cava
R. J.
Hasan
M. Z.
,
Nature
452
,
970
(
2008
).

7

Zhang
H.-J.
Liu
C.-X.
Qi
X.-L.
Dai
X.
Fang
Z.
Zhang
S.-C.
,
Nat. Phys.
5
,
438
(
2009
).

8

Xia
Y.
Qian
D.
Hsieh
D.
Wrayl
L.
Pal
A.
Lin
H.
Bansil
A.
Grauer
D.
Hor
Y. S.
Cava
R. J.
,
Nat. Phys.
5
,
398
(
2009
).

9

Chen
Y.-L.
Analytis
J. G.
Chu
J.-H.
Liu
Z.-K.
Mo
S.-K.
Qi
X.-L.
Zhang
H.-J.
Lu
D.-H.
Dai
X.
Fang
Z.
,
Science
325
,
178
(
2009
).

10

Hsieh
D.
et al. ,
Nature
460
,
1101
(
2009
).

11

Fu
L.
,
Phys. Rev. Lett.
103
,
266801
(
2009
).

12

Zhang
T.
Cheng
P.
Chen
X.
Jia
J.-F.
Ma
X.
He
K.
Wang
L.
Zhang
H.
Dai
X.
Fang
Z.
Xie
X.
Xue
Q.-K.
,
Phys. Rev. Lett.
103
,
266803
(
2009
).

13

Wang
J.
Li
W.
Cheng
P.
Song
C.
Zhang
T.
Deng
P.
Chen
X.
Ma
X.
He
K.
Jia
J.-F.
Xue
Q.-K.
Zhu
B.-F.
,
Phys. Rev. B
84
,
235447
(
2011
).

14

Xue
J.
Sanchez-Yamagishi
J.
Watanabe
K.
Taniguchi
T.
Jarillo-Herrero
P.
LeRoy
B. J.
,
Phys. Rev. Lett.
108
,
016801
(
2012
).

15

DaSilva
A. M.
,
Solid State Commun.
151
,
1444
(
2011
).

16

Apalkov
V. M.
Chakraborty
T.
,
Phys. Rev. Lett.
107
,
186801
(
2011
).

17

Wang
Z.
Zheng
F.
Fu
Z.-G.
Zhang
P.
, []

18

Zheng
F.
Wang
Z.
Fu
Z.-G.
Zhang
P.
,
Europhys. Lett.
103
,
27001
(
2013
).

19

Haldane
F. D. M.
,
Phys. Rev. Lett.
51
,
605
(
1983
).

20

Haldane
F. D. M.
Rezayi
E. H.
,
Phys. Rev. Lett.
54
,
237
(
1985
).

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.