Abstract
As the dimensions of physical systems approach the nanoscale, the laws of thermodynamics must be reconsidered due to the increased importance of fluctuations and quantum effects. While the statistical mechanics of small classical systems is relatively well understood, the quantum case still poses challenges. Here, we set up a formalism that allows us to calculate the full probability distribution of energy exchanges between a periodically driven quantum system and a thermalized heat reservoir. The formalism combines Floquet theory with a generalized master equation approach. For a driven two-level system and in the long-time limit, we obtain a universal expression for the distribution, providing clear physical insight into the exchanged energy quanta. We illustrate our approach in two analytically solvable cases and discuss the differences in the corresponding distributions. Our predictions could be directly tested in a variety of systems, including optical cavities and solid-state devices.

Content from this work may be used under the terms of the Creative Commons Attribution 3.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
1. Introduction
In small systems, fluctuations of thermodynamic quantities become important. The study of fluctuations in small systems led to the development of stochastic thermodynamics [1, 2], whose predictions, such as the Jarzinski equality [3] and the Crooks fluctuation relations [4], have been experimentally verified in mechanical [5], biological [6], molecular [7, 8], optical [9], and electronic systems [10]. Thermal fluctuations can also be exploited to extract work by using nonequilibrium feedback, allowing for physical realizations of the celebrated Maxwellʼs demon [11–15].
In all the mentioned experiments, the underlying physics is essentially classical. Down to atomic size and low temperatures, however, quantum mechanics is expected to come into play. Thermodynamics and statistical mechanics of quantum systems, as well as different types of quantum fluctuation relations and their observability in different settings, have been the subject of much attention lately [16–22]. However, while experimental demonstrations are still lacking, the very definitions of basic concepts, such as work, are still under debate [16, 23–25]. This difficulty is related to the measurement process: on one hand, work is not by itself an 'observable' in quantum-mechanical sense; on the other hand, its definition in terms of a double-projective measurement, which prevails in literature [16], involves coherence loss between different-energy eigenstates after the first measurement. An interferometric measurement of the work distribution using an ancilla was considered in [20, 21]. Measurement of the environment, rather than the system, has also been proposed, in order to keep track of the energy exchanges between the two [26–28].
Here, we provide a general framework for understanding the statistics of energy exchanges between a periodically driven quantum system and a heat bath. The problem of dissipation in driven systems has a long story [29–32]. However, the statistics of the dissipated heat were considered only recently and either in very specific cases and/or in the weak-drive limit [25, 27, 33]. We set the stage by deriving from microscopic principles a generalized master equation describing the dynamics of the energy exchanges. We focus on a driven two-level system; under a limited set of assumptions, we provide analytical expressions for the mean heat power and for all the cumulants of the energy distribution after a given time. In the long-time limit, we also write down the full probability distribution in a general form. By highlighting the contribution of each individual energy exchange, the full distribution provides us with a deeper insight into the thermalization process.
Within the stated assumptions, our results apply to any type of drive and coupling mechanism. Among different regimes, that of strong driving is particularly interesting, as it cannot be addressed with perturbative techniques—the system and the drive 'hybridize' and thermalization takes place by exchanging photons at dressed-state energies. We illustrate these concepts by discussing two analytically solvable cases in which the same driven quantum system is coupled to the environment in two different ways. As we show, different coupling mechanisms can result in very different energy-exchange processes. Our formalism can be straightforwardly generalized to consider multi-level systems and multiple heat baths; as such, it could be used to study the performance of quantum heat pumps and engines [34–46].
2. Theoretical framework
We consider a generic quantum system subject to a periodic drive and weakly coupled to its environment. The environment is a macroscopic object, which we assume to be thermalized at all times. Our quantity of interest is the probability density function (PDF) for the environment to exchange the amount of energy Q between times 0 and t. The moments of Q are conveniently expressed in terms of the characteristic function (CF) , as follows: .
We write the total Hamiltonian as , where H(t) and HR are the system and reservoir Hamiltonians, respectively, and is a coupling term consisting of operators S and B acting in the Hilbert space of system and reservoir, respectively. In the following, we will take and denote with ρ and the total (system + environment), system and environment density operators, respectively.
The PDF for the heat amount Q to be transferred to the reservoir between times and t is given by [47, 48]
where is the conditional probability that a measurement of HR gives e2 at time t when it gave e1 at time t0 and is the probability to measure e1 at time t0. Introducing the projector on the j-th state of the reservoir of energy ej and using the property , we have
where U(t) is the evolution operator generated by HT(t). The CF is given by [48]
We assume the initial total density matrix to be factorized into the system density matrix and the thermalized environment density matrix , where ZR is the partition function of the environment. In particular, this assumption implies that all projectors commute with , so that the initial measurement of the observable of interest (here, HR) does not change the subsequent dynamics [25, 48].
After noticing that , we write (3) as
and finally as
where
and
satisfies the equation of motion , with . The equation for can be compared to similar expressions obtained from the full-counting statistics theory of charge transport [49], with ν playing the role of the counting field. In general, the evolution of is not unitary for .
For a periodic drive, , where τ is the drive period and the corresponding angular frequency. We assume that the unitary dynamics generated by H are known; this knowledge is captured in our formalism by the use of Floquet states and quasi-energies [31]. Floquet states are particular solutions of the Schrödinger equation of the form where the Floquet mode satisfies and is its corresponding quasi-energy.
The derivation of the GQME for the generalized density matrix of the system is done in complete analogy to the standard master equation [32] and is presented in appendix
3. General results
We write the resulting GQME in the Schrödinger picture and in the Floquet basis. Under the stated assumptions, the GQME is Markovian and time-independent. The populations are decoupled from the coherences and satisfy a vector equation of the form . For a two-level system, and
A derivation of (8) can be found in appendix
Even before solving the GQME, we notice that the knowledge of can be used to evaluate the mean heat power transferred to the reservoir at any time (see appendix
An equivalent result was recently derived using the standard master equation approach and associating the relaxation processes to the dissipated heat [44, 53, 54]. Equation (9) can be used to classify open driven quantum systems into two categories: those that exchange heat at steady state, and those that do not. In general and in contrast to the undriven case, a driven system will keep exchanging energy with the environment unless its dressed (Floquet) states are decoupled (for instance, by symmetry) from the noise.
The GQME defined by (8) has an analytical solution. The corresponding CF can be written as
where are the eigenvalues of and the projection of the initial density matrix onto the corresponding eigenvectors , normalized so that . Many properties of the heat distribution can be obtained from (10) ; see appendix
where is the n-th derivative of ξ+ with respect to ν. In the following, we will consider the first three cumulants, which coincide with the central moments, namely, mean value, variance, and skewness of the PDF.
Furthermore, the explicit knowledge of the CF allows us to retrieve the full PDF at any given time. This requires inverting the Fourier transform, a task which, in general, must be performed numerically. However, some analytical insight can be gained in the long-time limit. We first notice that is always negative, while is negative everywhere except at , , where it vanishes. From (10), we thus see that for . This property suggests performing a series expansion around each νn. After the expansion, the Fourier transform can be inverted analytically. In the following, we expand up to the second order. This expansion results in a Gaussian approximation for the PDF; accordingly, it correctly reproduces the first two moments of the original distribution. The PDF reads
where , and
with real coefficients and .
Equations (12) and (13) allow for an insightful interpretation of the energy-exchange process. The delta functions account for the fact that the exchanges take place only in multiples of . This discretization results from energy being available in photons of energy Ω, the drive frequency, and , the dressed energy gap of the driven system. Furthermore, they tell us that the system is either found in the same Floquet state or has undergone a transition upwards (downwards), with probability and , respectively. On the other hand, the total probability that a certain amount of energy has been exchanged is dictated by the weight function . An appealing feature of (12) is that it clearly shows how the heat-exchange distribution 'builds up' on individual exchanges of well-defined energy. One should keep in mind, however, that it was derived under the assumption that is localized at the nodes . This assumption holds true only in the limit where many energy quanta have been exchanged. For very long times, , one can neglect the discretization due to the Dirac combs in (12) and find that .
4. Examples
The results discussed above are general and can be applied to a two-level system with any drive and coupling operator to the environment. As an illustrative, analytically tractable example, we discuss a two-level system interacting with a monochromatic drive, described by the Rabi Hamiltonian where σi are the usual Pauli operators, ω is the bare energy gap, g the amplitude and φ the phase of the driving field. The Floquet states can be written in analytic form (see appendix
When , (9) tells that the DSS heat current is, in general, nonvanishing. In physical terms, the system is continuously 'pumped' by the drive and emits photons to the environment, resulting in a net heat flow to the environment. In this case, the dependence of the PDF on the initial state is negligible at long times. Therefore, we directly take the DSS as the initial state, for which . The full PDF is shown in the main panel of figure 1 at times (purple) and (blue). It was obtained from the analytical solution (10) by numerically inverting the Fourier transform. The structure of the PDF is the same as in (12): a series of Dirac combs modulated by an envelope which moves in time. As best seen in the Inset, the spectrum of possible energies is composed by symmetric triplets centered at integer multiples of Ω and spaced by an amount . There is a strong analogy between this result and the Mollow triplet [58] observed in quantum-optics experiments [59, 60]. As for the envelope function of the PDF, it is manifestly non-Gaussian at early times. In the long-time limit, the PDF tends to a Gaussian as the relative importance of higher-order cumulants decreases [see equation (11)].
Figure 1. Dissipated energy for transverse coupling. (a) PDF at (purple) and (blue). Inset: Triplets at frequencies , and . (b) Effect of temperature and detuning on . Temperature is changed from to . The detuning is changed from to . (c) Mean value (blue), variance σ2 (purple) and skewness κ (yellow) of the PDF as a function of the detuning Δ. For all panels, the initial state is the DSS, , , , , and .
Download figure:
Standard image High-resolution imageIn figures 1(b) and (c), we show how the PDF is affected by changes in the drive frequency and the environmental temperature. We take a long time () and use the analytical results (13) and (11). In panel (b), we plot the Gaussian envelope function for three representative cases. In passing from low to high temperature, the mean value of the distribution is barely affected, while the variance strongly increases. The fact that temperature has little influence on the average dissipated heat is related to the fact that—differently from an undriven system—the transition rates do not satisfy the detailed balance. On the contrary, the variance of the distribution depends on temperature, due to the fact that a higher-temperature environment leads to stronger noise effects. In passing from a resonant to a red-detuned drive, the PDF shows reduced average and variance because of the reduction of the energy injected in the system that can then be dissipated. This trend is confirmed by the behavior of the central moments of the PDF as a function of Δ, shown in panel (c). The maxima of the moments are reached at resonance, i.e., when .
We next consider the noise operator . In this case, (9) tells that the mean heat power vanishes at DSS. Therefore, the heat depends critically on the initial state since it is dissipated before the reaching of the DSS. The absence of a net heat flow at DSS is due to the symmetry of the problem, which forbids transitions with energy exchange and thereby causes the drive and the environment to be effectively decoupled [54]. The resulting GQME is formally equivalent to that of an undriven system; its derivation can be found in appendix
where , and , and . Notice that the structure of this PDF is the same as the more general one (12), with weight function for and 0 otherwise. Figure 2 (a) shows a typical time evolution of the PDF as the system reaches its DSS. Figure 2 (b) shows the dependence of the first three central moments on the detuning Δ, starting from the ground state of the undriven system. If, by contrast, the initial state is in a coherent superposition of the undriven system eigenstates and , then the drive phase φ also affects the heat distribution, depending on the projection of the initial state onto the plane. An example is shown in figure 2 (c) for an equal superposition of and . Notably, there exists a range of values where the mean exchanged heat becomes negative, meaning that the environment is more likely to emit energy and the system to absorb it.
Figure 2. Dissipated energy for longitudinal coupling. (a) PDF at different times. (b, c) First three central moments of the dissipated heat as a function of the detuning Δ (b) and the drive phase φ (c). The initial state is in (a, b) and in (c). A high temperature is considered in (c). All other parameters are as in figure 1.
Download figure:
Standard image High-resolution image5. Conclusions
We have developed a general formalism to study the distribution of heat exchanges between a periodically driven quantum system and a heat bath. Our approach, based on a combination of Floquet theory and a generalized quantum master equation, fully takes into account the effects of the drive. Its power is epitomized by the possibility of obtaining the full heat-exchange distribution, as in equations (12) and (13).
Some of the assumptions made in this work could be further relaxed. The full secular approximation may be replaced by a partial secular approximation, which gives more accurate results in the vicinity of quasi-energy crossings [31, 52]. Several techniques developed in the context of full-counting statistics may be readily adapted to the current setting, including weak-coupling Markovian approaches [61, 62], non-Markovian perturbative expansion [63], recursive schemes [64, 65] and waiting-time analysis [66–68]. These techniques, originally developed for undriven systems, can find application here as the Floquet picture turns a time-dependent problem into a time-independent one.
Our predictions could be tested in a variety of physical systems; for example, superconducting quantum bits embedded in a resistive environment [25, 26] and/or integrated in a circuit-quantum-electrodynamics architecture [69, 70]. Their experimental confirmation would improve our current understanding of the thermodynamics of driven quantum systems and may as well open new avenues for the realization of thermal machines based on quantum mechanics.
Acknowledgements
We would like to thank J. Pekola and R. Fazio for a careful reading of the manuscript. This work has received funding from the European Union FP7/2007–2013 under REA grant agreement no 630925—COHEAT, from MIUR-FIRB2012—Project HybridNanoDev (Grant No. RBFR1236VV) and from MIUR-FIRB2013—Project Coca (Grant No. RBFR1379UX). S.G. acknowledges financial support from the Finnish National Graduate School in Nanoscience (NGS-NANO) and the Network in Condensed Matter and Materials Physics (CMMP).
Appendix A.: Derivation of the generalized quantum master equation
Starting from the definition of discussed in the main text, we can write a generalized quantum master equation (GQME) for the system generalized density matrix , in analogy with the usual quantum master equation [32]. The latter is recovered in the limit .
We start from the equation of motion for the total generalized density operator in (6)
where . We work in the interaction picture defined by , so that a generic operator O is transformed as , where is the evolution operator generated by H(t). After a simplification, we get
We then perform a series expansion up to the second order in the system-environment coupling and invoke the Born approximation, which implies that [32]. We introduce a generalized correlation function
Its explicit evaluation gives
where en are the eigenenergies of the bath and the corresponding occupation probabilities. From (A.4) we see that
implying that the generalized correlation function is a time-shifted ordinary correlation function. For a bosonic bath, the correlation function takes the form
where is the spectral density associated to the coupling operator B and the Bose distribution function. Performing the Born–Markov approximation and extending the integration times to infinity, we obtain
Sometimes it is convenient to go back to the Schrödinger picture. In this case we have:
where stands for .
Appendix B.: GQME for a periodic drive
We consider the case of a periodic drive, so that with . The dynamics of the driven system are captured by considering the Floquet states and their corresponding quasi-energies . We also introduce the Floquet modes , satisfying and are related to the Floquet states by .
The evolution operator of the system in the Floquet basis reads . We work in the interaction picture defined by . Then,
with
Notice the property .
By substituting (B.2) into (A.7), and denoting with , we get
Equation (B.4) can be rewritten as:
where we have introduced the integrals of the correlation function
The integrals (B.6) can be explicitly evaluated:
Using the identity and neglecting principal-value integrals, we obtain
where
and is the Heaviside step function.
Our results so far apply to any periodically driven system. In the following, we will take the fast-drive limit.
Appendix. GQME in the full secular approximation
We assume Ω to be faster than the decoherence rates that appear in the GQME. This allows us to neglect fast-oscillating terms of the form , . A further class of terms, oscillating as , , can be safely neglected in most [31, 51], but not all [52], instances. Altogether, these two approximations amount to a full secular approximation, which results in a decoupling of the equations for the diagonal and off-diagonal elements in (B.5). We note in passing that in this approximation, the principal-value integrals that we neglected in deriving (B.8) would not contribute to .
In order to determine it is enough to solve (B.5) for the diagonal elements . We define
At this point, we focus on a two-level system, which simplifies the analytical treatment. The GQME (B.5) can be written as:
We can also write (B.11) in matrix form by introducing a vector and a matrix so that
In the limit , one recovers the standard master equation
whose stationary solutions or dynamical steady state (DSS) are the well-known [31]
Notice that for a two-level system any noise operator S is traceless, so that . As a result, the coefficients appearing in (B.10) and (B.11) satisfy the relation , which in turn implies and .
Appendix C.: Average heat power
Let us calculate the time variation of the average heat, which we refer to as the mean heat power. It is given by
From the definition of the CF we have that . The evolution of the generating function is given by . Using (B.11) we obtain
This equation directly relates the dissipated heat power to the dynamics of the system. Given a solution ρ of the standard master equation, which is in general easier to obtain than the one for the GQME, we can immediately predict the dissipated power using (C.2). The most interesting application is in determining if and how much heat is dissipated when the system reaches the DDS (B.14). As discussed in the main text and in the following examples, this allows us to classify the driven systems in dissipative or nondissipative at steady state.
Appendix D.: General results in the long-time limit
We define
The eigenvalues of are
with
The corresponding eigenvectors are
Notice that in this representation the trace of a density operator is obtained by summing the two vector components. In the above equation, we have chosen the normalization constant for so that .
The initial density matrix can be characterized by the quantity . We can write it as
with
Putting things together, we finally write the CF as
Equation (D.9) is the exact solution of the GQME (B.11). It can be used to calculate all the moments and cumulants of the PDF. In general, in order to obtain the full PDF, we must numerically invert the Fourier transform in (3). In the following, however, we show that some analytical insight can be gained in the long-time limit.
Appendix. Analytical expressions for the first moments
The moments can be calculated directly from (D.9). From a physical point of view, the central moments , with , are the most meaningful quantities. For , these coincide with the cumulants [55]. In the long-time limit, the cumulants can be calculated directly from the dominant eigenvalues , as
This is possible because at , and . As a result, all the terms involving derivatives of ξ− undergo exponential decay.
A PDF is often characterized by considering its first three central moments, namely, the mean value , the variance , and the skewness . In the long time limit, all these quantities increase linearly in time and are proportional to the derivatives of the dominant eigenvalue ξ+ at :
Appendix. Eigenvalue analysis
Using (B.10) and (D.1), can be rewritten as (for )
so that . Likewise,
so that also .
Altogether, this implies that and . This implies that , and
Notice that are periodic with period τ, i.e. and that for the subdominant eigenvalues and the maximum is reached for . This means that the terms associated to the eigenvalue ξ− vanish exponentially as soon as and the behavior of is determined only by ξ+. Furthermore, due to the fact that for , is different for zero only in a neighborhood of the resonances and vanishes exponentially away from them.
D.1. Solution in the long-time limit
In the long-time limit, vanishes everywhere except in a neighborhood of . We recall that ξ+ is periodic in τ. In a neighborhood of νn, we perform a second-order (Gaussian) approximation and write
where and with and . Then we approximate the CF as
where . Explicitly:
using (B.10) and (D.1), we can write
The Fourier transform in (3) can be inverted analytically starting from (D.18). The result is
where we have introduced the weight function
Making use of (D.19) and (D.20), we obtain
where
Now we recall the identity (Dirac comb)
with . Substituting (D.25) into (D.23), we finally get
The analytical result (D.26) stems from the Gaussian expansion (D.17) and is valid in the long-time limit. This limit is defined by the condition , for which the CF is localized at the nodes . This is also the limit where many photons have been exchanged, as the standard deviation of the Gaussian function is much larger than the photon energy Ω. In this limit, the delta functions in (D.26) tend to a continuum and, as a result, we can write . The coefficient a and b are then directly linked to the average exchanged heat and variance , as expected from the analysis of the central moments.
Appendix E.: Two-level system with a monochromatic drive
Let us consider a two-level system driven by a transverse monochromatic drive. This is also referred to as the Rabi model, described by the Hamiltonian
where σi are the usual Pauli operators, defined with respect to the fixed basis . The Floquet modes read
and the corresponding quasi-energies are
where we have introduced the quantities , and .
In order to write the GQME (B.11), we need to calculate the matrix elements of the noise operator S in (B.2). We consider an Ohmic spectral density (we assume that Ω is much smaller than the cutoff frequency of the environment). Notice from (B.9) that for we have .
E.1. Transverse coupling ()
For only the terms with in (B.2) contribute and we have
From these expressions, the calculation follows the one leading to (D.26) with the definitions B.10.
E.2. Longitudinal coupling ()
For , only the terms with k = 0 contribute and we have
In the case, the GQME reads
The GQME (E.6) can be solved analytically. By using the notation and , the CF reads
From this CF, we see that the moments have a particular symmetry. As , the kth moment reads
where
The PDF is immediately obtained from the inverse Fourier transform of the CF. It reads
where is the probability for the environment to absorb a photon (the system emits it), to emit a photon (the system absorbs it), and corresponds to no emissions or absorptions.
Appendix. Dependence on the initial state
The moments in (E.8) depend on the initial state. If the system is initially thermalized in the Floquet basis, i.e. , by using the relation , we verify that
That means that and, in general, . From this result [or directly from (E.8)], it is immediate to see that the average heat power at DSS, as discussed in the main text.
If the system is initially in the state , the corresponding populations in the Floquet basis are
and . For a resonant drive, i.e. , and , we have . In the long time limit, we have
In the low temperature regime, i.e., , we have , which vanishes for . In the high temperature regime, i.e., , we have . which has no definite sign and attains its minimum at . A negative implies a net heat flow from the environment into the system.
Appendix F.: GQME in the time-independent case
For completeness, we also present a derivation of the GQME for an undriven two-level system, starting from (A.8). We take , , and . This gives . Substituting in (A.8), we obtain
using (B.8), we obtain
We define the rates and . Then
The time-independent differential equations for the relevant matrix elements read
The equations (F.4) have the same structure as the (E.6). We thus obtain the same CF and PDF, with the substitutions , and .