Thermodynamics is Tricky Business

Thermodynamics is one the most important tools we have for understanding the behavior of large physical systems. However, it is very important to realize when thermodynamics is applicable and when it is not applicable. For example, try to apply thermodynamics to the Intel processor inside the laptop I am writing this entry on. Certainly the silicon crystal is in thermal equilbrium, but then how am I able to make this system compute: if states are occupied with probabilities proportional to a Boltzman factor, then how can my computer operate with all sorts of internal states corresponding to, say, it’s memory? Let’s say that all of these internal states, states of my computing machine, are all energetically about the same energy (which is, to a decent approximation, true.) Then, according to thermodynamics, each of these states should be occupied with the same probability. But the last time I checked, the sentence I am typing is not white noise (some of you may object, 😉 )
Today, Robert Alicki, Daniel Lidar, and Paolo Zanardi have posted a paper in which they question the threshold theorem for fault-tolerant quantum computation and claim that the normal assumptions for this theorem cannot be fullfilled by physical systems. I have a lot of objections to the objections in this paper, but let me focus on one line of dispute.
The main argument put forth in this paper is that if we want to have a quantum computer with Markovian noise as is assumed in many (but not all) of the threshold calculations, then this leads to the following contradictions. If the system has fast gates, as required by the theorem, then the bath must be hot and this contradicts the condition that we need cold ancillas. If, on the other hand, the bath is cold, then the gates can be shown to be necessarily slow in order to get a valid Markovian approximation. Both of these conditions come from standard derivations of Markovian dynamics. The authors make the bold claim:

These conclusions are unavoidable if one accepts thermodyanmics…We take here the reasonable position that fault tolerant [quantum computing] cannot be in violation of thermodynamics.

Pretty strong words, no?
Well, reading the first paragraph of this post, you must surely know what my objection to this argument is going to be. Thermodyanmics is a very touchy subject and cannot and should not be applied adhoc to physical systems.
So lets imagine running the above argument through a quantum computer operating fault-tolerantly. Let’s say we do have a hot environment. We also have our quantum system, which we want to make behave like a quantum computer. Also we have cold ancilla qubits. Now what do we do when we are performing quantum error correction? We bring the cold ancillas into contact with the quantum computer interact the two and throw away the cold ancillas. Now we can ask the question, is the combined state of the cold anicllas and the hot environment in thermal equilbrium? Well, yes, both are in thermal equibrium before we start this process, but they will be in thermal equilbrium with two different temperatures. OK, so now we have an interaction between the system and the cold ancillas. So let’s do this. Now these two systems, the quantum computer and the ancillas clearly couple to the hot bath. Therefore we can assume that the Markovian assumption holds and further that the gate speed for the combined system-ancilla system is fast. No problem there, right. OK, now we throw away the cold ancillas. So we’ve done a cycle of the quantum error correction without violating the conditions set forth by the authors. How did we do this?
We did this by being careful about what we called the “system.” (Or, more directly we have to be careful what we call the “bath.” But really these are symmetric, no?) We started out the cycle with the system being the quantum computer. Then we brought in the cold ancillas. Our system now includes both the quantum computer and the ancillas. Since we are now enacting operations on this combined system, our enviornment is the original bath, which is hot (which may now couple to the ancillas.) We can perform fast gates on this combined system and then we may discard the ancillas.
In order for the authors argument to work, they have to assume that the “system” is always just the quantum computer. But then clearly the assumption of the environment being in thermal equilibrium is violated at the beginning of the error correcting cycle: the ancillas are cold but the bath is hot. Both are independently in thermal equibrium, but the combined system is not in thermal equilbrium at the same temperature. The interactions with the hot bath do imply that we can perform fast gates. The interactions with the cold ancilla do imply that we will have slow gates. But when we bring the cold ancillas and quantum computer together, we can also have fast gates: because our system now consists of the computer plus the ancillas and the remaining environment it hot. The ancillas are not part of the thermal bath which is causes problems for our quantum computer. Certainly the authors are not objecting to the fact that we can prepare cold ancilla states? So I see no contradiction in this paper with the threshold theorem. (A further note is that there is also a threshold for fault-tolerance when the noise is non-Markovian. I’m still trying to parse what the authors have to say about these theorems. I’m not sure I understand their arguments yet.)
Thermodynamics is, basically, a method for reasoning about large collections of physical systems when certain assumptions are made about this system. Often we cannot make these assumptions. (A classical case of this, which is not relevant to our discussion, but which is interesting is the case of the thermodynamics of a system of many point particles interacting via gravity: here thermodynamics can fail spectacularly, and indeed, things like the internal energy of the system are no long extensive quantities!) In the above argument, we cannot talk about two systems being at the same temperature: we have two separate systems with different tempatures. Certainly if we bring them together and they interact, under certain conditions, the two will equilibriate. But this is explicitly what doesn’t happen in the fault-tolerant constructions. This is, indeed, exactly what we mean by cold ancillas!
Understanding the limits of the threshold for fault-tolerant quantum computation is one of the most interesting areas of quantum information science. I’ve bashed my head up against the theorem many times trying to find a hole in it. I think that this process, of attempting to poke holes in the theorem, is extremely valuable. Because even if the theorem still holds, what we learn by bashing our heads against it is well worth the effort.
Updated Update: Daniel Lidar, Robert Alicki and other have posted responses and comments below. I highly recommend that you read them if you found this entry interesting!

Anyons in Honey

Alexei Kitaev has put a massive paper on the arXiv, cond-mat/0506438 describing a very interesting model with interacting spins on a honeycomb lattice. Looks like I’ve found my bus ride reading for the next month!

Bend It Like Feynman

Next week I begin teaching. This is really the first course that I’ve fully taught-I’ve given plenty of summer school lectures, and guest lectures, and I was a teaching assistant through most of my years at Berkeley-but this is the first class that I’ve really been in total control of the class. The class is “Quantum Computing” and is in the professional masters program here in the Computer Science and Engineering department at UW. You can check out the course webpage here. But there’s not much there but a syllabus yet. The cool thing is that I get to teach this course the way I think it should be taught. On the other hand, this means that there are “no excuses”-the quality of the class rests squarely on my shoulders
Since this is the first time that I’ve actually had to lecture for an entire course (as opposed to being a TA, in which you aren’t the first person to tell the students about the material) I’ve been spending a bit of time contemplating what makes a good lecturer. One way I did this was to go back and read the “Feynman Lectures on Gravitation.” Something I’ve noticed about a large number of the good speakers and lecturers, including Feynman, is that while their actual vocabulary might be limitted, they almost universal express themselves in ways which are very unique. Reading Feynman’s lectures, there aren’t many sections which are just ordinary drolling on. Saying the ordinary in extraordinary manner appears to be vital to keeping a lecture going. And certainly this also adds to Feynman’s humor. Perhaps by expressing his thoughts in such strange manners, he is just naturally led to funny sentences such as

There are 10^11 stars in the galaxy. That used to be a huge number. But it’s only a hundred billion. It’s less than the national deficit! We used to call them astronomical numbers. Now we should call them economical numbers.

Indeed, if you read Gordon Watts blog, he put up a list one of his students had kept during his teaching of all the crazy things he said during the term. And you can tell, just by reading this list, that Gordon would make an excellent teacher. Now I just wonder if I need to tone up or tone down my crazy speak habits…

Popular Science Hits the Spot

Friday I picked up How the Universe Got Its Spots : Diary of a Finite Time in a Finite Space by the astrophysicist Janna Levin. I met Janna once. Fresh off the factory floor at Caltech, I arrived at Berkeley having convinced the graduate school admissions people there that I was going to do particle physics. I really had no such intentions. I had decided I wanted to do astrophysics. Luckily I didn’t have to take the first year grad courses (so I’ve only been through Jackson, once, thank you very much!) so I was able to immediately start taking astrophysics classes. Having taken only one astro course at Caltech, I really had a lot of learning to do! But already in my first year I was trying to find some research to do: research was the reason I went to grad school, not to take classes. One of the people I visited was Janna Levin, who at the time was a postdoc. She gave me these really cool papers on chaos in black hole solutions as well as on the main subject of this popular book, what if the large scale topology of the universe is nontrivial. So I’m sure she doesn’t remember me, but I remember those papers on topology and also a paper she wrote with J.D. Barrow on the twin paradox in compact universes. I would be neglegent if I didn’t quote the Simpsons episode where Stephen Hawking makes an appearance:

Hawking: Your theory of a donut-shaped universe is intriguing, Homer. I may have to steal it.
Homer: Wow, I can’t believe someone I never heard of is hanging out with a guy like me.
Moe: All right, it’s closing time. Who’s paying the tab?
Homer: [imitating Hawking’s voice box] I am.
Hawking: I didn’t say that.
Homer: [still imitating] Yes I did.
[a glove comes out of Hawking’s wheelechair, bopping Homer in the face]
Homer: [still imitating] D’oh.

Shortly after talking to Dr. Levin about her work, I met with Dr. Daniel Lidar in the Chemistry department who was working on quantum computing. I had done some “research” as an undergrad on quantum computing, and the newness of quantum theory really appealed to me. Astrophysics is grand and beautiful and there was so much new data coming in, but many of the great theory problems seemed so large and so well gone over that I was sucked away from astrophysics. I am still jealous of the astrophysicist when they get to contemplate the entire frickin universe. Whereas I get to contemplate things I shall never really see. Well both are pretty cool.
“How the Universe Got It’s Spots” is an interesting little book. It is written as a series of letters to the author’s mother and explains all sorts of science, from topology, to black holes, to quantum theory. I’ve become, over the years, a hell of picky person when it comes to popular science books. I will admit that there were a few times when I had to close my brain during “Spots”, but most of these have to do with describing quantum theory, and happily it wasn’t the uncertainty principle which got mangled. And I’m just too stubborn to listen to what anyone else has to say about quantum theory. So me saying there were only a few rough spots in “Spots” is like saying that it’s really really well done.
Interestingly, the book takes a very personal view of the science discussed in the book. Not personal like most popular science articles where the author descripes his or her story and relationship to all these bigwigs in the grand quest we call science, but personal instead in detailing the authors emotional relationship to her work (and in some broader context, her relationship to the world around her as well.) In this way it reminds me a bit of Good Benito by Alan Lightman. Those astrophysicists really how to hit a guys emotion nerves. Here is a nice passage from “Spots” describing mathematicians and their penchant for being insane:

When I tell the stories of their suicide and mental illness, people always wonder if their fragility came from the nature of the knowledge-the knowledge of nature. I think rather that they went mad from rejection. Their mathematical obsessions were all-encompassing and yet ethereal. They needed their colleagues beyond needing their approval. To be spurned by their peers meant death of their ideas. They needed to encrypt the meaning in others’ thoughts and be assured their ideas would be perpetuated.

Another reason that I’m hard on popular science books has to do with the amount of learned. Growing up, the best popular science books all had one common trait. You would be reading the book and thinking about the topic and you would think, “well, it seems to me that what they’ve talked about here implies X.” And then a few pages latter you would read that indeed scientists discovered that such and such does imply X! Great popular science to me has a lot to do with great foreshadowing. The problem I have now is that I know most of the story. I’ve caught up to modern times. So the foreshadowing doesn’t work for me.
On the other hand, popular science articles do have a very interesting effect when I read them today. They remind me of the big picture, and often they let my mind wander. While I was reading “Spots,” for instance, the following occurred to me. One of the reasons we love relativity, both special and general is that it arises from such simple postulates into a beautiful and complex theory. One sometimes hears that this is missing in quantum theory: where do all these postulates about Hilbert space and Born’s rule and such come from? Are there some nice basic posulates from which we can reason, much like Einstein did for special relativity, as to why quantum theory should be the way it is? But while I was reading “Spots” it occurred to me that may this was an illusion. Suppose that instead of discovering special and general relativity before quantum theory (O.K. there is some overlap, but the truely disturbing parts of quantum theory emerged after both relativity theories.) If you are a quantum person living in a quantum world, does all this talk about mirrors and clocks seems rather troubling. Mirrors are big classical thingees. What do quantum mirrors look like, and is it natural to talk the thought experiments that Einstein used? But in a larger sense, I also began to wonder if the principles of relativity are really so natural. Are they natural to someone who experiences the amplitudes of quantum theory in their everyday experience? Why is it that we spend time trying to think about how quantum theory might emerge (this is, after all, what interpretations are really after, isn’t it?), but don’t spend time thinking about a deeper theory from which, say, special relativity might emerge. This, I guess is one reason I’m interested in loop quantum gravity: there, one of the challenges is to really see how our four dimensional world emerges from the, for a better word for it, quantum foam. So why does special relativity look the way it does, quantum boy? And it’s silly questions like these which keep me reading popular science, and will continue to keep me reading popular science, long after I’ve grown accustomed to the history.

Some Spiffy Physics Dudes

Howard Barnum passes along this link to a home video of the 5th Solvay conference held in 1927. It was at this conference that Heisenberg and Born delivered a paper in which they said

We regard quantum mechanics as a complete theory for which the fundamental physical and mathematical hypotheses are no longer susceptible of modification.

17 of the 29 participants in this Solvay conference were current or future Nobel prize winners.
The home video gives evidence that physicists have alway been jovial joking hams for the camera.

The Rest of the Story

Rumors (Uncertain Principles and LuboÅ¡ Motl’s reference frame) are that the Eovtos experiment here at the University of Washington may have observed a deviation from Newton’s laws at small lengths (less than one hundred microns.) Of course this would be huge news, and their desire to take it slow is certainly understandable and, I might add, is good science.
I remember driving down the road one day and I heard the radio man Paul Harvey report that a group of physicists had discovered room temperature superconductors. I recall that I got so excited that I actually started crying. Such a discovery would presumably change the world! Alas, it turned out to not be true. Either Paul Harvey had made it up or the group’s announcement was not correct. And now you know, “the rest of the story.”

Self-Correction

Sometimes you write a paper and think it’s all ready for submission and then after you submit it to the archive you find that it is lacking for quite a few reasons. On Friday I posted the paper quant-ph/0506023 (and did the new paper dance!) But after communications from Michael Nielsen and David Poulin, I realized that I had made a mistake in one of my claims (the proof I had did not work) and that I had very much misrepresented what is new in this paper (in particular in relationship to quant-ph/0504189 and quant-ph/0412076.) Luckily the mistake in my proof was not a big deal for the paper and also luckily one can correct one’s foolishness and clarify what’s new and interesting in the paper. Here is the updated title and abstract:
Operator Quantum Error Correcting Subsystems for Self-Correcting Quantum Memories
Authors: Dave Bacon
Comments: 17 pages, 3 figures, title change, rewrite of connection to operator quantum error correction, references added

The most general method for encoding quantum information is not to encode the information into a subspace of a Hilbert space, but to encode information into a subsystem of a Hilbert space. Recently this notion has led to a more general notion of quantum error correction known as operator quantum error correction. In standard quantum error correcting codes, one requires the ability to apply a procedure which exactly reverses on the error correcting subspace any correctable error. In contrast, for operator error correcting subsystems, the correction procedure need not undo the error which has occurred, but instead one must perform correction only modulo the subsystem structure. This does not lead to codes which differ from subspace codes, but does lead to recovery routines which explicitly make use of the subsystem structure. Here we present two examples of such operator error correcting subsystems. These examples are motivated by simple spatially local Hamiltonians on square and cubic lattices. In three dimensions we provide evidence, in the form a simple mean field theory, that our Hamiltonian gives rise to a system which is self-correcting. Such a system will be a natural high-temperature quantum memory, robust to noise without external intervening quantum error correction procedures.

Self Promotion of Self-Correcting Paper

Everybody do the new paper dance, quant-ph/0506023
Quantum Error Correcting Subsystems and Self-Correcting Quantum Memories
Authors: D. Bacon
Comments: 16 pages

The most general method for encoding quantum information is not to encode the information into a subspace of a Hilbert space, but to encode information into a subsystem of a Hilbert space. In this paper we use this fact to define subsystems with quantum error correcting capabilities. In standard quantum error correcting codes, one requires the ability to apply a procedure which exactly reverses on the error correcting subspace any correctable error. In contrast, for quantum error correcting subsystems, the correction procedure need not undo the error which has occurred, but instead one must perform correction only modulo the subsystem structure. Here we present two examples of quantum error correcting subsystems. These examples are motivated by simple spatially local Hamiltonians on square and cubic lattices. In three dimensions we provide evidence, in the form a simple mean field theory, that our Hamiltonian gives rise to a system which is self-correcting. Such a system will be a natural high-temperature quantum memory, robust to noise without external intervening quantum error correction procedures.