In Holden Karnofsky's just-published Cold Takes blog post This Can't Go On, he cites how at 2% annual economic growth the economy would grow by a factor of 3*10^70 in just 8,200 years. Since there are likely fewer than that many atoms in our galaxy, this would mean that "we'd need to be sustaining multiple economies as big as today's entire world economy per atom." Holden says:
Is it imaginable that we could develop the technology to support multiple equivalents of today's entire civilization, per atom available? Sure - but this would require a radical degree of transformation of our lives and societies, far beyond how much change we've seen over the course of human history to date. And I wouldn't exactly bet that this is how things are going to go over the next several thousand years.
It seems much more likely that we will "run out" of new scientific insights, technological innovations, and resources, and the regime of "getting richer by a few percent a year" will come to an end. After all, this regime is only a couple hundred years old.
(Edited 8/3 to include the written post quote now that it's published, rather than my transcription of the audio)
It is clear that energy consumption cannot continue to grow exponentially for much more than 1000 years. But it might be argued that we can continue to extract ever more economic value from less and less energy, especially with VR. This is discussed in the debate between Robin Hanson and Bryan Caplan, and Toby Ord in the comments.
See the comment here by Max Daniel:
"there are limits in how much value (whether in an economic or moral sense) we can produce per unit of available energy, and (ii) we will eventually only be able to expand the total amount of available energy subexponentially (there can only be so much stuff in a given volume of space, and the amount of available space is proportional to the speed of light cubed - polynomial rather than exponential growth).
...
And: