I confess that Fermat’s Theorem as an isolated proposition has very little interest for me, for a multitude of such theorems can easily be set up, which one could neither prove nor disprove. But I have been stimulated by it to bring our again several old ideas for a great extension of the theory of numbers. Of course, this theory belongs to the things where one cannot predict to what extent one will succeed in reaching obscurely hovering distant goals. A happy star must also rule, and my situation and so manifold distracting affairs of course do not permit me to pursue such meditations as in the happy years 1796-1798 when I created the principal topics of my Disquisitiones arithmeticae. But I am convinced that if good fortune should do more than I expect, and make me successful in some advances in that theory, even the Fermat theorem will appear in it only as one of the least interesting corollaries.
In reply to Olbers' attempt in 1816 to entice him to work on Fermat's Theorem. The hope Gauss expressed for his success was never realised.

It is always noteworthy that all those who seriously study this science [the theory of numbers] conceive a sort of passion for it.

Mathematics is the queen of the sciences and arithmetic [number theory] is the queen of mathematics. She often condescends to render service to astronomy and other natural sciences, but in all relations, she is entitled to first rank.

That this subject [of imaginary magnitudes] has hitherto been considered from the wrong point of view and surrounded by a mysterious obscurity, is to be attributed largely to an ill-adapted notation. If, for example, +1, -1, and the square root of -1 had been called direct, inverse and lateral units, instead of positive, negative and imaginary (or even impossible), such an obscurity would have been out of the question.

The problem of distinguishing prime numbers from composite numbers and of resolving the latter into their prime factors is known to be one of the most important and useful in arithmetic. It has engaged the industry and wisdom of ancient and modern geometers to such an extent that it would be superfluous to discuss the problem at length... Further, the dignity of the science itself seems to require that every possible means be explored for the solution of a problem so elegant and so celebrated.

To what heights would science now be raised if Archimedes had made that discovery [of decimal number notation]!

We must admit with humility that, while number is purely a product of our minds, space has a reality outside our minds, so that we cannot completely prescribe its properties a priori.