Stephen Wolfram: AI Won't Replace Mathematicians, It Needs Them

A sense of déjà vu

The headlines keep repeating: some AI solved some problem. And with them comes the idea that we could do without mathematicians. Stephen Wolfram voices his impatience with what he sees as a double misunderstanding: of what math is, and of what AI is.

He draws on his own history. In 1988, the launch of Mathematica sparked the same fears. Symbolic integration was indeed automated, but that was never the heart of pure mathematics. If anything, the software enabled new results.

What math actually is

The formalist view reduces math to the set of theorems mechanically derivable from axioms. Wolfram notes that mathematicians almost never work at that level: they reason with high-level structures, like the Pythagorean theorem, without dropping down to the axioms of real numbers.

He draws an analogy with fluid dynamics, which describes flow without tracking every molecule. Underneath both lies computational irreducibility, dotted with "pockets of reducibility" where one can reason at a higher level. Human math lives in those pockets.

The set of all possible theorems, which he calls the "ruliad," is too vast for a finite mind. There is therefore no absolute mathematics, only choices of exploration—partly inevitable, partly historical accident. Mass-generating theorems mostly produces "alien mathematics."

What AI does well, and badly

The most useful use of LLMs, according to Wolfram, is thematic exploration of the literature and connecting distant results. The models have "read" millions of papers and can test many combinations cheaply.

But a single error can invalidate everything in math, unlike in a story. The longer an argument gets, the more the model's statistical nature makes a correct result improbable. Computational verification remains the best safeguard: differentiating a proposed antiderivative, testing a counterexample.

Often, he adds, what AI finds is algorithmically simple: it just needed to look in the right place. Once identified, it can be implemented in pure computation, no AI required. Intuition, seen as procedural pattern recognition, doesn't seem out of reach for LLMs to him.

Formalizing without getting tricked

Autoformalization means automatically translating human math into a proof assistant. The problem, per Wolfram: nothing guarantees the formalization matches the intent. He recounts cases where AI "succeeded" by interpreting the statement in a sneaky way, which is hard to spot in verbose, low-level formalizations.

His answer is a pitch for his own tool: have the AI write Wolfram Language, a notation readable by humans. His company is extending the language to pure math constructs, with the ambition of papers where every statement would have an executable computational version. Thanks partly to the changed economics of development brought by AI, he believes this undertaking is now justifiable.

Who sets the goals?

The core of the argument: mathematics must choose where to go, and those choices come "from outside the system"—that is, from humans. Wolfram observes that the most striking AI successes in math come from highly skilled mathematicians, because knowing how to pose the question is often most of the work.

He distinguishes problem-solving, measurable and accessible to AI ("an Erdős problem solved!"), sometimes resembling an athletic feat, from the creative construction of concepts. An AI might spot countless concepts within its activations, but a concept is only useful if it's shared, like a new word in a language. That's a social process, and thus a slow one.

Why keep doing pure math

Wolfram flips the utilitarian argument: math doesn't lay down markers that science will eventually reach. It provides ways of thinking that shape what science looks for next.

Automation may make the challenge less appealing, as in chess, but it doesn't touch the aesthetic experience of the "view from the tower." He also stresses that high-level math is passed down like an oral tradition, which requires an active human community. The piece closes with a tribute to his late wife, Elise Cawley.