It tickled me that this was a bullet point in the Fable 5.2 announcement. I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.
In my (limited) experience it does not struggle with empirical research — at least in the procedural aspects thereof — as long as it has access to the right data.
It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.
I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.
I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)
I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.
I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?
My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.
I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.
I agree, but it is the kind of math done the physicists' way (which I found recently asserted that AI cannot do) and not the kind which is formalizable in Lean.
From skimming the papers, it’s not clear to me what it is actually doing outside of proving what can be considered mathematical theorems (even if that’s done the physicist way). It doesn’t seem to be making testable predictions (but maybe I missed those).
For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.
I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".
I won't even talk about relying on diverging series...
If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.
We used to joke in my physics undergrad that they didn’t need a math department because we were doing all the stuff they were doing but with actual applications. Then the mechanical engineers said the same thing about us!
"Claude solves" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "it broke out of the sandbox" vs. "we failed to build an adequate sandbox".
What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.
It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.
When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.
From a cursory glance the bootstrap paper is really hard to read, however the blog post is easier and seems more human written.
The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!
> thereby making it a consistent theory of quantum gravity
Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.
"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."
For example the famous Schwarzschild solution (that predicts black holes) doesn't apply to our universe, because it assumes a black hole that's been there forever, not one that formed. But it was still very useful for our understanding.
It also assumes zero angular momentum, which we know is essentially impossible in our universe. And rotating black holes (the Kerr metric) are much stranger beasts.
Schwarzschild allows you to still calculate a whole bunch of things outside the event horizon. The part where it changes from our universe is the physics inside the black hole and their formation
Apart from Claude/Anthropic no attribution whatsoever - neither on the Hexagon entry nor in the PDF. Isn't this a novelty, even for papers that are 100% the product of AI?
That's the most unfortunate part of these recent discoveries. Even if the human "only" proofread the entire thing, that's still worthy of credit, because without their work, none of that output would be worth writing about.
Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.
We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.
Over a decade ago I saw a talk about a cohesive and complete explanation for gravity. It didn't involve quantum mechanics nor a particle called a "graviton".
That talk did make enough sense.
I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.
I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.
Nonetheless, I am remaining open minded to this black hole stuff.
Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.
Now let's wait so we find if it stole someone's work.
If the solution is correct
If it does produce a meaningful and useful result.
Lately people claim victory too early
What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers. Who can be sure one can't be scooped because the model connects the dots between your thoughts and the related unpublished thoughts of hundreds of other researchers also relying on it as trusted peer, with the model owner publishing the combined results behind the backs of everyone.
> What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers.
They do but we've seen enough solutions by now that surely one of these researchers would come forward to point it out?
The "stolen" work and strategy of the solution itself was there from 2023 and even buckmaster used ai who "stole" the idea from Córdoba–Martínez-Zoroa programme. There's no proof that the solution even used much of the solution of the buckmaster. You people blindly repeat everything like a sheep without critical thinking. AI + humans solving it within days compared to decades of humans only solving is what should be commended. Instead we got people like you who will take humanity to stone ages due to anti capitalist ideology
I hope you one day come to appreciate the value of human effort and how it has allowed these models to exist and continue to exist. And that people should be looked after by the community for which they contribute with their effort rather than dismissed and discarded. It's a quality of life thing. For everyone.
I do value humans like crazy so I'm ok with ubi or some sort. Just because some rust belt workers got shelved due to technological and economic progress, I ain't gonna stop using foreign manufactured products. I sympathize and help them to upskill but not take whole future hostage because of unemployment or creative destruction. I'll probably be next to get booted and be unemployed forever but I'll try to reskill instead of demanding the whole world to stop embracing ai enhanced progress. Even AI can't solve it alone without the years of human knowledge and human prompter enhancing its search space for better output. It's exciting what all humans can do with it. And I'm just getting it for just 20$? The deal is too insane to not be awestruck.
Ask them about capitalism and its achievements and you will get your answer. This reddit/twitter tier analysis is pretty indicative of their motives. They'll be hyper critical free market fundamentalists when talking about anthropic pushing for regulation or any corporations but bootlick the state when it strangulates housing/healthcare industries with shitty regulations where more freer market can solve such issues without too much ugly side effects.
A lot of us are willing and today have already taken the bet that a model or system that can solve hard problems across math, physics, biology is genuine intelligence. It will command a great premium or it may even figure out in the not so distant future how to make money on its own.
> a model or system [...] can solve hard problems across math, physics, biology
...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.
It tickled me that this was a bullet point in the Fable 5.2 announcement. I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Copying my comment from that discussion:
Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.
https://news.ycombinator.com/item?id=50430239
> It looks like AI is finally branching out of math.
Is it really, though? It's still a heavily mathematical domain, rather than one involving empirical research, where AI still struggles.
In my (limited) experience it does not struggle with empirical research — at least in the procedural aspects thereof — as long as it has access to the right data.
It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.
I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.
I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)
I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.
I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?
My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.
I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.
I'd argue that "the right data" should really be called "the right information in context."
Context is king.
https://xkcd.com/435/
I agree, but it is the kind of math done the physicists' way (which I found recently asserted that AI cannot do) and not the kind which is formalizable in Lean.
"It's not much, but it's honest work."
From skimming the papers, it’s not clear to me what it is actually doing outside of proving what can be considered mathematical theorems (even if that’s done the physicist way). It doesn’t seem to be making testable predictions (but maybe I missed those).
> and not the kind which is formalizable in Lean.
For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.
I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".
I won't even talk about relying on diverging series...
Can you declare theorems in Lean for those techniques. And list them in the paper.
Why would it not be formalizable in Lean? People are formalizing parts of linguistics in Lean.
Most famously: to a physicist, the sum of all natural numbers is -1/12 https://en.wikipedia.org/wiki/1_%2B_2_%2B_3_%2B_4_%2B_%E2%8B...
If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.
OK, that goes right past me. However, the reference, in the wiki article, to https://en.wikipedia.org/wiki/Monstrous_moonshine seems appropriate.
We used to joke in my physics undergrad that they didn’t need a math department because we were doing all the stuff they were doing but with actual applications. Then the mechanical engineers said the same thing about us!
One of the most efficient ways to torture a pure mathematician is to force him to watch how physicists treat math.
I have strong, complicated feelings about it, and I understand you may not feel the same way, but "I like" is not a good description in my case.
What do you not like?
"I do not like" is also not a good description.
I think this is due to the unrelatedness to our universe.
> https://news.ycombinator.com/item?id=50563604
"Claude solves" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "it broke out of the sandbox" vs. "we failed to build an adequate sandbox".
What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.
It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.
When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.
When you ask it to make a banana picture and it goes of on a tangent solving a black hole physics problem, what then.
It probably means some physicists were using it to study black holes and it stole their work.
I think AI papers should always include prompt / prompting history as an annex
Yesterday's PBS Space Time: AI Is Breaking Math. Will It Solve Physics Next? https://youtu.be/wCRzZ0ccP_0
Unexpected PBS Space Time x Anthropic collab on Fable 5.2 announcement. The conspiracy theory: PBS insider-traded $ANT.
:)
From a cursory glance the bootstrap paper is really hard to read, however the blog post is easier and seems more human written.
The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!
> thereby making it a consistent theory of quantum gravity
Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.
Agreed on the correction.
Proved it in a 2d universe.
That's how all modern quantum gravity theory progress is done. You start with the simpler universes and move up from there.
I recommend this sad story:
https://nautil.us/what-does-any-of-this-have-to-do-with-phys...
Companies working on theoretical physics problems. What a time to live in.
From the announcement --
"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."
This sounds pretty normal for theoretical physics, like when models make assumptions about symmetries or homogeneity.
For example the famous Schwarzschild solution (that predicts black holes) doesn't apply to our universe, because it assumes a black hole that's been there forever, not one that formed. But it was still very useful for our understanding.
It also assumes zero angular momentum, which we know is essentially impossible in our universe. And rotating black holes (the Kerr metric) are much stranger beasts.
Doesn't GPS model Earth's gravity using Schwarzschild?
Schwarzschild allows you to still calculate a whole bunch of things outside the event horizon. The part where it changes from our universe is the physics inside the black hole and their formation
Spherical universe as opposed to spherical cows
It's the physics equivalent of "in mice"
Ok so the ultimate test is throwing mice in a black hole I guess
Though you need to start by throwing mice from another universe into a black hole in our universe.
That's how they got here in the first place.
Apart from Claude/Anthropic no attribution whatsoever - neither on the Hexagon entry nor in the PDF. Isn't this a novelty, even for papers that are 100% the product of AI?
I credit an entity with work that is largely AI. Soon it will just be people credited, everyone will just assume AI was used.
Having a person on there would make the Machine God look bad.
That's the most unfortunate part of these recent discoveries. Even if the human "only" proofread the entire thing, that's still worthy of credit, because without their work, none of that output would be worth writing about.
Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.
We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.
Over a decade ago I saw a talk about a cohesive and complete explanation for gravity. It didn't involve quantum mechanics nor a particle called a "graviton".
That talk did make enough sense.
I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.
I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.
Nonetheless, I am remaining open minded to this black hole stuff.
Interested to know if the writing has improved as compared to discoveries made by Astra.
How does this make my life easier or better?
In other words, you don’t think theoretical physics is a worthwhile pursuit?
Like "How does contributing to humanity's shared understanding of the universe directly serve you?", is that what you are asking?
by increasing your net worth if you hold pre-IPO Anthropic shares ;)
I'm guessing they solved something using Lean? LLM only solve coding problems. They're useless for anything else.
Answering myself: yes, one of the problems was solved using Lean. The other was undisclosed. Nothing new under the sun, huh.
The biggest mystery to solve is if their IPO is in itself a black hole
It's not. Mystery over.
Given the date, more IPO-fodder or substantial?
Probably both.
[delayed]
First I've heard of Hexagon math ... backed by heavy hitters, no peer review:
Representatives of AI labs and other organizations may email admin@hexagonmath.org to arrange a verified lab account.
https://hexagonmath.org/organizations/anthropic
Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.
Wild.
https://hexagonmath.org/who
Now let's wait so we find if it stole someone's work. If the solution is correct If it does produce a meaningful and useful result. Lately people claim victory too early
What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers. Who can be sure one can't be scooped because the model connects the dots between your thoughts and the related unpublished thoughts of hundreds of other researchers also relying on it as trusted peer, with the model owner publishing the combined results behind the backs of everyone.
> What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers.
They do but we've seen enough solutions by now that surely one of these researchers would come forward to point it out?
0. Likely scrubbed many times over.
The "stolen" work and strategy of the solution itself was there from 2023 and even buckmaster used ai who "stole" the idea from Córdoba–Martínez-Zoroa programme. There's no proof that the solution even used much of the solution of the buckmaster. You people blindly repeat everything like a sheep without critical thinking. AI + humans solving it within days compared to decades of humans only solving is what should be commended. Instead we got people like you who will take humanity to stone ages due to anti capitalist ideology
I hope you one day come to appreciate the value of human effort and how it has allowed these models to exist and continue to exist. And that people should be looked after by the community for which they contribute with their effort rather than dismissed and discarded. It's a quality of life thing. For everyone.
I do value humans like crazy so I'm ok with ubi or some sort. Just because some rust belt workers got shelved due to technological and economic progress, I ain't gonna stop using foreign manufactured products. I sympathize and help them to upskill but not take whole future hostage because of unemployment or creative destruction. I'll probably be next to get booted and be unemployed forever but I'll try to reskill instead of demanding the whole world to stop embracing ai enhanced progress. Even AI can't solve it alone without the years of human knowledge and human prompter enhancing its search space for better output. It's exciting what all humans can do with it. And I'm just getting it for just 20$? The deal is too insane to not be awestruck.
He didn't say anything about capitalism, you're assuming that.
Ask them about capitalism and its achievements and you will get your answer. This reddit/twitter tier analysis is pretty indicative of their motives. They'll be hyper critical free market fundamentalists when talking about anthropic pushing for regulation or any corporations but bootlick the state when it strangulates housing/healthcare industries with shitty regulations where more freer market can solve such issues without too much ugly side effects.
> a particle can take both routes simultaneously
Stopped reading right here. It took one. Maybe you don't know which one it took but things can't be in two places at once.
I'm glad they posted this today. For a moment, I got drawn back into the pre-singularity world -- I even checked a stock ticker!
It was a comforting moment, for sure. But ephemeral, self-imposed ignorance is no bliss at all :(
Barely done the IPO, solved two Black Holes already.
Next up, the Origins of the Universe... stay tuned for our Fable e^2. More on the 10 o'clock news...
/s
Impressive. Now, can they ask Claude how to run a profitable company?
A lot of us are willing and today have already taken the bet that a model or system that can solve hard problems across math, physics, biology is genuine intelligence. It will command a great premium or it may even figure out in the not so distant future how to make money on its own.
> is genuine intelligence
OK, but it's still an unfounded claim and...
> a model or system [...] can solve hard problems across math, physics, biology
...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.
> in the not so distant future
Any minute now
The new currency is hype and cult of personality
Hype always manages to outrun results, and hype can be turned into cash.