HN.zip

Should governments slow frontier AI? Jacob Coxon and Robin Hanson debate [video]

24 points by - 18 comments
[3 hidden]5 mins ago
There is no need to slow them down: Just hold everyone accountable for their actions and their claims. Do not compare "agents" to "humans". Hold them responsible for any damages they incur.
[3 hidden]5 mins ago
Also recommend this recent long form interview with Coxon : https://www.youtube.com/watch?v=JDPbo7WOU4M
[3 hidden]5 mins ago
Mythos class models require approx 1 TWh of electricity to be created. The next generation after Mythos will likely require multiple TWh. Finding, monitoring and regulating anybody capable of doing that in less than a few years should be relatively straightforward. There's unlikely to be any entity outside of the US & China with the capability.

Stopping this is very feasible.

[3 hidden]5 mins ago

  https://en.wikipedia.org/wiki/List_of_countries_by_electricity_production
[3 hidden]5 mins ago
Not in the USA. Programming is protected free speech.
[3 hidden]5 mins ago
Its fine to debate, but neither Trump nor Xi is going to slow anything down anytime soon.
[3 hidden]5 mins ago
Could they if they wanted to?
[3 hidden]5 mins ago
No, the stakes are too high for falling behind
[3 hidden]5 mins ago
Enough people in enough governments and related factions believe that whoever gets to superhuman AI first Wins Everything Forever, quite literally, so there will be no pause, there will be no moratorium, there will be no slowdown. If the AI bubble bursts I am abundantly confident all governments involved will spray as much money as is necessary at the AI research labs to keep them going.

Whether or not governments "should" slow down development, it is not on the table and the only question is how we should deal with it.

Note whether the people in the governments are right about that is irrelevant to the point I am making. I don't think they are right myself, but that doesn't matter.

[3 hidden]5 mins ago
> whoever gets to superhuman AI first wins

Is that possible when we live in a world of espionage? The question is not the West vs China, I think it's when will the public gain access to the underlying technology.

[3 hidden]5 mins ago
There is a lot they could do around pacing bringing more hardware online.
[3 hidden]5 mins ago
It would take a global agreement.
[3 hidden]5 mins ago
Why do people use this as a gotcha? There are many agreements already in place and there are sever consequences for violating them like Nuclear Non Proliferation. Or the Montreal Protocol which enacted a global ban on CFCs.
[3 hidden]5 mins ago
So get to it!? We have international agreements for many things.
[3 hidden]5 mins ago
For now they can. Another year or two of AI capabilities improvement via RSI and a frontier LLM may be more powerful.
[3 hidden]5 mins ago
Up until the point where the AI connects itself to global communication networks and announces "This is the voice of world control", yes.

In the USA it gets difficult to legally justify because programming is protected speech, and lists of numbers (model weights) are even less controversially protected than program source because the latter can be legally recognized as a technical means and regulated (DMCA, ITAR regulations, etc.).

[3 hidden]5 mins ago
Gee I wonder what Robin Hanson will say. Wait nvm it's always a flavor of "we should jettison all humans above the age of 65 into the Sun so that the SP500 goes up".
[3 hidden]5 mins ago
Please don’t post snark like this on HN. We’re at least trying for curious conversation here, not cynical, cantankerous, shallow dismissals. You may not owe libertarian economists better, but you owe HN readers better if you want to participate here.

https://news.ycombinator.com/newsguidelines.html