Jump to content
ClubAdventist

Recommended Posts

  • Members
Posted

phkrause

When the righteous are in authority, the people rejoice; But when a wicked man rules, the people groan. Proverbs 29;2
  • Members
Posted
AI's great divergence
 
Illustration of a giant robot that continues off screen with people arguing and discussing research around its feet.
 

Illustration: Aïda Amer/Axios. Stock: Getty Images

 

Anthropic will make its Wall Street debut today at a moment of profound contradiction in the history of AI, Axios' Zachary Basu writes.

  • The humans are embattled — bogged down by scandal, financial turmoil and political revolt.
  • But the machines are ascendant — accelerating toward an "intelligence explosion" they expect will transform civilization.

Why it matters: The industry's recent chaos has obscured a breathtaking surge in technological progress, forcing some of the world's leading researchers to reconsider just how soon AI could surpass human intelligence.

🔬 Zoom in: Inside Anthropic, soon to be valued north of $1 trillion, independent researchers at METR found that AI models are advancing at twice their historical pace — largely fueled, they believe, by AI itself.

  • Anthropic's own data shows Claude went from leading fewer than 1% of the company's AI research tasks in February to more than a quarter by August, with humans still supervising.

Zoom out: Anthropic CEO Dario Amodei talks about "the exponential": "an exponential increase in general cognitive capabilities with increasing computing power."

  • OpenAI disclosed Tuesday that Astra 6.2 is its first publicly released model to reach the "High" threshold for AI self-improvement — equivalent, the company says, to giving every researcher another highly capable engineer.
A bar chart showing the largest U.S. IPOs by deal size, adjusted for inflation. The largest so far is SpaceX, at $87.5b. Anthropic could become the largest, with a possible range of $81.3b to $93.5b depending on whether underwriters buy additional shares. Visa is in third place at $31.1b.
Data: S&P Capital IQ. Chart: Erin Davis/Axios

🖼️ The big picture: These breakthroughs are pushing some of AI's top forecasters to shorten their timelines for the fabled "intelligence explosion" — a runaway cascade of self-improving AI that could propel machine intelligence far beyond human comprehension.

  • The influential AI Futures Project said this month that it now expects machines to surpass the world's best human AI researchers next year.
  • Paul Christiano, an AI safety pioneer who recently joined OpenAI's board, puts the odds of superintelligence emerging within a year at one in three if development continues at its current pace.

Between the lines: For all their extraordinary capabilities, the machines remain at the mercy of a fallible human race.

  • Take Nvidia: Jensen Huang's sex scandal has plunged the chipmaker into crisis at the very height of its technological and financial power, endangering virtually the entire AI ecosystem.
  • AI leaders' disastrous messaging, veering between promises of utopia and warnings of mass unemployment, has poisoned public trust and helped fuel a revolt against data centers.

phkrause

When the righteous are in authority, the people rejoice; But when a wicked man rules, the people groan. Proverbs 29;2
  • Members
Posted
AI 2027: The reckoning
 
Animated illustration of the year 2027, rendered in large, 3D, black and white numbers. The numbers are repeatedly distorted in a digital glitch pattern.
 

Illustration: Brendan Lynch/Axios

 

We've talked to more than 50 leaders in government, AI, business and cyber — from let-'er-rip AI accelerationists to shut-'er-down critics — and they were unanimous on one chilling assessment, Jim VandeHei and Mike Allen write in a "Behind the Curtain" column:

  • Cyberattacks on businesses and critical infrastructure will be constant, increasingly sophisticated and highly disruptive over the next 18 months.
  • These leaders describe 2027 as the year cyber becomes like weather: Outages will be frequent, disruptive, occasionally scary, and something people and companies must learn to navigate and live with daily. The chances of widespread disruption or real damage are rising fast.

Why it matters: We write this neither to forecast nor frighten. Rather, we're sharing what government and AI leaders say privately but won't say publicly.

🌩️ The big picture: The disruptions of the past two weeks — from a global Microsoft outage to the FAA grounding air travel to a consumer banking glitch at Chase — were a mild preview of what experts expect is coming.

  • Bridgewater Associates, the world's largest hedge fund, put it bluntly in an assessment this month: "[We] are managing money based on a one-in-three chance of an economically destabilizing attack within the next year."

Horacio Rozanski, chairman and CEO of Booz Allen, calls this the "fog before the war" — a foretaste of greater chaos to come, when agentic invaders reach their full potential and can attack "at the speed of thought."

  • "Now is the time to take as many precautions as you can," Rozanski said. "Recognize that this is coming."

🔒 Most of these malfunctions appear to have resulted from companies and government trying to secure their computer and infrastructure systems against future large-scale cyberattacks. This pattern will persist.

  • Many future ones will be actual cyberattacks, carried out by U.S. rivals or smaller bad actors, using increasingly powerful AI to spot and exploit security vulnerabilities across society and our daily lives. Most top AI and government leaders expect at least small-scale strikes and fear much larger ones.

The best-case scenario described to us: regular, random outages and small-scale scares like losing bank access or air travel for a day.

  • The reason: Every government agency and company will mobilize to upgrade their software systems. So errors are inevitable.
  • These are assumptions based on private intelligence and understanding of AI's capabilities, both to cause and fix glitches.

😨 What worries top officials most: With thin AI expertise, an understaffed government and major companies are trying to keep pace with a technology that improves daily.

  • Even if government were loaded with competent experts, which it decidedly isn't, the sheer scale of vulnerabilities across federal, state and local government, not to mention all of business, would be impossible to reliably secure.

Think of it as whack-a-mole with infinite moles.

  • Until this past month, the White House and Congress have focused largely on safety regulations and data centers, not imminent cyber risks. Now, even the White House's Super Intelligence Force (SIF) is scrambling to get its head around the rising risks while appraising near-daily reports of possible breaches.
  • And President Trump just ousted the White House national cyber director and named Kirsten Davies, who was the Pentagon's chief information officer, as the replacement. Davies has deeper subject-matter expertise than her predecessor, former RNC official Sean Cairncross.

Column continues below.

phkrause

When the righteous are in authority, the people rejoice; But when a wicked man rules, the people groan. Proverbs 29;2
  • Members
Posted
Part 2: Understanding the threat
 
Animated illustration of three sparkle shapes flying at, hitting, and getting stuck in a concrete wall.
 

Illustration: Brendan Lynch/Axios. Stock: Getty Images

 

Only by understanding the state of AI + cyber can government and business mobilize to prevent possible shutdowns across critical banking, electricity and water systems. This is our crack at distilling our conversations in a digestible way for Axios readers, Jim and Mike write:

  • 🗡️ The double-edged sword. The good news: America's frontier AI labs (Anthropic, OpenAI, Google, etc.) built the most powerful AI on the planet, especially for building software. The bad news: AI that's great at building software is equally great at finding — and exploiting — its vulnerabilities, often called "bugs" or "holes."
  • 💥 The new dangers of old technologies. Government and business operate mostly on computer systems that were built for a pre-AI world. They're full of those bugs and holes. One vulnerability — exploited by a bad actor, or even triggered by someone trying a repair in good faith — can shut down an entire company or all air travel, as we just witnessed.
  • 🇨🇳 China foresaw this moment. A Beijing-sponsored hacking group, Volt Typhoon, has lurked in American critical infrastructure — water, energy, transportation and communications networks — for more than five years. A sister group, Salt Typhoon, broke into major U.S. phone carriers and took call records and wiretap data. The full number of compromised systems is unknown. The administration's view is that China isn't slowing down and the U.S. can't cede any advantage.
  • ⏳ America is scrambling — and struggling — to catch up. Remember when Anthropic held back its Mythos AI model because of its breathtaking and scary cyber capabilities? Since then, some global companies, including JPMorgan Chase, have used Mythos and other technologies to locate and repair their vulnerabilities. Our intelligence agencies did the same. But most of government and American business haven't.
  • 💰 Cyber defense is costly. Lots of government agencies and businesses simply can't afford to safeguard their systems. The biggest companies can outbid others for top-tier cyber protection. The best firms are largely booked. Bluntly, many businesses hesitate to spend millions on pure loss unless they're convinced a threat is imminent.
  • 🤖 The coming swarm. AI is getting better and better. And the ability for swarms of agents to act autonomously rises each week. Case in point: The FBI warned Nov. 13 about ARTEX — free, open-source software that lets hackers turn AI agents loose to run multiple phases of an attack at machine speed. The Texas energy regulator sounded alarms to the state's oil, gas and utility networks that they're a target. The EU warned governments about ARTEX after a 10-day cyberattack last month.
  • 🏛️ Government is divided and distracted. This is an all-hands-on-deck moment for society, and most of government is busy pointing fingers or looking elsewhere. Trump shows little AI expertise. Few people at the White House have a sophisticated understanding of the technology or are working to marshal government to prevent a hypothetical attack. Congress is no better. A random person at the bar understands this topic with the same depth as many lawmakers.
  • 👀 Wait and see. Oddly, although many officials with cyber smarts across different sectors or layers of government fear the same thing, they rarely talk to people about it outside their own domain and party. There's no real mechanism or institution to pull them together. Most just assume no serious preventive action will happen until a true mini-catastrophe hits. Yet they all assume that a mini-catastrophe is coming.

The reasons not to freak out: Everyone we talked to expects attacks. Few predict true catastrophe. There's a big gap between a bank going out for a day and a region going dark for a week.

  • A truly society-shaking attack, one that breaks pipelines or blacks out a region, still probably requires a nation-state. The actors who can do it, mainly China, pay the highest price if they do: An attack on the U.S. grid is an act of war, inviting a response against the assailant's systems.
  • America's fragmentation most likely isolates major incidents. Thousands of utilities, and no single switch for the grid, mean even a successful hit tends to stay regional.

💡 So what could be done? The solution sits with the very first point of our distillation: We have the tech to both cause and fix this cyber threat. The government, through leverage or mandate, could pull the AI companies together and force them to help fortify vulnerable American systems before focusing fully on simply building more powerful models.

  • Top execs at the leading AI companies tell us they'd gladly comply if their rivals did. In fact, these leaders feel a sense of post-election urgency to act before a public event makes citizens hate AI even more than they already do.

Jay Clayton, chair of the White House task force, is finishing a voluntary safety regime for the big AI companies and is probably best positioned to pull AI CEOs together. He's well-versed in cyber and sees AI largely through a national security lens.

  • Other solutions will come from the private sector. JPMorgan Chase chairman and CEO Jamie Dimon is chairing an Alliance for Critical Infrastructure (ACI), a group of finance, energy, tech, telecom and airline giants aiming to "strengthen national resilience, reduce systemic risk, and sustain the continuity of the economy."

The bottom line: When we press all these leaders across government, business and AI, they agree that the chances of working together to prevent an attack are lower than the chances of an actual attack.

phkrause

When the righteous are in authority, the people rejoice; But when a wicked man rules, the people groan. Proverbs 29;2

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...