Twitxy Saved

Jake Steckler

Verified account This account is verified. Learn more

@JakeASteckler

Research Scholar @GovAIOrg
Joined February 2026
334 Following 285 Followers 153 Posts

Latest posts 5

Pinned post

Jake Steckler Verified account @JakeASteckler
AI takeover scenarios often hinge on an idea I’m skeptical of, where rogue AI overthrows militaries and seizes hard power. I wrote a piece where I concretely break down what I think makes this improbable, and why “full-blown takeover” concerns could be counterproductive for mitigating the risks of misaligned or poorly controlled AI in the military.

For AI to seize hard power, it would need to be physically capable of defeating our military, and humans would need to be careless enough to give it the power to do so. I think that’s unlikely to occur for several reasons. Among them:

- The military is unlikely to sufficiently hand the reins over to AI. (1) Even if we wanted to, overhauling the institution in this way faces countless barriers that have plagued it for decades. (2) Doing so would be strategically suicidal.
- Integrating general-purpose AI into physical systems faces challenges that will take significant time to overcome, all while we grow increasingly attuned to the risks posed by AI.
- There’s little to suggest that more capable AI would be able to persuade or coerce people to take the costly, coordinated actions some of these scenarios predict.
- Even if AI managed to assume control over a large arsenal, we’d fight back. In which case, recent warfare shows us that crude countermeasures work against technologically advanced adversaries, and AI relies on infrastructure we can and would shut down.

1/2
11 replies 11 reposts 62 likes 9.4K views View on X
Jake Steckler Verified account @JakeASteckler
Rapid AI progress has many people imagining a world where general-purpose AI models autonomously control military drones at scale. But there’s little analysis on what this would look like in practice, and how soon it might be feasible.

My latest paper at @GovAIOrg asks what it would take to make this vision a reality, and what the path there means for AI policy.

Read it here: governance.ai/research-paper…

The AI-enabled drones widely fielded today use narrow AI, not general-purpose models like LLMs. AI is typically only used to handle limited portions of a flight when the link to a pilot is broken, and these models are brittle in unpredictable conditions on real-world battlefields. Because of this, today’s drones still require significant pilot involvement to be most effective.

General-purpose AI models might make it possible to field autonomous systems that can receive plain language commands and make complex decisions in unpredictable environments without human control. Many people see frontier LLMs as a path toward this end - and rapid progress in robotics capabilities by frontier models like GPT-6 Astra and most recently Claude Fable 5.2 supports this case.

But two things currently stand in the way:

- The biggest and most powerful models are still not capable enough even in controlled environments without compute and latency constraints
- Military drones will have to operate “on the edge” in contested environments without consistent cloud compute access - which makes these constraints even more severe

If and when general-purpose AI plays a major role in drone autonomy, it’ll likely be through models that are far smaller than today’s frontier, and those that militaries can rapidly modify. And, notably - when it comes to these types of small open-weight models, China currently dominates.

This has a variety of implications for the US military, frontier AI developers, and US policymakers.

Thread below with my key takeaways and recommendations.

1/
2 replies 15 reposts 63 likes 4.9K views View on X
Jake Steckler Verified account @JakeASteckler
Surprised by this but probably shouldn't be. Driscoll was front and center in the Army's effort to adopt drones and AI and modernize its software systems, before he quit because of his relationship with Hegseth. He's apparently boys with JD Vance so might be the odd move that gets the company closer to the admin by hiring someone who just left in anger
Andrew Curran Verified account @AndrewCurran_ Nov 2
OpenAI has appointed former U.S. Army Secretary and drone expert Dan Driscoll to the newly created OpenAI role of Senior Counselor for National Security Modernization.
View quoted post on X