mattwiebe.blog
mattwiebe.blog
@mattwiebe.blog@mattwiebe.blog

this blog is for testing fediverse integration from WordPress.com, but soon I can actually just use it!

58 posts
50 followers

Compute Sovereignty: Why I’m Building Local AI Connectors for WordPress

Anthropic have put a big question mark beside trusting frontier labs this week. First they banned OpenClaw users from running their Claude subscriptions with third-party tools. Copied the features into Claude Code, locked out the open source version, gave everyone a week’s notice. Users are looking at cost increases up to 50x. And then today they announce Mythos Preview, their most powerful model ever, and tell us it’s too dangerous to release. They’re giving it to 40 handpicked organizations through Project Glasswing. It found thousands of zero-day vulnerabilities in every major operating system and web browser, some of them decades old. So I get the concern. But the pattern here is clear. The frontier labs get to decide what you can run and how you can run it. And that should make you uncomfortable.

So. Local AI. There’s a growing movement toward compute sovereignty and I’ve been spending a lot of time in this space. One cool new player is Actual Computer, who let you create local compute clusters and potentially fully distributed ones too. They’re in private beta but I got my invite fast. You download their software, your machine joins a cluster, they expose a public API. In this video I add Actual Computer as a new connector for my WP Home Inference plugin, which lets you run local models against remote site workloads.

The plugin bridges any OpenAI-compatible API running locally. Ollama, LM Studio, whatever. Through a Tailscale funnel, WordPress just sees it as another connector. I wrote zero code for this plugin. The whole thing was built through OpenAI Codex. By the end of the session I had WordPress generating post excerpts against a DeepSeek R1 distill on my M4 Max/48GB, routed through Actual Computer. And groups like Templar AI are already training 72 billion parameter models across distributed nodes with no centralized cluster. This space is moving fast.

WordPress 7.0 is shipping with AI connector architecture and local inference is going to be a real part of that story. WP Home Inference is live now if you want to mess around with it.

Discover more from mattwiebe.blog

Subscribe now to keep reading and get access to the full archive.

Continue reading