Cloudflare announced Markdown for Agents on February 12th, and it’s one of those features that makes you stop and think about how fundamentally the web is changing. The idea is simple: when an AI agent requests your content, Cloudflare converts the HTML to clean Markdown at the edge before serving it. The result is an 80% reduction in token consumption, which means AI tools spend less processing junk HTML and more time actually understanding what you wrote. The problem is, it’s only available on Pro plans and above. If you’re running a blog on the free tier like I am, you’re out of luck.

But the underlying idea is too important to ignore, so I went looking for an open source alternative and found one.

I think a lot of content creators haven’t really internalized what it means that AI agents are now a significant audience for their work. When someone asks Claude or ChatGPT a question about containers, or RHEL, or MCP servers, and the model pulls from your blog post to construct an answer, that’s distribution. That’s your ideas reaching people who might never have found your site through a Google search. The old model was that you wrote content for humans and hoped the search engines would index it. The new model is that you’re writing for humans and agents, and the agents are becoming the primary discovery mechanism for a growing number of people.

If your site is serving raw HTML to these agents, you’re making their job harder. They’re burning tokens parsing your navigation bars, your sidebar widgets, your footer links, all the structural noise that has nothing to do with your actual content. That’s not just wasteful, it degrades the quality of the output. Cleaner input means better summaries, more accurate citations, and more faithful representation of what you actually said.

I installed md4AI, a free GPL-licensed WordPress plugin, on both crunchtools.com and educatedconfusion.com. It detects requests from known AI user agents like ClaudeBot and GPTBot, and serves them a clean Markdown version of the content instead of the full HTML page. It also supports llms.txt, which is basically robots.txt for large language models. You can tell AI agents who you are, what your site is about, and what kind of content they’ll find here.

The whole thing took about twenty minutes. Install the plugin, activate it, configure your llms.txt, and you’re done. You can test it yourself:

curl -H "User-Agent: ClaudeBot/1.0" https://crunchtools.com/

You’ll get clean Markdown instead of HTML. And if you hit https://crunchtools.com/llms.txt, you’ll get a structured description of the site that any AI agent can use to understand the context of what it’s reading.

If you’re a content creator and you’re not thinking about how AI agents consume your work, you’re leaving distribution on the table. Cloudflare is building this into their paid infrastructure because they know it matters. But you don’t need to wait for a paid feature to make your content AI-friendly. The open source tools are already here.