Microsoft and Cloudflare partner to transform websites for AI agents
Microsoft and Cloudflare collaborate to make websites more accessible for AI agents and conversational search, challenging traditional keyword-based queries.
(Image credit: Shutterstock)
Key Highlights:
- Microsoft and Cloudflare aim to replace traditional keyword searches with conversational AI interfaces.
- Cloudflare’s AutoRAG automatically indexes website content, ensuring real-time updates.
- NLWeb introduces structured endpoints for AI agents to access reliable data.
From Search Engines to Answer Engines
Microsoft and Cloudflare have unveiled a partnership to transform websites into AI-friendly platforms. The collaboration merges Microsoft’s NLWeb standard with Cloudflare’s AutoRAG, enabling natural language interactions instead of keyword-based searches. This shift mirrors the expectations set by tools like ChatGPT, Copilot, and Claude, which provide direct answers rather than lists of links.
R.V. Guha, creator of NLWeb and Technical Fellow at Microsoft, stated:
"Together, NLWeb and AutoRAG let publishers go beyond search boxes, making conversational interfaces for websites simple to create and deploy. This integration will enable every website to easily become AI-ready for both people and trusted agents."
Traditional search engines rely on users sifting through multiple links, but the new framework promises structured responses to queries, reducing inefficiencies for both humans and AI agents.
Challenges and Concerns
While the partnership offers a compelling vision, questions remain about adoption and control:
- Will website operators benefit, or face additional technical burdens?
- Cloudflare’s AutoRAG handles indexing and data management, but this raises concerns about cost, dependency, and control over website data.
Competing with Google
This initiative positions Microsoft and Cloudflare as direct competitors to Google by redefining how AI models access website data. If AI tools shift from scraping to structured access, search traffic patterns could change dramatically.
How It Works
To enable conversational search, website owners can:
- Log into the Cloudflare Dashboard.
- Create an AutoRAG instance using the NLWeb Website quick deploy option.
- Select the domain and start indexing.
- Preview or embed the conversational interface for testing.
Related Reading:
About the Author:
Efosa has over 7 years of experience writing about technology, with expertise in privacy, security, and AI policy. He holds a Master's and PhD in sciences, focusing on the intersection of tech and regulation. Contact: udinmwenefosa@gmail.com.
Related News
AWS extends Bedrock AgentCore Gateway to unify MCP servers for AI agents
AWS announces expanded Amazon Bedrock AgentCore Gateway support for MCP servers, enabling centralized management of AI agent tools across organizations.
CEOs Must Prioritize AI Investment Amid Rapid Change
Forward-thinking CEOs are focusing on AI investment, agile operations, and strategic growth to navigate disruption and lead competitively.
About the Author
Alex Thompson
AI Technology Editor
Senior technology editor specializing in AI and machine learning content creation for 8 years. Former technical editor at AI Magazine, now provides technical documentation and content strategy services for multiple AI companies. Excels at transforming complex AI technical concepts into accessible content.