What can an agent read on the web?

Agent Web Directory ยท September 1, 2026

A directory of MCP servers, agent skills, protocols and the sites whose robots.txt lets agents in. Each entry is a page.

The Agent Web Directory page in a browser window, with a search field and seven categories of linked entries from MCP Servers to Registries and Indexes, above a line of newly indexed pages.

The full paper publishes here.