llm browser

backend/README.md

@@ -74,6 +74,17 @@ and the API authenticates against the issuer at `OIDC_ISSUER`
 random one is generated per boot, invalidating all sessions on restart).
 `AUTH_SESSION_TTL` (default `168h`) bounds the session.
 
+### Agent view (`/api/v1/browse`)
+
+`GET /api/v1/browse?url=<domain or URL>` fetches the page server-side,
+renders it as markdown (the way a text-only agent sees it), gathers
+`/llms.txt`, `/llms-full.txt`, `/.well-known/llms.txt` and `/robots.txt`
+from the site root, and returns the snapshot plus agent-readiness checks.
+Companion files are fetched concurrently; each outbound request is bounded
+by `FETCH_TIMEOUT` (default `15s`) and response bodies are capped at 2 MiB.
+`FETCH_USER_AGENT` (default `LLM-Browser/0.1 (…)`) identifies the server to
+inspected sites.
+
 ## Layout
 
 ```