Cloudflare has added a new /crawl endpoint to Browser Rendering, letting developers crawl entire websites with one API call and export content in HTML, Markdown, or structured JSON for RAG and AI data workflows.