4 months ago
Cloudflare Launches Site-Wide Crawl API for RAG and AI Training
Cloudflare has added a new /crawl endpoint to Browser Rendering, letting developers crawl entire websites with one API call and export content in HTML, Markdown, or structured JSON for RAG and AI data workflows.
970
