AI Search now supports CSS content selectors for website data sources. You can now define which parts of a crawled page are extracted and indexed by specifying CSS selectors paired with URL glob patterns. Content selectors solve the problem of indexing only relevant content while ignoring navigation, sidebars, foote...
AI Search - Website Source CSS content selectors for precise content extraction in AI Search
Cloudflare Developer Platform Changelog · 2026-04-08
Related items
AI Search - AI Search support for crawling login protected website content
AI Search now supports custom HTTP headers for website crawling, solving a common problem where valuable content behind authentication or access controls could not be indexed. Previously, AI Search could only crawl publicly accessible pages, leaving knowledge bases, documentation, and other protected content out of...
AI Search - AI Search path filtering for website and R2 data sources
AI Search now includes path filtering for both website and R2 data sources. You can now control which content gets indexed by defining include and exclude rules for paths. By controlling what gets indexed, you can improve the relevance and quality of your search results. You can also use path filtering to split a si...
AI Search - New Workers AI models for text generation and embedding in AI Search
AI Search now supports four additional Workers AI models across text generation and embedding. Text generation Model Context window (tokens) @cf/zai-org/glm-4.7-flash 131,072 @cf/qwen/qwen3-30b-a3b-fp8 32,000 GLM-4.7-Flash is a lightweight model from Zhipu AI with a 131,072 token context window, suitable for long-do...
AI Search - Reranking and API-based system prompt configuration in AI Search
AI Search now supports reranking for improved retrieval quality and allows you to set the system prompt directly in your API requests. Rerank for more relevant results You can now enable reranking to reorder retrieved documents based on their semantic relevance to the user’s query. Reranking helps improve accuracy,...
AI Search, Vectorize - Create fully-managed RAG pipelines for your AI applications with AutoRAG
AutoRAG is now in open beta, making it easy for you to build fully-managed retrieval-augmented generation (RAG) pipelines without managing infrastructure. Just upload your docs to R2 , and AutoRAG handles the rest: embeddings, indexing, retrieval, and response generation via API. With AutoRAG, you can: Customize you...
AI Search - New AI Search REST API endpoints for /search and /chat/completions
AI Search now offers new REST API endpoints for search and chat that use an OpenAI compatible format. This means you can use the familiar messages array structure that works with existing OpenAI SDKs and tools. The messages array also lets you pass previous messages within a session, so the model can maintain contex...