User-agent: * Allow: / # Filtered search URLs. The bare /search/ page is in the sitemap and stays crawlable; # the query-string variants are not published anywhere, and crawling them walks every # vendor and department we hold. That traffic 504s on a busy volume and takes the # paying API down with it, for pages we never asked to have indexed. Disallow: /search/? Disallow: /property/? Disallow: /leads/? Sitemap: https://www.builddata.ca/sitemap.xml # LLM discoverability LLMs: https://www.builddata.ca/llms.txt