User-agent: BadBot Disallow: / User-agent: * Disallow: /pricing-v2/ Disallow: /crunchbase-pricing/ Disallow: /crunchbase-pro/ Disallow: /search/ Disallow: /topics/ Sitemap: https://about.crunchbase.com/sitemap.xml