User-agent: * # match all bots Disallow: /apps/ Disallow: /re/ Disallow: /cshared/ Disallow: /dndcp/ Disallow: /cp-site/