# All robots will spider the domain User-agent: * Disallow: /global/ Disallow: /assets/ Disallow: /currofc/docs/ Disallow: /event/ Disallow: /news/