User-agent: * Disallow: /go Disallow: /? Disallow: /search Disallow: /url Disallow: /xhtml?