User-agent: * Disallow: /application/ Disallow: /aspnet_client/ Disallow: /search/ Disallow: /test/ #Wild Card use is only supported by google thus the user agent is set to googlebot User-agent:googlebot Disallow: /*?