User-agent: linkCheck Disallow: /de/prv/ Disallow: /cgi-bin/ User-agent: BadSite Disallow: / User-agent: * Disallow: download/