Sitemap: /xmlsitemap User-agent: * Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /config/ Disallow: /data/ Disallow: /install/ Disallow: /masterpages/ Disallow: /python/ Disallow: /umbraco/ Disallow: /umbraco_client/ Disallow: /usercontrols/ Disallow: /xslt/ Disallow: /turneringer_og_resultater/resultatsoegning/ Disallow: /landshold/landsholdsdatabasen/*.aspx* Disallow: /resultater/kampsoegAdvanceret/ User-agent: AhrefsBot Disallow: / User-Agent: Baiduspider Disallow: / User-Agent: Ezooms Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: YandexBot Disallow: / User-Agent: SemrushBot Disallow: / User-Agent: Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; http://www.grapeshot.co.uk/crawler.php) Disallow: / User-Agent: Mozilla/5.0 (compatible; proximic; https://www.comscore.com/Web-Crawler) Disallow: / User-Agent: Perl LWP Disallow: /