#This is webbaecker.de from Bremerhaven, Germany, and this is our work: Sitemap: https://www.webbaecker.de/sitemap.xml Sitemap: https://www.webbaecker.de/sitemap-news.xml #Disallow all Microsoft and other terror: User-agent: bingbot User-agent: bingpreview User-agent: BingBot User-agent: msnbot User-agent: msnbot-media User-agent: python-requests Disallow: / #Allow every friendly search engine as follows: User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: /trackback/ Disallow: /comments/ Disallow: /category/ Disallow: /tag/ Disallow: */trackback/ Disallow: */comments/ Disallow: /?s= Disallow: /search/ #Place a small honeypot for unfriendly search engines: User-agent: * Disallow: /*blackhole Disallow: /?blackhole