# DISALLOW_PLACEHOLDER User-agent: Linguee Disallow: / User-Agent: LinkChecker Allow: / User-Agent: W3C-checklink Allow: / User-agent: * #folders Disallow: /botdetect/ Disallow: /download/ Disallow: /newsletters/ Disallow: /reseller/ Disallow: /products/ Disallow: /padinfo/ Disallow: /pad/ Disallow: /cms/ Disallow: /cms_cache/ Disallow: /cms_pageparts/ Disallow: /content/ Disallow: /forms/ Disallow: /template/ Disallow: /tools/ #file types Disallow: /*.asp$ Disallow: /*.asax$ Disallow: /*.ashx$ Disallow: /*.axd$ Disallow: /*.browser$ Disallow: /*.config$ Disallow: /*.cs$ Disallow: /*.dll$ Disallow: /*.msi$ Disallow: /*.swf$ Disallow: /*.txt$ Disallow: /*.zip$ Disallow: /*.tar.gz$ #overrides Allow: /blog/ Sitemap: https://captcha.com/sitemap.xml # DISALLOW_PLACEHOLDER