Sitemap: https://www.deneutcompany.nl/storage/sitemaps/de-neut-company-sitemap.xml

# Crawlers Setup
User-agent: *
Crawl-delay: 10
Disallow: /admin/
Disallow: /*?filter
Disallow: /*?page

User-agent: MJ12bot
Disallow: /

User-agent: Vagabondo
Disallow: /

User-agent: BaiDuSpider
Disallow: /

User-agent: Exabot
Disallow: /

User-agent: Yandex
Disallow: /

User-agent: BSpider
Disallow: /

User-agent: Googlebot
Disallow:

User-agent: AdsBot-Google
Disallow:

User-agent: Googlebot-Image
Disallow: