assen.automadness.nl
robots.txt

Robots Exclusion Standard data for assen.automadness.nl

Resource Scan

Scan Details

Site Domain assen.automadness.nl
Base Domain automadness.nl
Scan Status Ok
Last Scan2025-12-09T04:26:32+00:00
Next Scan 2026-01-08T04:26:32+00:00

Last Scan

Scanned2025-12-09T04:26:32+00:00
URL https://assen.automadness.nl/robots.txt
Domain IPs 104.21.59.96, 172.67.174.191, 2606:4700:3030::6815:3b60, 2606:4700:3037::ac43:aebf
Response IP 104.21.59.96
Found Yes
Hash a71ffa17c1215421437428e975b30f0545e028cda7c8f647c2939f26038aef97
SimHash 4d51f8a0abe2

Groups

*

Rule Path
Disallow /fout-pagina
Disallow /error-page
Disallow /fehlerseite
Disallow /page-derreur
Disallow /site/*
Disallow /nl/mailings/links/*
Disallow /benl/mailings/links/*
Disallow /en/mailings/links/*
Disallow /de/mailings/links/*
Disallow /fr/mailings/links/*
Disallow /befr/mailings/links/*
Disallow /mailings/links/*
Disallow /mailing/*
Disallow /mailings/*
Disallow /tools/*
Disallow /toon-programma/*
Disallow /nl/mailing/*
Disallow /benl/mailing/*
Disallow /en/mailing/*
Disallow /de/mailing/*
Disallow /fr/mailing/*
Disallow /befr/mailing/*

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Disallow *?d=*

Comments

  • robots.txt