alarmeringen.nl
robots.txt

Robots Exclusion Standard data for alarmeringen.nl

Resource Scan

Scan Details

Site Domain alarmeringen.nl
Base Domain alarmeringen.nl
Scan Status Ok
Last Scan2024-11-09T17:24:41+00:00
Next Scan 2024-11-16T17:24:41+00:00

Last Scan

Scanned2024-11-09T17:24:41+00:00
URL https://alarmeringen.nl/robots.txt
Domain IPs 172.66.40.57, 172.66.43.199, 2606:4700:3108::ac42:2839, 2606:4700:3108::ac42:2bc7
Response IP 172.66.40.57
Found Yes
Hash 69315df681b0687a7d2b5e2992228a902e5808da80c6e21bb8dce5e7e11fe81d
SimHash 03649a508510

Groups

mediapartners-google

Rule Path
Disallow
Allow /

*

Rule Path
Disallow /search/
Disallow /dashboard/
Disallow /*q%3D*
Disallow /q%3D*
Disallow /*g%3D*
Disallow /*region%3D*
Disallow /*city%3D*
Disallow /*discipline%3D*

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

antropic-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://alarmeringen.nl/sitemap.xml