openmonumentendag.nl
robots.txt

Robots Exclusion Standard data for openmonumentendag.nl

Resource Scan

Scan Details

Site Domain openmonumentendag.nl
Base Domain openmonumentendag.nl
Scan Status Ok
Last Scan2024-09-25T03:33:19+00:00
Next Scan 2024-10-25T03:33:19+00:00

Last Scan

Scanned2024-09-25T03:33:19+00:00
URL https://openmonumentendag.nl/robots.txt
Redirect https://www.openmonumentendag.nl/robots.txt
Redirect Domain www.openmonumentendag.nl
Redirect Base openmonumentendag.nl
Domain IPs 104.26.14.62, 104.26.15.62, 172.67.71.92, 2606:4700:20::681a:e3e, 2606:4700:20::681a:f3e, 2606:4700:20::ac43:475c
Redirect IPs 104.26.14.62, 104.26.15.62, 172.67.71.92, 2606:4700:20::681a:e3e, 2606:4700:20::681a:f3e, 2606:4700:20::ac43:475c
Response IP 104.26.14.62
Found Yes
Hash 4b11185c6c60b6d970a4183b9528c7451417f6878dd0d0cfdcd328c600ed8fd9
SimHash 3a72d8c02b31

Groups

*

Rule Path
Disallow /author/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /app/*
Disallow /route/*

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bspider

Rule Path
Disallow /

Comments

  • Crawlers