robertkranenborg.nl
robots.txt

Robots Exclusion Standard data for robertkranenborg.nl

Resource Scan

Scan Details

Site Domain robertkranenborg.nl
Base Domain robertkranenborg.nl
Scan Status Ok
Last Scan2025-11-23T02:43:28+00:00
Next Scan 2025-12-23T02:43:28+00:00

Last Scan

Scanned2025-11-23T02:43:28+00:00
URL https://robertkranenborg.nl/robots.txt
Redirect https://www.robertkranenborg.nl/robots.txt
Redirect Domain www.robertkranenborg.nl
Redirect Base robertkranenborg.nl
Domain IPs 104.21.80.121, 172.67.181.11, 2606:4700:3031::6815:5079, 2606:4700:3034::ac43:b50b
Redirect IPs 104.21.80.121, 172.67.181.11, 2606:4700:3031::6815:5079, 2606:4700:3034::ac43:b50b
Response IP 104.21.80.121
Found Yes
Hash 7916076212a436522e4b3ff14954039b11545e3b3755f68e170da2dca4c4040b
SimHash 49045851c933

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.robertkranenborg.nl/sitemap.xml