werkenbijdebijenkorf.nl
robots.txt

Robots Exclusion Standard data for werkenbijdebijenkorf.nl

Resource Scan

Scan Details

Site Domain werkenbijdebijenkorf.nl
Base Domain werkenbijdebijenkorf.nl
Scan Status Ok
Last Scan2024-09-25T10:58:13+00:00
Next Scan 2024-10-09T10:58:13+00:00

Last Scan

Scanned2024-09-25T10:58:13+00:00
URL https://werkenbijdebijenkorf.nl/robots.txt
Redirect https://www.werkenbijdebijenkorf.nl/robots.txt
Redirect Domain www.werkenbijdebijenkorf.nl
Redirect Base werkenbijdebijenkorf.nl
Domain IPs 134.209.138.125
Redirect IPs 104.22.70.155, 104.22.71.155, 172.67.24.16, 2606:4700:10::6816:469b, 2606:4700:10::6816:479b, 2606:4700:10::ac43:1810
Response IP 104.22.70.155
Found Yes
Hash 81b4a22d45a2be9774a3ca047118bc786b2128309b2c25d9d251d95ccc02db60
SimHash 431d8040cff3

Groups

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow *?t=
Disallow *%26t%3D

Other Records

Field Value
sitemap https://www.werkenbijdebijenkorf.nl/sitemap.xml