werkenbijfeadship.nl
robots.txt

Robots Exclusion Standard data for werkenbijfeadship.nl

Resource Scan

Scan Details

Site Domain werkenbijfeadship.nl
Base Domain werkenbijfeadship.nl
Scan Status Ok
Last Scan2024-06-12T19:12:40+00:00
Next Scan 2024-06-19T19:12:40+00:00

Last Scan

Scanned2024-06-12T19:12:40+00:00
URL https://werkenbijfeadship.nl/robots.txt
Redirect https://www.werkenbijfeadship.nl/robots.txt
Redirect Domain www.werkenbijfeadship.nl
Redirect Base werkenbijfeadship.nl
Domain IPs 134.209.138.125
Redirect IPs 104.22.70.155, 104.22.71.155, 172.67.24.16, 2606:4700:10::6816:469b, 2606:4700:10::6816:479b, 2606:4700:10::ac43:1810
Response IP 104.22.70.155
Found Yes
Hash f75fab31c64156d16f6d50fa2834f77d1062641e483291e0fcfe5630cc25e2da
SimHash 731d8042cff3

Groups

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow *?t=
Disallow *%26t%3D

Other Records

Field Value
sitemap https://www.werkenbijfeadship.nl/sitemap.xml