werkenbijsecuritas.nl
robots.txt

Robots Exclusion Standard data for werkenbijsecuritas.nl

Resource Scan

Scan Details

Site Domain werkenbijsecuritas.nl
Base Domain werkenbijsecuritas.nl
Scan Status Ok
Last Scan2024-06-07T13:22:25+00:00
Next Scan 2024-06-21T13:22:25+00:00

Last Scan

Scanned2024-06-07T13:22:25+00:00
URL https://werkenbijsecuritas.nl/robots.txt
Redirect https://www.werkenbijsecuritas.nl/robots.txt
Redirect Domain www.werkenbijsecuritas.nl
Redirect Base werkenbijsecuritas.nl
Domain IPs 134.209.138.125
Redirect IPs 104.22.70.155, 104.22.71.155, 172.67.24.16, 2606:4700:10::6816:469b, 2606:4700:10::6816:479b, 2606:4700:10::ac43:1810
Response IP 172.67.24.16
Found Yes
Hash 2da2cae5089f27e497735b002dc1124a6dc0e9cf82ad3c98637db44aa8f513cc
SimHash 5315c042cfb2

Groups

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow *?t=
Disallow *%26t%3D

Other Records

Field Value
sitemap https://www.werkenbijsecuritas.nl/sitemap.xml