vitaleinfrasector.nl
robots.txt

Robots Exclusion Standard data for vitaleinfrasector.nl

Resource Scan

Scan Details

Site Domain vitaleinfrasector.nl
Base Domain vitaleinfrasector.nl
Scan Status Ok
Last Scan2025-10-06T10:15:25+00:00
Next Scan 2025-10-20T10:15:25+00:00

Last Scan

Scanned2025-10-06T10:15:25+00:00
URL https://vitaleinfrasector.nl/robots.txt
Domain IPs 2a00:1bd0:0:397:1::300, 5.22.248.122
Response IP 5.22.248.122
Found Yes
Hash 8cf76e915927a018ba67c5e5de654c866e7e6f02054de5335e13432fdb59129b
SimHash 021c8840fbb0

Groups

*

Rule Path
Disallow /shortcuts/
Allow /shortcuts/*.gif$
Allow /shortcuts/*.jpg$
Allow /shortcuts/*.jpeg$
Allow /shortcuts/*.png$

adscanner bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/3~bl

Rule Path
Disallow /

timpi

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vitaleinfrasector.nl/sitemap.xml