a58tilburgbreda.nl
robots.txt

Robots Exclusion Standard data for a58tilburgbreda.nl

Resource Scan

Scan Details

Site Domain a58tilburgbreda.nl
Base Domain a58tilburgbreda.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-17T01:31:42+00:00
Next Scan 2024-10-01T01:31:42+00:00

Last Successful Scan

Scanned2023-12-06T18:51:16+00:00
URL https://a58tilburgbreda.nl/robots.txt
Domain IPs 2a00:1bd0:0:397:1::300, 5.22.248.122
Response IP 5.22.248.122
Found Yes
Hash 899e86d1cf74de9252d1c6ce7d85e41ca0d620bfe9fff6c36694077c005f1eaf
SimHash 085c8041ff91

Groups

*

Rule Path
Disallow /shortcuts/
Allow /shortcuts/*.gif$
Allow /shortcuts/*.jpg$
Allow /shortcuts/*.jpeg$
Allow /shortcuts/*.png$

semrushbot

Rule Path
Disallow /

semrushbot/3~bl

Rule Path
Disallow /

adscanner bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.a58tilburgbreda.nl/sitemap.xml