sweenyfuneralhome.ca
robots.txt

Robots Exclusion Standard data for sweenyfuneralhome.ca

Resource Scan

Scan Details

Site Domain sweenyfuneralhome.ca
Base Domain sweenyfuneralhome.ca
Scan Status Ok
Last Scan2025-12-14T14:41:38+00:00
Next Scan 2026-01-13T14:41:38+00:00

Last Scan

Scanned2025-12-14T14:41:38+00:00
URL https://www.sweenyfuneralhome.ca/robots.txt
Domain IPs 72.32.39.199
Response IP 72.32.39.199
Found Yes
Hash 56d10798a4332ba831a84024ae7cf7d5bb8416433c1c2570d4394046d4974642
SimHash 915ccce2ea2a

Groups

*

Rule Path
Disallow /admin.php

*

Rule Path
Disallow /include/storage/

*

Rule Path
Disallow /include/sitelist/sitelist.php

*

Rule Path
Disallow /banner

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

spbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex
megaindex.ru
megaindex.ru/2.0

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Warnings

  • 2 invalid lines.