canadalightingexperts.com
robots.txt

Robots Exclusion Standard data for canadalightingexperts.com

Resource Scan

Scan Details

Site Domain canadalightingexperts.com
Base Domain canadalightingexperts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-06T10:40:33+00:00
Next Scan 2025-01-04T10:40:33+00:00

Last Successful Scan

Scanned2023-08-17T14:05:45+00:00
URL https://www.canadalightingexperts.com/robots.txt
Domain IPs 23.15.21.26
Response IP 173.223.90.81
Found Yes
Hash 9385e61b86789730872ea31ba35d69d105ef3dff8a05bb8dc12738acb8be6e85
SimHash 2316f012d913

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /ProductSheet.aspx
Disallow /secure/
Disallow /product.aspx
Disallow /more-info.aspx
Disallow /cart.aspx
Disallow /search.aspx
Disallow /*/product.aspx
Disallow /Secure/*
Disallow /Project/*
Disallow /Product/*
Disallow /Search/*
Disallow /Cart/*
Disallow /Error/*
Disallow /User/*
Disallow /Media/*
Disallow /Survey/*
Disallow /Supplier/*
Disallow /User/*
Disallow /*.php$
Disallow /*first_answer%3D

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

redcarpet
shopwiki
baiduspider
voyager
yandex
sogou spider
converacrawler
ocelli
scoutjet
camontspider
ahrefsbot
discobot
twiceler
fatbot
becomebot
speedy
openbot
dealozbot
naverbot
exabot
yanga
psbot
mj12bot
ubicrawler
semanticdiscovery
turnitinbot
twengabot
sitebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.canadalightingexperts.com/sitemapcanadalightingexperts.xml

Comments

  • Global Directives

Warnings

  • 1 invalid line.