aosom.ca
robots.txt

Robots Exclusion Standard data for aosom.ca

Resource Scan

Scan Details

Site Domain aosom.ca
Base Domain aosom.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-13T21:24:56+00:00
Next Scan 2024-09-11T21:24:56+00:00

Last Successful Scan

Scanned2023-02-07T00:13:43+00:00
URL https://aosom.ca/robots.txt
Redirect https://www.aosom.ca:443/robots.txt
Redirect Domain www.aosom.ca
Redirect Base aosom.ca
Domain IPs 3.232.16.21, 34.232.234.10
Redirect IPs 23.52.171.129, 23.52.171.147, 2600:1417:5e::48f7:5191, 2600:1417:5e::48f7:51a3
Response IP 23.52.171.147
Found Yes
Hash 4f6f12292a58da71ef6263965578b92ac7fbc35efb998582a9a16c6fc866eceb
SimHash edfe5df0b6a7

Groups

*

Rule Path
Disallow /?*
Disallow /payment/
Disallow /plap/
Disallow /business/
Disallow /item/null~*
Disallow /item/~*
Disallow /fr/
Disallow /reviews/fr/

amazonproductdiscoverybot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

Other Records

Field Value
sitemap https://www.aosom.ca/sitemap.xml