shopping-canada.com
robots.txt

Robots Exclusion Standard data for shopping-canada.com

Resource Scan

Scan Details

Site Domain shopping-canada.com
Base Domain shopping-canada.com
Scan Status Ok
Last Scan2024-09-18T23:01:40+00:00
Next Scan 2024-09-25T23:01:40+00:00

Last Scan

Scanned2024-09-18T23:01:40+00:00
URL https://shopping-canada.com/robots.txt
Redirect https://www.shopping-canada.com/robots.txt
Redirect Domain www.shopping-canada.com
Redirect Base shopping-canada.com
Domain IPs 2600:1f14:30d6:dc00:97bc:932c:3f74:30e5, 54.191.48.77
Redirect IPs 13.226.2.101, 13.226.2.108, 13.226.2.19, 13.226.2.29, 2600:9000:25a2:1000:e:b1f9:a00:93a1, 2600:9000:25a2:1a00:e:b1f9:a00:93a1, 2600:9000:25a2:1e00:e:b1f9:a00:93a1, 2600:9000:25a2:9200:e:b1f9:a00:93a1, 2600:9000:25a2:9400:e:b1f9:a00:93a1, 2600:9000:25a2:b400:e:b1f9:a00:93a1, 2600:9000:25a2:d400:e:b1f9:a00:93a1, 2600:9000:25a2:f800:e:b1f9:a00:93a1
Response IP 52.85.49.86
Found Yes
Hash 1b2e30f90d034d633a127958b4012d23bf3a5273abba31a6ed4bc058c126af4c
SimHash 7b58c8c1a192

Groups

*

Rule Path
Disallow /ajax/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.shopping-canada.com/Sitemap_index.xml