shopping-canada.com
robots.txt

Robots Exclusion Standard data for shopping-canada.com

Resource Scan

Scan Details

Site Domain shopping-canada.com
Base Domain shopping-canada.com
Scan Status Ok
Last Scan2024-11-13T23:04:57+00:00
Next Scan 2024-11-20T23:04:57+00:00

Last Scan

Scanned2024-11-13T23:04:57+00:00
URL https://shopping-canada.com/robots.txt
Redirect https://www.shopping-canada.com/robots.txt
Redirect Domain www.shopping-canada.com
Redirect Base shopping-canada.com
Domain IPs 2600:1f14:30d6:dc00:97bc:932c:3f74:30e5, 54.191.48.77
Redirect IPs 13.226.2.101, 13.226.2.108, 13.226.2.19, 13.226.2.29, 2600:9000:21f8:1600:e:b1f9:a00:93a1, 2600:9000:21f8:4600:e:b1f9:a00:93a1, 2600:9000:21f8:5c00:e:b1f9:a00:93a1, 2600:9000:21f8:6600:e:b1f9:a00:93a1, 2600:9000:21f8:8400:e:b1f9:a00:93a1, 2600:9000:21f8:ac00:e:b1f9:a00:93a1, 2600:9000:21f8:bc00:e:b1f9:a00:93a1, 2600:9000:21f8:f200:e:b1f9:a00:93a1
Response IP 3.164.206.73
Found Yes
Hash 1b2e30f90d034d633a127958b4012d23bf3a5273abba31a6ed4bc058c126af4c
SimHash 7b58c8c1a192

Groups

*

Rule Path
Disallow /ajax/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.shopping-canada.com/Sitemap_index.xml