rewardscanada.ca
robots.txt

Robots Exclusion Standard data for rewardscanada.ca

Resource Scan

Scan Details

Site Domain rewardscanada.ca
Base Domain rewardscanada.ca
Scan Status Ok
Last Scan2024-10-03T18:45:14+00:00
Next Scan 2024-10-10T18:45:14+00:00

Last Scan

Scanned2024-10-03T18:45:14+00:00
URL https://rewardscanada.ca/robots.txt
Domain IPs 172.96.179.240
Response IP 172.96.179.240
Found Yes
Hash 9e302bc9b36f4fbf11ec6a1c25a67e529d38ef0a5e0dc9fb64cf3cd3d6b1e5a9
SimHash 781c9d00da10

Groups

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

seekport

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

brandverity

Rule Path
Disallow /

brandverity/1.0

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

Other Records

Field Value
sitemap https://rewardscanada.ca/sitemap.xml