assets-prod.rew.ca
robots.txt

Robots Exclusion Standard data for assets-prod.rew.ca

Resource Scan

Scan Details

Site Domain assets-prod.rew.ca
Base Domain rew.ca
Scan Status Ok
Last Scan2025-08-15T08:51:49+00:00
Next Scan 2025-09-14T08:51:49+00:00

Last Scan

Scanned2025-08-15T08:51:49+00:00
URL https://assets-prod.rew.ca/robots.txt
Domain IPs 151.101.130.208, 151.101.194.208, 151.101.2.208, 151.101.66.208, 2a04:4e42:200::720, 2a04:4e42:400::720, 2a04:4e42:600::720, 2a04:4e42::720
Response IP 146.75.46.208
Found Yes
Hash 85cc4398abab9acfa90e55fa2003e786ecd139c6bb415caf040ef4197ef15579
SimHash c90cc2e46732

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /
Allow /assets
Allow /building
Allow /building-group
Allow /development-developer
Allow /packs
Allow /property
Allow /property-agent
Allow /property-office
Allow /vendor

Other Records

Field Value
sitemap https://sitemap.rew.ca/sitemaps/sitemap.xml.gz