infinitesweeps.ca
robots.txt

Robots Exclusion Standard data for infinitesweeps.ca

Resource Scan

Scan Details

Site Domain infinitesweeps.ca
Base Domain infinitesweeps.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-07T19:16:47+00:00
Next Scan 2026-01-05T19:16:47+00:00

Last Successful Scan

Scanned2025-03-12T08:37:49+00:00
URL https://infinitesweeps.ca/robots.txt
Redirect https://www.infinitesweeps.ca/robots.txt
Redirect Domain www.infinitesweeps.ca
Redirect Base infinitesweeps.ca
Domain IPs 104.21.44.25, 172.67.193.248
Redirect IPs 104.21.44.25, 172.67.193.248
Response IP 104.21.44.25
Found Yes
Hash 8cd1ae06a34659cb1c60720f1258764b396807cb4c1e1749aae2e4c214f2921c
SimHash 68045035c5b2

Groups

twitterbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Disallow /upgrade/
Disallow /share/
Disallow /twitter/
Disallow /facebook/
Disallow /sponsor/
Disallow /paypal/
Disallow /forum/profile/
Disallow /login.php?*

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.infinitesweeps.ca/sitemap.xml