torontoairsoft.com
robots.txt

Robots Exclusion Standard data for torontoairsoft.com

Resource Scan

Scan Details

Site Domain torontoairsoft.com
Base Domain torontoairsoft.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-15T00:54:51+00:00
Next Scan 2026-03-15T00:54:51+00:00

Last Successful Scan

Scanned2023-08-03T05:43:30+00:00
URL https://torontoairsoft.com/robots.txt
Domain IPs 104.19.177.121, 104.19.178.121
Response IP 104.19.178.121
Found Yes
Hash e5c1c93d537c74170a0f2032ad08ec04305e91d5b842532f4d3b40b84dc39e13
SimHash 68956c966bd4

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /checkout.asp
Disallow /add_cart.asp
Disallow /view_cart.asp
Disallow /error.asp
Disallow /shipquote.asp
Disallow /rssfeed.asp
Disallow /admin/
Disallow /apple-app-site-association

Other Records

Field Value
sitemap https://www.torontoairsoft.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.