Log In Sign Up

urmstonaquatics.com
robots.txt

Robots Exclusion Standard data for urmstonaquatics.com

Resource Scan

Scan Details

Site Domain urmstonaquatics.com
Base Domain urmstonaquatics.com
Scan Status Ok
Last Scan2025-12-30T13:51:46+00:00
Next Scan 2026-01-06T13:51:46+00:00

Last Scan

Scanned2025-12-30T13:51:46+00:00
URL https://urmstonaquatics.com/robots.txt
Domain IPs 104.26.4.60, 104.26.5.60, 172.67.70.92, 2606:4700:20::681a:43c, 2606:4700:20::681a:53c, 2606:4700:20::ac43:465c
Response IP 104.26.4.60
Found Yes
Hash 48c563d0474dd6fe8f08602f14a28f061249832c8e94a1c3b51b7d78fd26db33
SimHash c1347a1e01ae

Groups

mj12bot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://urmstonaquatics.com/media/storage/sitemap-index.xml
Back to top

Comments

  • Disable checkout & customer account
  • Disable Search pages
  • Disable common folders
  • Disable Tag & Review (Avoid duplicate content)
  • Common files
  • Disable sorting (Avoid duplicate content)
  • Disable version control folders and others
Back to top

Warnings

  • 48 invalid lines.
Back to top