floridastate.rivals.com
robots.txt

Robots Exclusion Standard data for floridastate.rivals.com

Resource Scan

Scan Details

Site Domain floridastate.rivals.com
Base Domain rivals.com
Scan Status Ok
Last Scan2024-11-11T02:56:26+00:00
Next Scan 2024-11-25T02:56:26+00:00

Last Scan

Scanned2024-11-11T02:56:26+00:00
URL https://floridastate.rivals.com/robots.txt
Domain IPs 216.137.39.106, 216.137.39.61, 216.137.39.85, 216.137.39.98, 2600:9000:2365:1400:9:617f:eac0:93a1, 2600:9000:2365:8400:9:617f:eac0:93a1, 2600:9000:2365:da00:9:617f:eac0:93a1, 2600:9000:2365:e800:9:617f:eac0:93a1
Response IP 216.137.39.98
Found Yes
Hash 84fa70b5f64cbeda152b83856b3020a04b072b8cb72ba482abc85c8653378c5c
SimHash ab1019c57f66

Groups

*

Rule Path
Disallow /api/
Disallow /user/password/*

Other Records

Field Value
sitemap https://n.rivals.com/sitemap_index.xml

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file