cal.rivals.com
robots.txt

Robots Exclusion Standard data for cal.rivals.com

Resource Scan

Scan Details

Site Domain cal.rivals.com
Base Domain rivals.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-05-27T00:39:41+00:00
Next Scan 2024-06-03T00:39:41+00:00

Last Successful Scan

Scanned2024-05-12T00:39:14+00:00
URL https://cal.rivals.com/robots.txt
Domain IPs 106.10.236.137, 2406:2000:e4:1605::1000
Response IP 106.10.236.137
Found Yes
Hash 84fa70b5f64cbeda152b83856b3020a04b072b8cb72ba482abc85c8653378c5c
SimHash ab1019c57f66

Groups

*

Rule Path
Disallow /api/
Disallow /user/password/*

Other Records

Field Value
sitemap https://n.rivals.com/sitemap_index.xml

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file