n.rivals.com
robots.txt

Robots Exclusion Standard data for n.rivals.com

Resource Scan

Scan Details

Site Domain n.rivals.com
Base Domain rivals.com
Scan Status Ok
Last Scan2024-11-11T20:37:58+00:00
Next Scan 2024-11-25T20:37:58+00:00

Last Scan

Scanned2024-11-11T20:37:58+00:00
URL https://n.rivals.com/robots.txt
Domain IPs 204.246.191.102, 204.246.191.37, 204.246.191.84, 204.246.191.97, 2600:9000:200f:1400:9:617f:eac0:93a1, 2600:9000:200f:9c00:9:617f:eac0:93a1, 2600:9000:200f:b400:9:617f:eac0:93a1, 2600:9000:200f:e400:9:617f:eac0:93a1
Response IP 216.137.39.98
Found Yes
Hash 84fa70b5f64cbeda152b83856b3020a04b072b8cb72ba482abc85c8653378c5c
SimHash ab1019c57f66

Groups

*

Rule Path
Disallow /api/
Disallow /user/password/*

Other Records

Field Value
sitemap https://n.rivals.com/sitemap_index.xml

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file