roughnrowdybrawl.com
robots.txt

Robots Exclusion Standard data for roughnrowdybrawl.com

Resource Scan

Scan Details

Site Domain roughnrowdybrawl.com
Base Domain roughnrowdybrawl.com
Scan Status Ok
Last Scan2024-10-21T17:22:35+00:00
Next Scan 2024-11-20T17:22:35+00:00

Last Scan

Scanned2024-10-21T17:22:35+00:00
URL https://roughnrowdybrawl.com/robots.txt
Redirect https://www.roughnrowdybrawl.com/robots.txt
Redirect Domain www.roughnrowdybrawl.com
Redirect Base roughnrowdybrawl.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.241, 76.76.21.93
Response IP 76.76.21.98
Found Yes
Hash f6cdf867035f8eda59ae0a0c04ac90862b8790526a3ba5f177f2a965c030f998
SimHash d82cd6884e93

Groups

proximic

Rule Path
Disallow

deepcrawl

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /preview/
Disallow /viceroy-signup

Other Records

Field Value
sitemap https://www.barstoolsports.com/sitemap.xml
sitemap https://www.barstoolsports.com/sitemap-authors.xml
sitemap https://www.barstoolsports.com/sitemap-tags.xml
sitemap https://www.barstoolsports.com/sitemap-brands.xml