thirstybernie.com
robots.txt

Robots Exclusion Standard data for thirstybernie.com

Resource Scan

Scan Details

Site Domain thirstybernie.com
Base Domain thirstybernie.com
Scan Status Ok
Last Scan2025-03-29T08:55:39+00:00
Next Scan 2025-04-28T08:55:39+00:00

Last Scan

Scanned2025-03-29T08:55:39+00:00
URL https://thirstybernie.com/robots.txt
Redirect https://www.cowboysbbqcovington.com/robots.txt
Redirect Domain www.cowboysbbqcovington.com
Redirect Base cowboysbbqcovington.com
Domain IPs 104.21.87.181, 172.67.170.129, 2606:4700:3037::6815:57b5, 2606:4700:3037::ac43:aa81
Redirect IPs 104.21.67.100, 172.67.220.114, 2606:4700:3035::ac43:dc72, 2606:4700:3036::6815:4364
Response IP 104.21.67.100
Found Yes
Hash 508d07828223e9c91ec12037bc62c4e7cc42826ec45fb7c617e1db7515a9bf77
SimHash 6314dc574733

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.cowboysbbqcovington.com/sitemap.xml