hairyundies.com
robots.txt

Robots Exclusion Standard data for hairyundies.com

Resource Scan

Scan Details

Site Domain hairyundies.com
Base Domain hairyundies.com
Scan Status Ok
Last Scan6/5/2025, 8:56:00 PM
Next Scan 7/5/2025, 8:56:00 PM

Last Scan

Scanned6/5/2025, 8:56:00 PM
URL https://hairyundies.com/robots.txt
Redirect https://www.hairyundies.com/robots.txt
Redirect Domain www.hairyundies.com
Redirect Base hairyundies.com
Domain IPs 104.26.8.71, 104.26.9.71, 172.67.74.198
Redirect IPs 104.26.8.71, 104.26.9.71, 172.67.74.198
Response IP 172.67.74.198
Found Yes
Hash ca36f08bd2942a53df89eff33ad3fd2f085f114fa65ce7b9082a9252d6685066
SimHash 69018d452792

Groups

*

Rule Path
Disallow /ratings/actor/

Other Records

Field Value
sitemap https://www.hairyundies.com/sitemap/main.xml
sitemap https://www.hairyundies.com/sitemap/actor.xml
sitemap https://www.hairyundies.com/sitemap/scene.xml
sitemap https://xmlsitemap.hairyundies.com/hairyundies_20220525.xml