shamusyoung.com
robots.txt

Robots Exclusion Standard data for shamusyoung.com

Resource Scan

Scan Details

Site Domain shamusyoung.com
Base Domain shamusyoung.com
Scan Status Ok
Last Scan2025-03-26T22:40:29+00:00
Next Scan 2025-04-25T22:40:29+00:00

Last Scan

Scanned2025-03-26T22:40:29+00:00
URL https://shamusyoung.com/robots.txt
Redirect http://www.shamusyoung.com/robots.txt
Redirect Domain www.shamusyoung.com
Redirect Base shamusyoung.com
Domain IPs 104.21.10.70, 172.67.131.67, 2606:4700:3031::6815:a46, 2606:4700:3033::ac43:8343
Redirect IPs 104.21.10.70, 172.67.131.67, 2606:4700:3031::6815:a46, 2606:4700:3033::ac43:8343
Response IP 104.21.10.70
Found Yes
Hash 41a8c9e6b81857319bd7e6bc5a1b53f3f2a893183354dc55ce2a1a8e2841c1a1
SimHash 800a7ce20ba1

Groups

*

Rule Path
Disallow /twentysidedtale/images
Disallow /diecast
Disallow /files
Disallow /forums
Disallow /twentysidedtale/wp-content

Other Records

Field Value
crawl-delay 20

semrushbot

Rule Path
Disallow /