somewhatawry.com
robots.txt

Robots Exclusion Standard data for somewhatawry.com

Resource Scan

Scan Details

Site Domain somewhatawry.com
Base Domain somewhatawry.com
Scan Status Ok
Last Scan2026-02-09T18:07:03+00:00
Next Scan 2026-02-16T18:07:03+00:00

Last Scan

Scanned2026-02-09T18:07:03+00:00
URL https://somewhatawry.com/robots.txt
Domain IPs 66.96.147.113
Response IP 66.96.147.113
Found Yes
Hash 51b712a65a12ba52af8da2230221179d69077602fa0f33986e61ba461239e5f6
SimHash 69011b144711

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap http://somewhatawry.com/sitemap.xml