the-butters.com
robots.txt

Robots Exclusion Standard data for the-butters.com

Resource Scan

Scan Details

Site Domain the-butters.com
Base Domain the-butters.com
Scan Status Ok
Last Scan2025-12-16T02:42:19+00:00
Next Scan 2026-01-15T02:42:19+00:00

Last Scan

Scanned2025-12-16T02:42:19+00:00
URL https://the-butters.com/robots.txt
Redirect https://www.the-butters.com/robots.txt
Redirect Domain www.the-butters.com
Redirect Base the-butters.com
Domain IPs 104.18.10.56, 104.18.11.56, 2606:4700::6812:a38, 2606:4700::6812:b38
Redirect IPs 104.18.10.56, 104.18.11.56, 2606:4700::6812:a38, 2606:4700::6812:b38
Response IP 104.18.11.56
Found Yes
Hash 7640d5b2f7ea11cef11d069d2a1ba06f13ed83de1bc0c798cbeab7f45c5f49aa
SimHash fd11d03ee912

Groups

*

Rule Path
Disallow /api/
Disallow /user/
Disallow /checkout/