scrubhatpatterns.com
robots.txt

Robots Exclusion Standard data for scrubhatpatterns.com

Resource Scan

Scan Details

Site Domain scrubhatpatterns.com
Base Domain scrubhatpatterns.com
Scan Status Ok
Last Scan2025-10-24T05:07:45+00:00
Next Scan 2025-10-31T05:07:45+00:00

Last Scan

Scanned2025-10-24T05:07:45+00:00
URL https://scrubhatpatterns.com/robots.txt
Redirect https://www.scrubhatpatterns.com/robots.txt
Redirect Domain www.scrubhatpatterns.com
Redirect Base scrubhatpatterns.com
Domain IPs 199.34.228.57
Redirect IPs 199.34.228.57
Response IP 199.34.228.57
Found Yes
Hash 822c9f44ac7cb48ab295643a7a9310ab4c4ba86bcdce300ce40073a35266e029
SimHash 0354dc746793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.scrubhatpatterns.com/sitemap.xml