smallstategreatbeer.com
robots.txt

Robots Exclusion Standard data for smallstategreatbeer.com

Resource Scan

Scan Details

Site Domain smallstategreatbeer.com
Base Domain smallstategreatbeer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-23T02:27:29+00:00
Next Scan 2025-05-07T02:27:29+00:00

Last Successful Scan

Scanned2025-03-16T00:04:47+00:00
URL https://smallstategreatbeer.com/robots.txt
Redirect https://mobilebarhawaii.com/robots.txt
Redirect Domain mobilebarhawaii.com
Redirect Base mobilebarhawaii.com
Domain IPs 104.21.88.228, 172.67.153.181, 2606:4700:3033::6815:58e4, 2606:4700:3037::ac43:99b5
Redirect IPs 104.26.0.116, 104.26.1.116, 172.67.73.195, 2606:4700:20::681a:174, 2606:4700:20::681a:74, 2606:4700:20::ac43:49c3
Response IP 104.26.1.116
Found Yes
Hash e7c8c88c4f4e4927135ae62fa4302ee3b1cfbc2f91b127e965f68d7a2884378f
SimHash dd1d49c94b32

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /*?*
Disallow /*?%2F
Disallow /?*
Disallow /?%2F
Disallow /404/
Disallow /404/*
Disallow /403/
Disallow /403/*
Disallow /index.php
Disallow /wp-content/plugins/litespeed-cache/guest.vary.php
Disallow /readme.html
Disallow /license.txt
Disallow /wp-content/cache/
Disallow /wp-login.php
Disallow /*?feed*
Disallow /search/*