winespectator.com
robots.txt

Robots Exclusion Standard data for winespectator.com

Resource Scan

Scan Details

Site Domain winespectator.com
Base Domain winespectator.com
Scan Status Ok
Last Scan2024-10-30T17:32:44+00:00
Next Scan 2024-11-06T17:32:44+00:00

Last Scan

Scanned2024-10-30T17:32:44+00:00
URL https://winespectator.com/robots.txt
Redirect https://www.winespectator.com/robots.txt
Redirect Domain www.winespectator.com
Redirect Base winespectator.com
Domain IPs 44.196.199.11
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 199.232.46.133
Found Yes
Hash a6290e98d87da223f6defb7ab643dd864a53fc2cd80b3637d1721471fab39c31
SimHash 08345030e113

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /app/
Disallow /vendor/
Disallow /srn/