winespectator.com
robots.txt
Robots Exclusion Standard data for winespectator.com
Resource Scan
Scan Details
Site Domain | winespectator.com |
Base Domain | winespectator.com |
Scan Status | Ok |
Last Scan | 2024-10-30T17:32:44+00:00 |
Next Scan | 2024-11-06T17:32:44+00:00 |
Last Scan
Scanned | 2024-10-30T17:32:44+00:00 |
URL | https://winespectator.com/robots.txt |
Redirect | https://www.winespectator.com/robots.txt |
Redirect Domain | www.winespectator.com |
Redirect Base | winespectator.com |
Domain IPs | 44.196.199.11 |
Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
Response IP | 199.232.46.133 |
Found | Yes |
Hash | a6290e98d87da223f6defb7ab643dd864a53fc2cd80b3637d1721471fab39c31 |
SimHash | 08345030e113 |
Groups
*
Rule | Path |
---|---|
Disallow | /app/ |
Disallow | /vendor/ |
Disallow | /srn/ |