blackangus.com
robots.txt
Robots Exclusion Standard data for blackangus.com
Resource Scan
Scan Details
Site Domain | blackangus.com |
Base Domain | blackangus.com |
Scan Status | Ok |
Last Scan | 2024-04-30T08:38:51+00:00 |
Next Scan | 2024-05-30T08:38:51+00:00 |
Last Scan
Scanned | 2024-04-30T08:38:51+00:00 |
URL | https://blackangus.com/robots.txt |
Domain IPs | 108.138.246.2, 108.138.246.35, 108.138.246.69, 108.138.246.76, 2600:9000:260f:1200:18:27da:b840:93a1, 2600:9000:260f:2c00:18:27da:b840:93a1, 2600:9000:260f:3600:18:27da:b840:93a1, 2600:9000:260f:a600:18:27da:b840:93a1, 2600:9000:260f:ca00:18:27da:b840:93a1, 2600:9000:260f:dc00:18:27da:b840:93a1, 2600:9000:260f:ea00:18:27da:b840:93a1, 2600:9000:260f:fc00:18:27da:b840:93a1 |
Response IP | 3.160.246.20 |
Found | Yes |
Hash | a17171138cc9f86440c18439c33ea02b1d34c6727ffdff4771548a29520bcb9a |
SimHash | a108da668a71 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /account/ |
Disallow | /android |
Disallow | /arrival-confirmation/ |
Disallow | /checkout |
Disallow | /forgot-password |
Disallow | /order-confirmation/ |
Disallow | /reset-password |
Disallow | /webviews/ |
Other Records
Field | Value |
---|---|
sitemap | https://blackangus.origin.order.koala.io/sitemap.xml |