us.thebar.com
robots.txt
Robots Exclusion Standard data for us.thebar.com
Resource Scan
Scan Details
| Site Domain | us.thebar.com |
| Base Domain | thebar.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T23:26:45+00:00 |
| Next Scan | 2024-12-03T23:26:45+00:00 |
Last Scan
| Scanned | 2024-11-03T23:26:45+00:00 |
| URL | https://us.thebar.com/robots.txt |
| Domain IPs | 76.76.21.164, 76.76.21.22 |
| Response IP | 76.76.21.22 |
| Found | Yes |
| Hash | b4fa1954f8aa2b1ab2b9453e743d42c4b909b3bea80a4155644f6c01b25dc36a |
| SimHash | 60455471cdd6 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /* |
| Disallow | |
| Disallow | /404 |
| Disallow | /not-found |
| Disallow | /*/404 |
| Disallow | /*/not-found |
Other Records
| Field | Value |
|---|---|
| sitemap | https://us.thebar.com/sitemap.xml |
Comments