bmwusa.com
robots.txt
Robots Exclusion Standard data for bmwusa.com
Resource Scan
Scan Details
Site Domain | bmwusa.com |
Base Domain | bmwusa.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-04-18T03:11:53+00:00 |
Next Scan | 2024-07-17T03:11:53+00:00 |
Last Successful Scan
Scanned | 2023-10-06T06:53:07+00:00 |
URL | https://www.bmwusa.com/robots.txt |
Domain IPs | 184.50.85.148, 2600:1413:b000:1b::17d7:704, 2600:1413:b000:1b::17d7:713, 96.17.180.180 |
Response IP | 23.215.7.4 |
Found | Yes |
Hash | 1d802c00e90a39f15a8dc6cdecaf3aa4f9eed897bf83a841feed8879a5cfe37f |
SimHash | 692d5e418993 |
Groups
*
Rule | Path |
---|---|
Disallow | /api |
Disallow | /search-results.html |
Disallow | /errors/ |
Disallow | /errors.html |
Disallow | /cms.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.bmwusa.com/sitemap.xml |