kimballmidwest.com
robots.txt
Robots Exclusion Standard data for kimballmidwest.com
Resource Scan
Scan Details
Site Domain | kimballmidwest.com |
Base Domain | kimballmidwest.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-19T15:53:32+00:00 |
Next Scan | 2024-10-18T15:53:32+00:00 |
Last Successful Scan
Scanned | 2024-05-29T15:52:41+00:00 |
URL | https://kimballmidwest.com/robots.txt |
Redirect | https://www.kimballmidwest.com/robots.txt |
Redirect Domain | www.kimballmidwest.com |
Redirect Base | kimballmidwest.com |
Domain IPs | 139.64.248.73 |
Redirect IPs | 139.64.248.73 |
Response IP | 139.64.248.73 |
Found | Yes |
Hash | 228e261917e615df7bc2d22d8e65492818495ebe1f2ef7ef4e8654ec199d017a |
SimHash | 2ed55d038684 |
Groups
*
Rule | Path |
---|---|
Disallow | /Cards/ |
Disallow | /images/products/360/ |
Disallow | /TempFiles/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.kimballmidwest.com/sitemapindex.xml |
Warnings
- `visit-time` is not a known field.
Comments