chinasemitrailersupplier.com
robots.txt
Robots Exclusion Standard data for chinasemitrailersupplier.com
Resource Scan
Scan Details
| Site Domain | chinasemitrailersupplier.com |
| Base Domain | chinasemitrailersupplier.com |
| Scan Status | Ok |
| Last Scan | 2024-10-06T09:26:11+00:00 |
| Next Scan | 2024-11-05T09:26:11+00:00 |
Last Scan
| Scanned | 2024-10-06T09:26:11+00:00 |
| URL | https://chinasemitrailersupplier.com/robots.txt |
| Domain IPs | 104.21.60.3, 172.67.186.162, 2606:4700:3034::ac43:baa2, 2606:4700:3035::6815:3c03 |
| Response IP | 104.21.60.3 |
| Found | Yes |
| Hash | 0e164dff3ab5dde83199499094928dc4c842cbd59807c7cd254a12485d75f82c |
| SimHash | c315de1522d0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | */.well-known* |
| Disallow | */wp-content/plugins/* |
| Disallow | *wp-admin* |
| Disallow | *wp-login* |
| Disallow | *redirect_to* |
| Disallow | *clid%3D* |
| Disallow | *?utm* |
| Disallow | *add_to* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chinasemitrailersupplier.com/sitemap_index.xml |
Warnings
- 2 invalid lines.