truck-n-trailer.com
robots.txt
Robots Exclusion Standard data for truck-n-trailer.com
Resource Scan
Scan Details
Site Domain | truck-n-trailer.com |
Base Domain | truck-n-trailer.com |
Scan Status | Ok |
Last Scan | 2024-09-25T04:12:46+00:00 |
Next Scan | 2024-10-25T04:12:46+00:00 |
Last Scan
Scanned | 2024-09-25T04:12:46+00:00 |
URL | https://truck-n-trailer.com/robots.txt |
Domain IPs | 13.107.246.73 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 5777affdc6a90a5dbb471b0be31c063b4bf333b64c75ee2aeb584c223b655792 |
SimHash | f610dd19c4f7 |
Groups
*
Rule | Path |
---|---|
Disallow | /MyGarage/ |
Disallow | /user/ |
Disallow | /Auth/ |
Disallow | /api/ |
Disallow | /newuserapi/ |
Disallow | /admin/ |
Disallow | /dashboard/ |
Disallow | /truckpros/ |
Disallow | /tasksapi/ |
Disallow | /test/ |
Disallow | /UserTracking/ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://truck-n-trailer.com/sitemap.xml |
Warnings
- 2 invalid lines.
Comments