trucktrend.com
robots.txt
Robots Exclusion Standard data for trucktrend.com
Resource Scan
Scan Details
Site Domain | trucktrend.com |
Base Domain | trucktrend.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-09T09:15:44+00:00 |
Next Scan | 2024-12-08T09:15:44+00:00 |
Last Successful Scan
Scanned | 2023-08-17T08:39:31+00:00 |
URL | https://www.trucktrend.com/robots.txt |
Domain IPs | 23.215.7.19, 23.215.7.27 |
Response IP | 23.200.74.249 |
Found | Yes |
Hash | 0d394a9102d35a3d92835b956d64a11fdc3355ea3dd2e3c5883bebdfdbe6d2bf |
SimHash | 206d0c01ad93 |
Groups
*
Rule | Path |
---|---|
Disallow | /profile/ |
Disallow | /login/ |
Disallow | /logout/ |
Disallow | /3833/ |
Disallow | /load/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.trucktrend.com/sitemap.xml |
sitemap | http://www.trucktrend.com/bg-sitemap.xml |
sitemap | http://www.trucktrend.com/trucktrend.com-adam-news.xml |
sitemap | http://www.sitemapsim.com/trucktrend.com-adam.xml |