truckersexshop.com
robots.txt
Robots Exclusion Standard data for truckersexshop.com
Resource Scan
Scan Details
| Site Domain | truckersexshop.com |
| Base Domain | truckersexshop.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-05-15T19:43:42+00:00 |
| Next Scan | 2024-06-14T19:43:42+00:00 |
Last Successful Scan
| Scanned | 2024-03-24T17:42:04+00:00 |
| URL | https://truckersexshop.com/robots.txt |
| Domain IPs | 104.21.65.197, 172.67.165.129, 2606:4700:3030::6815:41c5, 2606:4700:3032::ac43:a581 |
| Response IP | 104.21.65.197 |
| Found | Yes |
| Hash | 9608ad6312ff119743025d45996c532df5809c7380107fe0543b5301ed3d2926 |
| SimHash | 0136dda8b57a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account.php |
| Disallow | /add-address.php |
| Disallow | /address.php |
| Disallow | /cart.php |
| Disallow | /change-password.php |
| Disallow | /checkout.php |
| Disallow | /confirmation.php |
| Disallow | /edit-account.php |
| Disallow | /edit-address.php |
| Disallow | /edit-card.php |
| Disallow | /edit-payment.php |
| Disallow | /logoff.php |
| Disallow | /order.php |
| Disallow | /place-order.php |
| Disallow | /popunder.php |
| Disallow | /share-session.php |
| Disallow | /status.php |
| Disallow | /test.php |
| Disallow | /faqs.php |
| Disallow | /faqs.html |
| Disallow | /faqs.htm |
| Disallow | /privacy-policy.php |
| Disallow | /privacy-policy.html |
| Disallow | /privacy-policy.htm |
| Disallow | /2257.php |
| Disallow | /2257.html |
| Disallow | /2257.htm |
| Disallow | /ordering.php |
| Disallow | /ordering.html |
| Disallow | /ordering.htm |
| Disallow | /guarantee.php |
| Disallow | /guarantee.html |
| Disallow | /guarantee.htm |
| Disallow | /shipping.php |
| Disallow | /shipping.html |
| Disallow | /shipping.htm |
| Disallow | /returns.php |
| Disallow | /returns.html |
| Disallow | /returns.htm |
| Disallow | /help.php |
| Disallow | /help.html |
| Disallow | /help.htm |
| Disallow | /help.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |