turbodieselregister.com
robots.txt
Robots Exclusion Standard data for turbodieselregister.com
Resource Scan
Scan Details
| Site Domain | turbodieselregister.com |
| Base Domain | turbodieselregister.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-01T13:53:39+00:00 |
| Next Scan | 2024-10-08T13:53:39+00:00 |
Last Successful Scan
| Scanned | 2024-06-02T12:50:37+00:00 |
| URL | https://turbodieselregister.com/robots.txt |
| Redirect | https://www.turbodieselregister.com/managebots/robots.php?do=generatefile |
| Redirect Domain | www.turbodieselregister.com |
| Redirect Base | turbodieselregister.com |
| Domain IPs | 104.21.38.223, 172.67.140.57, 2606:4700:3032::6815:26df, 2606:4700:3032::ac43:8c39 |
| Redirect IPs | 104.21.38.223, 172.67.140.57, 2606:4700:3032::6815:26df, 2606:4700:3032::ac43:8c39 |
| Response IP | 172.67.140.57 |
| Found | Yes |
| Hash | 2eae2d0ce65abd8258bed4a7ac53949815e4ae18797160cd2b8e19c49a8c7a2c |
| SimHash | e15513614dc5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
applebot
| Rule | Path |
|---|---|
| Disallow | /blogs/ |
| Disallow | /blog.php |
| Disallow | /calendar.php |
| Disallow | /clientscript/ |
| Disallow | /converse.php |
| Disallow | /css.php |
| Disallow | /director.php |
| Disallow | /dynamics/dynamics/ |
| Disallow | /errors.php |
| Disallow | /external.php |
| Disallow | /feed/ |
| Disallow | /forms.php |
| Disallow | /forums/misc/ |
| Disallow | /forums/help/ |
| Disallow | /forums/media/ |
| Disallow | /history/ |
| Disallow | /hp/ |
| Disallow | /list/ |
| Disallow | /lost-password/ |
| Disallow | /media/u* |
| Disallow | /media.php?do=rss* |
| Disallow | /media/help/ |
| Disallow | /media/members/ |
| Disallow | /media/misc/ |
| Disallow | /misc.php |
| Disallow | /mobiquo/ |
| Disallow | /moderator.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /payments.php |
| Disallow | /pictures/plog-rss.php |
| Disallow | /printthread.php |
| Disallow | /private.php |
| Disallow | /projhp/ |
| Disallow | /proxy.php?link |
| Disallow | /register.php |
| Disallow | /report.php |
| Disallow | /search/ |
| Disallow | /search.php |
| Disallow | /sendmessage.php |
| Disallow | /subscription.php |
| Disallow | /trapbot/ |
| Disallow | /treeview/ |
| Disallow | /visitme/ |
| Disallow | /login.php |
| Disallow | /hp/ |
| Disallow | /hp/separationdetective.php |
| Disallow | /threads/*/previous |
| Disallow | /threads/*/next |
Comments