dieseltruckresource.com
robots.txt

Robots Exclusion Standard data for dieseltruckresource.com

Resource Scan

Scan Details

Site Domain dieseltruckresource.com
Base Domain dieseltruckresource.com
Scan Status Ok
Last Scan2025-04-05T10:16:32+00:00
Next Scan 2025-04-12T10:16:32+00:00

Last Scan

Scanned2025-04-05T10:16:32+00:00
URL https://dieseltruckresource.com/robots.txt
Redirect https://www.dieseltruckresource.com/robots.txt
Redirect Domain www.dieseltruckresource.com
Redirect Base dieseltruckresource.com
Domain IPs 104.21.77.170, 172.67.210.130, 2606:4700:3031::6815:4daa, 2606:4700:3037::ac43:d282
Redirect IPs 104.21.77.170, 172.67.210.130, 2606:4700:3031::6815:4daa, 2606:4700:3037::ac43:d282
Response IP 104.21.77.170
Found Yes
Hash f7db04020318eaee47ed176da867cab5287283b300f8a02799c2db5d2deaaafc
SimHash 2f565252eb93

Groups

gptbot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /forums/sendmessage.php
Disallow */attachments/*dl
Disallow /forums/search.php
Disallow /forums/esp_search.php
Disallow /forums/members/
Disallow /forums/login.php
Disallow /forums/post_thanks.php
Disallow /forums/members/list/
Disallow /forums/tags.php

Other Records

Field Value
sitemap https://www.dieseltruckresource.com/forums/sitemap_index.xml.gz