hardworkingtrucks.com
robots.txt

Robots Exclusion Standard data for hardworkingtrucks.com

Resource Scan

Scan Details

Site Domain hardworkingtrucks.com
Base Domain hardworkingtrucks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-04T03:49:04+00:00
Next Scan 2025-02-02T03:49:04+00:00

Last Successful Scan

Scanned2023-10-12T01:24:31+00:00
URL https://hardworkingtrucks.com/robots.txt
Redirect https://www.hardworkingtrucks.com/robots.txt
Redirect Domain www.hardworkingtrucks.com
Redirect Base hardworkingtrucks.com
Domain IPs 89.106.200.1
Redirect IPs 3.139.36.129, 3.18.77.221, 52.14.203.11
Response IP 3.18.77.221
Found Yes
Hash 558f7248823ffed16526000455ee60db236d0197617a6051b20af37b2d4022ec
SimHash 700550688b33

Groups

*

Rule Path
Disallow /__
Disallow /print/content
Disallow /search

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hardworkingtrucks.com/sitemap.xml
sitemap https://www.hardworkingtrucks.com/sitemap-google-news.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449