hwequipment.com
robots.txt

Robots Exclusion Standard data for hwequipment.com

Resource Scan

Scan Details

Site Domain hwequipment.com
Base Domain hwequipment.com
Scan Status Ok
Last Scan2026-02-01T03:45:03+00:00
Next Scan 2026-03-03T03:45:03+00:00

Last Scan

Scanned2026-02-01T03:45:03+00:00
URL https://hwequipment.com/robots.txt
Domain IPs 192.190.221.2
Response IP 192.190.221.2
Found Yes
Hash eaa04a1c863e040d33e2f1d63b603d9293d7def78589c55e82e3947e3157e8a8
SimHash 64109191e3b4

Groups

*

Rule Path
Disallow /*?*search=*
Disallow /*?*address=*
Disallow /images

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.hwequipment.com/sitemap_index.xml

Comments

  • Popular User Agents: Googlebot, Bingbot, Slurp
  • Do not crawl google maps searches
  • Only allow robots to crawl a page every 3 seconds
  • Website Sitemap