hetayparts.com
robots.txt

Robots Exclusion Standard data for hetayparts.com

Resource Scan

Scan Details

Site Domain hetayparts.com
Base Domain hetayparts.com
Scan Status Ok
Last Scan2026-02-03T07:13:46+00:00
Next Scan 2026-02-10T07:13:46+00:00

Last Scan

Scanned2026-02-03T07:13:46+00:00
URL https://hetayparts.com/robots.txt
Domain IPs 5.9.158.214
Response IP 5.9.158.214
Found Yes
Hash 78b10116c6cb2b630bdd9764c427f424439b0c44fa00523e02910785e0764da8
SimHash 6314c062e3b0

Groups

*

Rule Path
Disallow /api/
Disallow /images/
Disallow /my/
Disallow /johndeere/old/

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 500

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1