yamahapart.com
robots.txt

Robots Exclusion Standard data for yamahapart.com

Resource Scan

Scan Details

Site Domain yamahapart.com
Base Domain yamahapart.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-21T14:08:47+00:00
Next Scan 2026-04-21T14:08:47+00:00

Last Successful Scan

Scanned2025-01-01T22:31:13+00:00
URL https://www.yamahapart.com/robots.txt
Domain IPs 104.18.40.161, 172.64.147.95, 2606:4700:4400::6812:28a1, 2606:4700:4400::ac40:935f
Response IP 172.64.147.95
Found Yes
Hash d6787d3ae6e20baaa79a271b0c80a02ce32282f791517e286115bd1aa2ff9b8d
SimHash 642ed8656b53

Groups

*

Rule Path
Disallow /account/
Disallow /cart/
Disallow /widgets/webrequestproxy/

Other Records

Field Value
crawl-delay 10

amazonbot

Rule Path
Disallow /account/
Disallow /cart/
Disallow /widgets/webrequestproxy/

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Disallow /account/
Disallow /cart/
Disallow /widgets/webrequestproxy/

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Disallow /account/
Disallow /cart/
Disallow /widgets/webrequestproxy/

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.yamahapart.com/sitemap.xml

Comments

  • 20241218: vNext CMS - www.yamahapart.com