ww.har.com
robots.txt

Robots Exclusion Standard data for ww.har.com

Resource Scan

Scan Details

Site Domain ww.har.com
Base Domain har.com
Scan Status Ok
Last Scan2024-11-14T00:36:48+00:00
Next Scan 2024-11-21T00:36:48+00:00

Last Scan

Scanned2024-11-14T00:36:48+00:00
URL https://ww.har.com/robots.txt
Redirect https://www.har.com/robots.txt
Redirect Domain www.har.com
Redirect Base har.com
Domain IPs 18.204.166.112, 52.72.217.0, 54.80.176.231
Redirect IPs 18.204.166.112, 52.72.217.0, 54.80.176.231
Response IP 52.72.217.0
Found Yes
Hash 65d33336e14506d01d385ba3ce44e20fea907f6c7abf512b573be4d2bf9a1467
SimHash 8a3c4d508192

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /social/
Disallow /20803562/
Disallow /dlreceipt/
Disallow /track
Disallow /search/flyer/*/avm
Disallow /api/getStaticStreetView
Disallow /api/staticmap

Other Records

Field Value
sitemap https://sitemap.har.com/sitemap.xml