ww.har.com
robots.txt
Robots Exclusion Standard data for ww.har.com
Resource Scan
Scan Details
Site Domain | ww.har.com |
Base Domain | har.com |
Scan Status | Ok |
Last Scan | 2024-11-14T00:36:48+00:00 |
Next Scan | 2024-11-21T00:36:48+00:00 |
Last Scan
Scanned | 2024-11-14T00:36:48+00:00 |
URL | https://ww.har.com/robots.txt |
Redirect | https://www.har.com/robots.txt |
Redirect Domain | www.har.com |
Redirect Base | har.com |
Domain IPs | 18.204.166.112, 52.72.217.0, 54.80.176.231 |
Redirect IPs | 18.204.166.112, 52.72.217.0, 54.80.176.231 |
Response IP | 52.72.217.0 |
Found | Yes |
Hash | 65d33336e14506d01d385ba3ce44e20fea907f6c7abf512b573be4d2bf9a1467 |
SimHash | 8a3c4d508192 |
Groups
*
Rule | Path |
---|---|
Disallow | /social/ |
Disallow | /20803562/ |
Disallow | /dlreceipt/ |
Disallow | /track |
Disallow | /search/flyer/*/avm |
Disallow | /api/getStaticStreetView |
Disallow | /api/staticmap |
Other Records
Field | Value |
---|---|
sitemap | https://sitemap.har.com/sitemap.xml |