gohunt.com
robots.txt
Robots Exclusion Standard data for gohunt.com
Resource Scan
Scan Details
Site Domain | gohunt.com |
Base Domain | gohunt.com |
Scan Status | Ok |
Last Scan | 2024-11-15T21:44:58+00:00 |
Next Scan | 2024-11-22T21:44:58+00:00 |
Last Scan
Scanned | 2024-11-15T21:44:58+00:00 |
URL | https://gohunt.com/robots.txt |
Domain IPs | 34.217.168.228, 44.231.41.180, 50.112.82.42 |
Response IP | 44.231.41.180 |
Found | Yes |
Hash | 4443fe9d2d2a457030fd1c0ffc72d6abb8420edd36bea9a5408c27bd7bf7a9ae |
SimHash | af20c9d0af12 |
Groups
*
Rule | Path |
---|---|
Disallow | /browse/dashboard |
Disallow | /content/ |
Disallow | /contentful/previews/ |
Disallow | /mobile/ |
Disallow | /not-found/ |
Disallow | /read/ |
Disallow | /remotes/ |
Disallow | /user/account |
Other Records
Field | Value |
---|---|
sitemap | https://www.gohunt.com/sitemap.xml |
Comments