huntcal.com
robots.txt
Robots Exclusion Standard data for huntcal.com
Resource Scan
Scan Details
Site Domain | huntcal.com |
Base Domain | huntcal.com |
Scan Status | Ok |
Last Scan | 2025-05-05T16:33:02+00:00 |
Next Scan | 2025-06-04T16:33:02+00:00 |
Last Scan
Scanned | 2025-05-05T16:33:02+00:00 |
URL | https://huntcal.com/robots.txt |
Redirect | https://www.huntcal.com/robots.txt |
Redirect Domain | www.huntcal.com |
Redirect Base | huntcal.com |
Domain IPs | 104.26.6.136, 104.26.7.136, 172.67.72.208, 2606:4700:20::681a:688, 2606:4700:20::681a:788, 2606:4700:20::ac43:48d0 |
Redirect IPs | 104.26.6.136, 104.26.7.136, 172.67.72.208, 2606:4700:20::681a:688, 2606:4700:20::681a:788, 2606:4700:20::ac43:48d0 |
Response IP | 104.26.7.136 |
Found | Yes |
Hash | c1d3e1cf302b47f9ade9d9a92ca7f84ab3607e255dbc1cf5fffd20217e7c6e09 |
SimHash | e752df74c353 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /cgi/ |
Disallow | /cal/ |
Disallow | /img/ |
Disallow | /js/ |
Disallow | /cmt/ |
Disallow | /pay/ |
Disallow | /custom/ |
Disallow | /family/ |
Disallow | /ecom/ |
Disallow | /misc/ |
Disallow | /discms/ |
Disallow | /diversions/ |
Allow | /cal/faq |
Other Records
Field | Value |
---|---|
sitemap | http://www.huntcal.com/sitemap.xml |