hotsr.com
robots.txt
Robots Exclusion Standard data for hotsr.com
Resource Scan
Scan Details
Site Domain | hotsr.com |
Base Domain | hotsr.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-29T12:13:34+00:00 |
Next Scan | 2024-12-28T12:13:34+00:00 |
Last Successful Scan
Scanned | 2023-12-05T11:09:40+00:00 |
URL | https://hotsr.com/robots.txt |
Redirect | https://www.hotsr.com/robots.txt |
Redirect Domain | www.hotsr.com |
Redirect Base | hotsr.com |
Domain IPs | 104.21.91.153, 172.67.223.116, 2606:4700:3035::6815:5b99, 2606:4700:3035::ac43:df74 |
Redirect IPs | 104.21.91.153, 172.67.223.116, 2606:4700:3035::6815:5b99, 2606:4700:3035::ac43:df74 |
Response IP | 104.21.91.153 |
Found | Yes |
Hash | cd06d9b1a144aaa099edc2d8f2686ceb1cd2dede715a72b0b18ef3484c0bfa35 |
SimHash | 63bf736aefc3 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets/ |
Disallow | /cgi-bin/ |
Disallow | /content/right2know/salaries/ |
Disallow | /content/right2know/salaries/search/ |