site.com
robots.txt
Robots Exclusion Standard data for site.com
Resource Scan
Scan Details
| Site Domain | site.com |
| Base Domain | site.com |
| Scan Status | Ok |
| Last Scan | 2024-05-08T16:48:17+00:00 |
| Next Scan | 2024-05-22T16:48:17+00:00 |
Last Scan
| Scanned | 2024-05-08T16:48:17+00:00 |
| URL | https://site.com/robots.txt |
| Domain IPs | 13.113.196.52, 34.211.108.46, 34.226.36.51, 35.176.92.19 |
| Response IP | 34.211.108.46 |
| Found | Yes |
| Hash | 732829a66f7fda83b993c4a21916381f6709c26187ba6e917af9da9f5fbb9281 |
| SimHash | 2320cbaccf93 |
Groups
*
| Product | Comment |
|---|---|
| * | applies to all robots |
| Rule | Path | Comment |
|---|---|---|
| Allow | / | allow all |
| Disallow | */secur/forgotpassword.jsp?* | - |
Comments