saylor.org
robots.txt
Robots Exclusion Standard data for saylor.org
Resource Scan
Scan Details
| Site Domain | saylor.org |
| Base Domain | saylor.org |
| Scan Status | Ok |
| Last Scan | 2024-06-28T15:38:16+00:00 |
| Next Scan | 2024-07-28T15:38:16+00:00 |
Last Scan
| Scanned | 2024-06-28T15:38:16+00:00 |
| URL | https://saylor.org/robots.txt |
| Domain IPs | 172.66.40.200, 172.66.43.56, 2606:4700:3108::ac42:28c8, 2606:4700:3108::ac42:2b38 |
| Response IP | 172.66.43.56 |
| Found | Yes |
| Hash | e23b7b6386768cd8031eb7925205750e248cefcf47989ebea807c6754caa5032 |
| SimHash | 4801aa024bb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /site/ |
| Disallow | /author/nobody/ |
| Disallow | /author/ryan-mcdonnell/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |