penpalschools.com
robots.txt
Robots Exclusion Standard data for penpalschools.com
Resource Scan
Scan Details
| Site Domain | penpalschools.com |
| Base Domain | penpalschools.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-04-07T14:09:15+00:00 |
| Next Scan | 2024-07-06T14:09:15+00:00 |
Last Successful Scan
| Scanned | 2023-08-17T03:04:42+00:00 |
| URL | https://penpalschools.com/robots.txt |
| Redirect | https://www.penpalschools.com/robots.txt |
| Redirect Domain | www.penpalschools.com |
| Redirect Base | penpalschools.com |
| Domain IPs | 13.33.33.104, 13.33.33.124, 13.33.33.22, 13.33.33.32 |
| Redirect IPs | 199.34.228.48 |
| Response IP | 199.34.228.48 |
| Found | Yes |
| Hash | 1902ea3c4d3bb3f1c4614db51c64f3833f345c0bf1e98864ec332cbcc2c4b3bc |
| SimHash | 094420464b33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /apps/ |
| Disallow | /1247969782.html |
| Disallow | /2913097323.html |
| Disallow | /grant-review.html |
| Disallow | /quote-school.html |
| Disallow | /quote-custom.html |
| Disallow | /quote-internal.html |
| Disallow | /parentsold.html |
| Disallow | /updates-mark.html |
| Disallow | /updates-jess.html |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.penpalschools.com/sitemap.xml |