penpalschools.com
robots.txt
Robots Exclusion Standard data for penpalschools.com
Resource Scan
Scan Details
Site Domain | penpalschools.com |
Base Domain | penpalschools.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-04T14:09:57+00:00 |
Next Scan | 2025-01-02T14:09:57+00:00 |
Last Successful Scan
Scanned | 2023-08-17T03:04:42+00:00 |
URL | https://penpalschools.com/robots.txt |
Redirect | https://www.penpalschools.com/robots.txt |
Redirect Domain | www.penpalschools.com |
Redirect Base | penpalschools.com |
Domain IPs | 13.33.33.104, 13.33.33.124, 13.33.33.22, 13.33.33.32 |
Redirect IPs | 199.34.228.48 |
Response IP | 199.34.228.48 |
Found | Yes |
Hash | 1902ea3c4d3bb3f1c4614db51c64f3833f345c0bf1e98864ec332cbcc2c4b3bc |
SimHash | 094420464b33 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /apps/ |
Disallow | /1247969782.html |
Disallow | /2913097323.html |
Disallow | /grant-review.html |
Disallow | /quote-school.html |
Disallow | /quote-custom.html |
Disallow | /quote-internal.html |
Disallow | /parentsold.html |
Disallow | /updates-mark.html |
Disallow | /updates-jess.html |
Other Records
Field | Value |
---|---|
sitemap | http://www.penpalschools.com/sitemap.xml |