test.writing.upenn.edu
robots.txt
Robots Exclusion Standard data for test.writing.upenn.edu
Resource Scan
Scan Details
Site Domain | test.writing.upenn.edu |
Base Domain | upenn.edu |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-21T18:54:19+00:00 |
Next Scan | 2025-01-19T18:54:19+00:00 |
Last Successful Scan
Scanned | 2022-12-05T06:19:13+00:00 |
URL | https://test.writing.upenn.edu/robots.txt |
Domain IPs | 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3 |
Response IP | 23.185.0.3 |
Found | Yes |
Hash | 9feadcc82fecf061cb37d5101b5fc146ed8439dc11a2e425908dd2043d1e1afb |
SimHash | 18189c02c920 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-admin/admin-ajax.php |
Disallow | /author/* |