pfew.org
robots.txt
Robots Exclusion Standard data for pfew.org
Resource Scan
Scan Details
| Site Domain | pfew.org |
| Base Domain | pfew.org |
| Scan Status | Ok |
| Last Scan | 2025-10-18T01:49:47+00:00 |
| Next Scan | 2025-11-17T01:49:47+00:00 |
Last Scan
| Scanned | 2025-10-18T01:49:47+00:00 |
| URL | https://pfew.org/robots.txt |
| Redirect | https://www.pfew.org/robots.txt |
| Redirect Domain | www.pfew.org |
| Redirect Base | pfew.org |
| Domain IPs | 192.124.249.55 |
| Redirect IPs | 192.124.249.55 |
| Response IP | 192.124.249.55 |
| Found | Yes |
| Hash | 6d4599013f3d61f230c607c4e85a588f2dc391136bed6818b20abca77d0a34db |
| SimHash | 79197d5628b1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /error |
| Disallow | /pfew-student-resources |
| Disallow | /template-subpage |
| Disallow | /template-landing |
| Disallow | /pfew-winners |
| Disallow | /thank-you |
| Disallow | /thank-you-ca |
| Disallow | /thank-you-email |
| Disallow | /pfew_gear |
| Disallow | /thank-you-judge |
| Disallow | /thank-you-speaker |
| Disallow | /identity |
| Disallow | /educator-portal |
| Disallow | /covid |
| Disallow | /survey-student |
| Disallow | /thank-you-student |
| Disallow | /student-application/registration |
| Disallow | /thank-you-shirt-order |
| Disallow | /pfew-shirt-order |
| Disallow | /thank-you-donation |
| Disallow | /student-sponsorship-decline |
| Disallow | /student-status-lookup |
| Disallow | /survey-test |
| Disallow | /survey-response-student |
| Disallow | /survey-SMG |
| Disallow | /survey-CA |
| Disallow | /pfew-lunch-order |
| Disallow | /thank-you-lunch-order |
| Disallow | /survey-preprogram |
| Disallow | /survey-SMG-prior |
| Disallow | /thank-you-ray-weber |
| Disallow | /pfew-ray-weber |
| Disallow | /MFA |
| Disallow | /thank-you-lunch-order-pct |
| Disallow | /thank-you-ambassador |
| Disallow | /survey-response |
| Disallow | /pfew-lunch-order-pct |
| Disallow | /ImportantPFEWRegistrationInstructions/PennCollege |
| Disallow | /school-endorsement |
| Disallow | /pfew_gear_inactive |
| Disallow | /survey-speakerseries-feedback |
| Disallow | /survey-SMG-training-assessment |
| Disallow | /survey-SMG-training-assessment-lesson |
| Disallow | /alumni-invites |
| Disallow | /thank-you-FinAid |
| Disallow | /tests |
| Disallow | /Important-PFEW-Registration-Instructions |
| Disallow | /thank-you-internapp |
| Disallow | /thank-you-RAapp |
| Disallow | /PFEWFinancialAid |
| Disallow | /thank-you-regional-programs |
| Disallow | /stripe_process |
| Disallow | /survey-bizsim-dropout |
| Disallow | /stripe_wh |
| Disallow | /survey-guardians-thanks |
| Disallow | /survey-bizsim |
| Disallow | /thank-you-speaker-series |
| Disallow | /signature_process |
| Disallow | /team-websites |
| Disallow | /survey-guardians |
| Disallow | /dei |
| Disallow | /Donovin-Lindsay |
| Disallow | /pct |
| Disallow | /peifer-article |
| Disallow | /fundraiser |
| Disallow | /donation-form |
| Disallow | /fundraiser_temp |
| Disallow | /pfew-alumni-info |
| Disallow | /pfew-alumni-news-share |
| Disallow | /rogers-memorial |
| Disallow | /donation-form-temp |
| Disallow | /alumni-legacy |
| Disallow | /pool-letters |
| Disallow | /CPCApp |
| Disallow | /thank-you-CPCapp |
| Disallow | /pfew-reality-fair |
| Disallow | /thank-you-realityfair |
| Disallow | /pfew-reality-fair-signup |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pfew.org/sitemap.xml |
Warnings
- 1 invalid line.