princetonol.com
robots.txt
Robots Exclusion Standard data for princetonol.com
Resource Scan
Scan Details
| Site Domain | princetonol.com |
| Base Domain | princetonol.com |
| Scan Status | Ok |
| Last Scan | 2025-03-04T11:01:12+00:00 |
| Next Scan | 2025-04-03T11:01:12+00:00 |
Last Scan
| Scanned | 2025-03-04T11:01:12+00:00 |
| URL | https://princetonol.com/robots.txt |
| Domain IPs | 91.242.252.131 |
| Response IP | 91.242.252.131 |
| Found | Yes |
| Hash | 820a5b000c756fdb7619b1e71e6286f42b2923794f528242534265d0fc1233a1 |
| SimHash | 693afb7dd5a3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ads/ |
| Disallow | /app/ |
| Disallow | /aspnet_client/ |
| Disallow | /att/ |
| Disallow | /autoscript/ |
| Disallow | /backtoschool/ |
| Disallow | /cgi-bin/ |
| Disallow | /ckfinder/ |
| Disallow | /cnews/ |
| Disallow | /customerror/ |
| Disallow | /dcads/ |
| Disallow | /dcforum/ |
| Disallow | /demo/ |
| Disallow | /directory/ |
| Disallow | /designs/ |
| Disallow | /error/ |
| Disallow | /fckeditor/ |
| Disallow | /fckeditor_small/ |
| Disallow | /Files/ |
| Disallow | /files%20as%20of%2020151231/ |
| Disallow | /fileuploader/ |
| Disallow | /gifs/ |
| Disallow | /linklogs/ |
| Disallow | /local/ |
| Disallow | /Multi-File-Uploader/ |
| Disallow | /nl-images/ |
| Disallow | /nplink/ |
| Disallow | /ntc_images/ |
| Disallow | /old/ |
| Disallow | /perlfect/ |
| Disallow | /polEditor/ |
| Disallow | /polInc_old/ |
| Disallow | /redesign/ |
| Disallow | /redesign_2003/ |
| Disallow | /redesign_2005/ |
| Disallow | /rimages/ |
| Disallow | /Scripts/ |
| Disallow | /SourceDocs/ |
| Disallow | /spnsur/ |
| Disallow | /stats/ |
| Disallow | /templates/ |
| Disallow | /test/ |
| Disallow | /Visual%20Studio%202008/ |
| Disallow | /Visual%20Studio%202008Projects/ |
| Disallow | /Visual%20Studio%202008Templates/ |
| Disallow | /webstats/ |
| Disallow | /sharedinc/ |
| Disallow | /*.exe$ |
| Disallow | /*.cfm$ |
| Disallow | /*.html$ |
cludo
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ads/ |
| Disallow | /app/ |
| Disallow | /aspnet_client/ |
| Disallow | /att/ |
| Disallow | /autoscript/ |
| Disallow | /backtoschool/ |
| Disallow | /cgi-bin/ |
| Disallow | /ckfinder/ |
| Disallow | /cnews/ |
| Disallow | /customerror/ |
| Disallow | /dcads/ |
| Disallow | /dcforum/ |
| Disallow | /demo/ |
| Disallow | /directory/ |
| Disallow | /designs/ |
| Disallow | /error/ |
| Disallow | /fckeditor/ |
| Disallow | /fckeditor_small/ |
| Disallow | /Files/ |
| Disallow | /files%20as%20of%2020151231/ |
| Disallow | /fileuploader/ |
| Disallow | /gifs/ |
| Disallow | /linklogs/ |
| Disallow | /local/ |
| Disallow | /Multi-File-Uploader/ |
| Disallow | /nl-images/ |
| Disallow | /nplink/ |
| Disallow | /ntc_images/ |
| Disallow | /old/ |
| Disallow | /perlfect/ |
| Disallow | /polEditor/ |
| Disallow | /polInc_old/ |
| Disallow | /redesign/ |
| Disallow | /redesign_2003/ |
| Disallow | /redesign_2005/ |
| Disallow | /rimages/ |
| Disallow | /Scripts/ |
| Disallow | /SourceDocs/ |
| Disallow | /spnsur/ |
| Disallow | /stats/ |
| Disallow | /templates/ |
| Disallow | /test/ |
| Disallow | /Visual%20Studio%202008/ |
| Disallow | /Visual%20Studio%202008Projects/ |
| Disallow | /Visual%20Studio%202008Templates/ |
| Disallow | /webstats/ |
| Disallow | /*.exe$ |
| Disallow | /*.cfm$ |
| Disallow | /*.html$ |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.princetonol.com/sitemap.xml |
| sitemap | http://WWW.PRINCETONOL.COM/trafficbasedsspdeltasitemap.xml |
| sitemap | http://WWW.PRINCETONOL.COM/trafficbasedsspsitemap.xml |