sandiegoreader.com
robots.txt
Robots Exclusion Standard data for sandiegoreader.com
Resource Scan
Scan Details
| Site Domain | sandiegoreader.com |
| Base Domain | sandiegoreader.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-08T17:46:09+00:00 |
| Next Scan | 2024-10-06T17:46:09+00:00 |
Last Successful Scan
| Scanned | 2022-09-23T02:41:01+00:00 |
| URL | https://sandiegoreader.com/robots.txt |
| Redirect | https://www.sandiegoreader.com/robots.txt |
| Redirect Domain | www.sandiegoreader.com |
| Redirect Base | sandiegoreader.com |
| Response IP | 104.26.10.131, 104.26.11.131, 172.67.74.51 |
| Found | Yes |
| Hash | 3ccb619376ccaa5ab780b99626000dbc78546aa25abfce5ef8a98a2a0771803f |
| SimHash | 05164d00fe45 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mailfriend/ |
| Disallow | /search/ |
| Disallow | /events/search/? |
| Disallow | /events/*/reminder/ |
| Disallow | /oembed/ |
| Disallow | /radio/ |
| Disallow | /social/ |
| Disallow | /users/*/recent/ |
| Disallow | /comments/cr/ |
| Disallow | /groups/ |
| Disallow | /accounts/login/ |
| Disallow | /sitemap-moderation-moderationprofile.xml |
| Disallow | /admin/ |
| Disallow | /restaurants/opennow/ |
| Disallow | /categories/news/ |
| Disallow | /comics/ |
| Disallow | /photos/galleries/* |
| Disallow | /photos/galleries/sets/* |
| Disallow | /travel-photos/ |
| Disallow | /videos/* |
| Disallow | /videos/sets/* |
| Disallow | /searchalerts/create/ |
| Disallow | /alerts/ |
| Disallow | /san-diego-neighborhoods/ |
Comments