nytcrosswordanswers.org
robots.txt
Robots Exclusion Standard data for nytcrosswordanswers.org
Resource Scan
Scan Details
| Site Domain | nytcrosswordanswers.org |
| Base Domain | nytcrosswordanswers.org |
| Scan Status | Ok |
| Last Scan | 2024-11-11T02:12:28+00:00 |
| Next Scan | 2024-11-18T02:12:28+00:00 |
Last Scan
| Scanned | 2024-11-11T02:12:28+00:00 |
| URL | https://nytcrosswordanswers.org/robots.txt |
| Domain IPs | 2600:3c03::f03c:94ff:fe72:4a80, 66.175.210.134 |
| Response IP | 66.175.210.134 |
| Found | Yes |
| Hash | 9d9065a4f3cc426f8341188041dda5194e6758a81111e94b3f9314d9a9cb2059 |
| SimHash | 1159d9808616 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | /embed |
| Disallow | /comments/feed/ |
| Disallow | /?replytocom=* |