rachelbythebay.com
robots.txt
Robots Exclusion Standard data for rachelbythebay.com
Resource Scan
Scan Details
| Site Domain | rachelbythebay.com |
| Base Domain | rachelbythebay.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T20:56:51+00:00 |
| Next Scan | 2024-10-08T20:56:51+00:00 |
Last Scan
| Scanned | 2024-09-08T20:56:51+00:00 |
| URL | https://rachelbythebay.com/robots.txt |
| Domain IPs | 2001:470:1:954::215, 216.218.228.215 |
| Response IP | 216.218.228.215 |
| Found | Yes |
| Hash | aaa993d7688d9f151b9098fa753efcea3224ffe8b4adb7d5893ac46dd1dfc3f7 |
| SimHash | 530de170c881 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /edu |
| Disallow | /rpc |
| Disallow | /fred |
| Disallow | __null__ |
| Disallow | /__null__ |
| Disallow | __contact__ |
| Disallow | /__contact__ |
| Disallow | __NULL__ |
| Disallow | /__NULL__ |
| Disallow | /fun |
| Disallow | /fun/ |
| Disallow | /w/protofeed |
| Disallow | /pick |
| Disallow | /pick/ |
| Disallow | /api |
Warnings
- 2 invalid lines.