ivanovyordan.dev
robots.txt
Robots Exclusion Standard data for ivanovyordan.dev
Resource Scan
Scan Details
Site Domain | ivanovyordan.dev |
Base Domain | ivanovyordan.dev |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-06-22T07:31:39+00:00 |
Next Scan | 2025-09-20T07:31:39+00:00 |
Last Successful Scan
Scanned | 2022-05-04T02:19:39+00:00 |
URL | https://ivanovyordan.dev/robots.txt |
Redirect | https://ivanovyordan.substack.com/robots.txt |
Redirect Domain | ivanovyordan.substack.com |
Redirect Base | substack.com |
Response IP | 104.18.33.245 |
Found | Yes |
Hash | 82ca0de2b19375b8cd5b23397c70b7dbd408a95e94dd7e5a975784436eacceaf |
SimHash | 9828ab80c794 |
Groups
*
Rule | Path |
---|---|
Disallow | /action/ |
Disallow | /publish |
Disallow | /sign-in |
Disallow | /channel-frame |
Disallow | /feed/private |
Disallow | /feed/podcast/*/private/*.rss |
Disallow | /subscribe |
Disallow | /lovestack/* |
Disallow | /p/*/comment/* |
Disallow | /embed |