joshelman.medium.com
robots.txt
Robots Exclusion Standard data for joshelman.medium.com
Resource Scan
Scan Details
| Site Domain | joshelman.medium.com |
| Base Domain | medium.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T01:36:17+00:00 |
| Next Scan | 2024-10-04T01:36:17+00:00 |
Last Scan
| Scanned | 2024-09-20T01:36:17+00:00 |
| URL | https://joshelman.medium.com/robots.txt |
| Domain IPs | 162.159.152.4, 162.159.153.4, 2606:4700:7::a29f:9804, 2606:4700:7::a29f:9904 |
| Response IP | 162.159.152.4 |
| Found | Yes |
| Hash | cbe4d50f98507c660dabfe34186cb22188ca2008d469ebc8c15d6ef5a1f24e8a |
| SimHash | 6904ba65c732 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/ |
| Disallow | /me/ |
| Disallow | /%40me$ |
| Disallow | /%40me/ |
| Disallow | /*/edit$ |
| Disallow | /*/*/edit$ |
| Disallow | /r/ |
| Disallow | /t/ |
| Disallow | /search?q$ |
| Disallow | /search?q= |
| Disallow | /*/*source%3D |
| Allow | /_/ |
| Allow | /_/api/users/*/meta |
| Allow | /_/api/users/*/profile/stream |
| Allow | /_/api/posts/*/responses |
| Allow | /_/api/posts/*/responsesStream |
| Allow | /_/api/posts/*/related |
Other Records
| Field | Value |
|---|---|
| sitemap | https://joshelman.medium.com/sitemap/sitemap.xml |