topia.blog
robots.txt
Robots Exclusion Standard data for topia.blog
Resource Scan
Scan Details
| Site Domain | topia.blog |
| Base Domain | topia.blog |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2024-04-13T21:15:05+00:00 |
| Next Scan | 2024-07-12T21:15:05+00:00 |
Last Successful Scan
| Scanned | 2023-09-10T21:14:05+00:00 |
| URL | https://topia.blog/robots.txt |
| Redirect | https://topia.blog/robots.txt?gi=a0aeca8fe0b8 |
| Domain IPs | 104.21.12.229, 172.67.196.138, 2606:4700:3030::ac43:c48a, 2606:4700:3031::6815:ce5 |
| Response IP | 172.67.196.138 |
| Found | Yes |
| Hash | 66e8b70c2c68f52a6a16d066fa21fd10d2aec08beaca843a4f420608cbbe17ef |
| SimHash | 6804fa65c773 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/ |
| Disallow | /me/ |
| Disallow | /%40me$ |
| Disallow | /%40me/ |
| Disallow | /*/edit$ |
| Disallow | /*/*/edit$ |
| Disallow | /r/ |
| Disallow | /t/ |
| Disallow | /search?q$ |
| Disallow | /search?q= |
| Disallow | /*/*source%3D |
| Allow | /_/ |
| Allow | /_/api/users/*/meta |
| Allow | /_/api/users/*/profile/stream |
| Allow | /_/api/posts/*/responses |
| Allow | /_/api/posts/*/responsesStream |
| Allow | /_/api/posts/*/related |
Other Records
| Field | Value |
|---|---|
| sitemap | https://topia.blog/sitemap/sitemap.xml |