allen.blog.br
robots.txt
Robots Exclusion Standard data for allen.blog.br
Resource Scan
Scan Details
| Site Domain | allen.blog.br |
| Base Domain | allen.blog.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-12-18T18:07:18+00:00 |
| Next Scan | 2026-03-18T18:07:18+00:00 |
Last Successful Scan
| Scanned | 2023-08-24T08:33:43+00:00 |
| URL | https://allen.blog.br/robots.txt |
| Redirect | https://allen.blog.br/robots.txt?gi=d299678abcda |
| Domain IPs | 104.21.44.159, 172.67.201.44, 2606:4700:3031::ac43:c92c, 2606:4700:3036::6815:2c9f |
| Response IP | 104.21.44.159 |
| Found | Yes |
| Hash | a194434405cef2b04c0e89205a1ccffad6dec954e771a179b1b35c156a6bc31b |
| SimHash | 69043b65cf3a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/ |
| Disallow | /me/ |
| Disallow | /%40me$ |
| Disallow | /%40me/ |
| Disallow | /*/edit$ |
| Disallow | /*/*/edit$ |
| Disallow | /r/ |
| Disallow | /t/ |
| Disallow | /search?q$ |
| Disallow | /search?q= |
| Disallow | /*/*source%3D |
| Allow | /_/ |
| Allow | /_/api/users/*/meta |
| Allow | /_/api/users/*/profile/stream |
| Allow | /_/api/posts/*/responses |
| Allow | /_/api/posts/*/responsesStream |
| Allow | /_/api/posts/*/related |
Other Records
| Field | Value |
|---|---|
| sitemap | https://allen.blog.br/sitemap/sitemap.xml |